Same here.
If you weigh more than a little girl, your going to have to install the brackets, or throw a efw more nails into the moulding. Personally i just hammered the brackets into the wall with picture nails, and I have done hundreds of pull-ups since w/o a problem... I think the bar itself will break before the brackets come out.