Hard to really give advice without seeing you in action but not keeping your abs in tights and building too much pressure by straining too much can cause this effect. It also can be from your core not being conditioned enough to withstand the weight just yet.
Also, once you get to a certain weight. Wearing a belt is a definate help in keeping your insides in place. I would first suggest trying a belt to see if this alleviates the problem.