About 3-4 weeks ago I punched a guy and immediately afterwards I had ice on it for a long time. Well it hasn't gotten better. I hit it right on the pinky knuckle, and the outside of my hand is visibly swollen compared to my left hand. However It does not effect me in lifting, the only time i ever get any pain in lifting is on a certain variation of a curl with a twist at the end. Otherwise it only hurts when I squeeze my fists without a dumbell in it, or if I bump it wrong. Is their a chance it could be broken? I am hesitant to go to a doctor because I fear they will tell me to take a week or more off of lifting, which I wouldn't do because it isn't that big of an inconvenience. as of now.