I had a Hydrocele while in college, my right testicle sac blew up to tha point I couldn't lay on my stomach. This was in a matter of a few weeks too. I seriously thought I had cancer and was going to die, but tha good news I lived to forever be called "Super Nut" by my housemates.
I know varicocele and hydrocele are similiar but I forget how and I'm pressed for time right now, so I'll get back to this. I'm pretty sure it was about two weeks until I could do light activity and close to a month before I felt I could seriously hit tha gym without worries due to tha swelling and stitches but YMMV... it's sorta similar to a vasectomy.