OP, I think it would be wise to convince your endo/urologist/pcp or whoever to check your Prolactin levels. If they won't do it, I would buy my own lab to make sure: privatemdlabs com
My testosterone was 140 when I was 33 because of a prolactinoma. My tumor is huge at 4cm and was spiking my Prolactin at 1400 (ref range 7-12), but even a 4mm tumor could cause your T to dip. My endo was convinced that I'd need HRT to get my T back to normal, but he was wrong, I'm at 430 and rising now.
Also, I would also look into seeing a Naturopath to get recommendations on herbs. They seem to work for me, but it's hard to get the dosage/cycle right.