Plus the heavy musculature (especially with atrophic testicles)would be a giveaway that you might be abusing steroids.
The doctor will probably put down hypogonadism and steroid abuse on your medical file and you'd be a pariah dog for the rest of your life. Employers, insurers, doctors, psychiatrists all have access to your medical history.