I'm shocked that your first doc put you on Androgel when your total T was 640! Did you have your E2 (estradiol) tested at that time? Ever tested? How about your LH and FSH?
Dr. Crisler would be the best person to answer the questions in your last paragraph. If you like, post all your lab results to see what comments may be offered.