320 is really low, regardless of being in range. When I went and got my first test at 36, I was sitting at 310 and the doctor told me to come back in the next week for another to make sure, and it was the same. That is when we started everything. No TRT, but a review of my lifestyle and a 3 month attempt to get things straightened out without adding anything. More sleep, diet changes, etc. When that did not do anything, I was referred to multiple endos and I am sure you have all read up on that journey. 3 different endos, bone scans, MRI, multiple labs, etc... In the end, it took about 6 months and my test before the decision came in at 287. I was always slightly irritated, low sex drive, working out twice as much to keep all my muscle, recovery times were slow, and I had brain fog.
The reason I write this is because you really want to think about options and find out what is really happening before making the choice. A simple testosterone test really tells you nothing. You have to dive in.