With 6 years having past your body is probably in a steady-state, i.e. not in the process of recovery. Thus if you were going to develop gyno you would have.
Why is it you want to take a "anti-estrogen pill"? Are you still having symptoms? If so, what are they? Do you just still ahve puffyness in the nipples for the past 6 years?