I have no lab evidence, but I have read numerous articles stating that 1 drink will not have an effect, but after that it starts to increase significantly. Binge drinking having the biggest impact. I've always assumed this to be the case because I don't know anyone past 21 that doesn't appear kind of flabby with slight gyno that drinks a lot. Also, the down moody feeling that seems to accompany heavy drinking the next day could be associated with high e2 levels.
For whatever reason, beer seems to be the one they focus on having the worst impact. Red wine is usually the recommended path with the least impact. Probably because of studies done on positive overall health that red wine shows as helping.