You are just short changing yourself by not training your legs and back. The legs and back contain the most musculature in the entire body, and will do wonders for your physique when acquiring some development in those areas.
Sounds to me like you are relatively new to this game, and if that's the case I'd recommend you get on a basic strength routine to build your foundation. Focus on getting big and strong all over first, then worry about the details later.