Inverted rows aren't particularly intense or draining, so I would just throw them into the mix as needed. If you just want a little extra upper back work, just do a couple sets at the end of every workout. If you really want maximum size and strength, I wouldn't drop the BB rows for any significant length of time.