How much sleep are you getting?
Main recovery time is when you sleep and not getting enough can greatly effect how quickly you recover
What does your leg routine look like?
If it is a good heavy leg day I would suggest simply cutting on the cycling for that day so your mucles are i nthe best shape to do a good heavy leg workout.
You also might want to only cycle once the day after your leg workout I know I am normally pretty sore the next day if I do heavy squats and leg press.
Honestly I don't know what your goals are but cycling that much a week sounds crazy. Given a nice slow bike ride is really not going to hinder your gains that much but sheesh hehe