When running SERMs, what happens is that as your testosterone levels rise, your estrogen will follow. And high estrogen can affect libido.
Consider using an AI like Aromasin (exemestane) in moderate doses to keep your estrogen at a healthy range. Have you done bloods to see where you are?