Nope....lots of debate on how your body consumes its nutrients but fat, at ANY time of the day, is never a bad idea. Assuming its healthy fats of course.
Either the case, the best time to eat something and have it hardly count against you (work against you) would be around your workout. Rather its before or after.