I vary my workout times depending on my work schedule. If I have early morning meetings then I work out in the afternoon and vice versa. I wake up at 4am (even on weekends) and often don't go to bed until well after 11pm. Been doing this since before my daughters were born - they are now 18 - and my body is completely adjusted.
I have an added advantage in working from home in that I keep dumbells under my desk and will sneak in some lifting while on telecons
.