I agree with everyone else. Both mine stay home while hubby and I are at work. Lexie stays in her crate and Tucker stays under a laundry basket with a potty pad under it, until he won't pee/poo the crate anymore. We tried leaving them in the x-pen during the day but they went NUTS in there while we were gone. I would find the pen moved nearly 10 feet and they would SCREECH when we got back home so we went back to the calmer, safer crate/laundry basket method. They are just fine doing that and Lexie actually LOVES to be in her crate where it's soft, warm, and she has her favorite fuzzy friend. Tucker's not so fond of the laundry basket and even with a full laundry basket on top managed to move out of the bedroom and down the hall...just don't know what I'm going to do with him
Anyway, I think your baby will be just fine without you while you're at work, just give him extra love on the weekends!