I totally sympathize with you! I posted elsewhere on this forum that I was having a hard time finding balance in my life between my part time job, my husband, 3 kids and 2 yorkies, plus friends and family, and social obligations.
I work 3-4 hours a day, several days per week. I try to work in the middle of the day, so that I'm with the pups in the morning and the evenings. Sometimes we go out to dinner, and I feel guilty about that. I'm also the one who has 99% of the responsibility day and night. Once they get older and housebroken, my load will decrease somewhat.
Since I have 2 Yorkies now, I feel a little less guilty about going out without them, but some guilt is still there.
At the end of the day, I know they love me, are well provided for, stimulated, socialized and loved by me and my family. I don't think they are suffering because I choose to work or spend an evening or 2 away from them. I'm always home by 9:00 p.m.

They've trained me well.