You are right, they love attention and being with their family. You must leave him alone while you're at work but why not try putting him in the room with you at night? He wants to be near you. Giving in on this won't spoil him.
Like Judy, I love seeing Gus' face pop up from his xpen every morning.