Hi! Congratulations on your new baby!!!
His whole world is now changed and he has a lot of getting used to it to do. You, as my DH would say, are "the mommy" and 'cuz he loves you already and is forming that forever attachment to you he will miss you when you are gone especially until he gets used to you leaving
and returning. We had that here at first, too, but it should get better. DH seems to deliberately excite them

but, based on all my previous experiences with animals, I just leave as matter-of-factly as possible..."love you"..."back in a" then "little while" vs "few minutes" vs "one minute" vs "right back" then come back just as calmly..."see? right back." They sleep on my pillow...I can tell by the 'dents' which is comforting and snuggly to them...and keeps them 'near me 'cuz they sleep there with me at night, too. They still get excited and happy to see me when I return home and bounce and wriggle like little sausages on a hot griddle, but I maintain a very calm, "hi...how're you doing" exterior and just let them bounce...and they no longer whimper anxiously like at first...especialy Mia who is kinda high strung and hyper. I do my thing first,
then pick them up for huggies and kissies and a quick play session...they know the drill now. My aim is to keep them as calm and stabilized as possible and indicate my 'in charge' position by being as consistently calm and stabilized as possible myself...even though I am equally happy to be home with them.
Good luck with your new fur kid!