For a puppy you actually struck gold as he does not seem to be too cumbersome for a normal pup . . . so I know it will just get better in time, once you are so used to him being around knowing he is not a trouble maker like normal puppies are
since he is still tiny, why don't you just tag him along. Get a discreet puppy purse and get him used to being with you without having to make any noise at all . .you'd be surprise to find out you can take him anywhere and everywhere. My Annika is very territorial and will bark at anyone who comes to the house . . however, when i take her with me, NO ONE would even know she is with me . . as she is as quiet as a mouse . . when I travel she goes with me to restaurants and groceries with no problems
Welcome to YT and look forward to seeing pictures of your little boy.