Congratulations on your new little one! As with so many puppy issues, time, patience and love should help matters. As others have said, he will need some time to build a relationship with you in order to trust that he can depend on you to keep him safe from all of the new sights, smells, noises, etc. that he is experiencing.
Best of luck, and welcome to YT!