Welcome to YT! Make sure your vet OK's the puppy being outside. Sometimes, even if they don't have contact with other dogs, they can pick up diseases from water or animal dropings outside (even though I live 10 minutes from Manhattan, I saw raccoons in our fenced in yard!). Hopefully the weather will be getting better soon but for now, make sure your put some nice sweater or coat on the pup.
My vet advised me against taking Pepper out until he was 3 months or so (even in closed yard), I wish you good luck potty training, sometimes it can be a challenge
