If kids where there I would leave him at home if he's not use to kids. My Yorkie Tibbs loves my son 3 years of age but other kids really seem to stress him out because well kids love dogs . But it can be a little scary for your puppy :s I agree that you should slowly introduce him to people you visit often
I hope this helps!