Imo, if your already stressed over this, its probably not a good idea. eveyone will want to hold and pet your baby, and that is alot for them to deal with. not to mention the strange place and so much going on. if it were me--- i would either stop over for a short visit (without your baby) or find someone to pet sit. it neither of those are a option, then id probably stay home.
And 1 other thing to think about. you dont know where all these other people have been, and what they may have touched or come in contact with--before touching your baby. have the been exsposed to any pet viruses/ illness that could be transfered to your baby? your baby is young and isnt stong enough to fight alot of things off.
again this is just my opinion---but i wouldnt.