NOt a silly question at all, I dont think any question is silly because if it werent important you wouldnt ask it
I say yes:
1) to get him used to it
2) for vet appointments
3 incase you visit a friend and want to sit out on thier deck ect..
I still took my dog in MY yard, but no other dogs are in my area... so I was lucky...