Thank you all for the great suggestions.

I took him for a walk yesterday and took your advice about making sure he walks with me and it worked. For the most part he will walk along side of me but sometimes he doesnt. But not giving him a lot of slack on the leash helped tremendously. I havent had a chance to get a bark collar but in the meantime, I've been holding him down when he barked in the window and he calmed down. Im going to try the spray bottle again. I used it before but not on walks. So far so good!