Do you interact with the people looking at him? If I start talking to whomever is looking at them my two will look up at me and then wiggle around letting them know they'd like to be petted
He may just be barking to 'protect' you and if he knows the people are okay he will probably settle down. Works for me.