I feel so bad for him. Obviously the loundness of all of your voices frightened
him. It is possible to talk in lower voices? I guess some pups are more sensitive to sound than others. Perhaps he thought he was being scolded.

I hope someone else can come up with other suggestions for you.
Carol & Buddy