Yes! Keep dragging him out! He'll never get over it unless he gets used to it.
I'd suggest socializing him more, take him out whenever you can, have friends over. Get him used to people of all shapes and sizes! Puppy class will be good for socialization but it sounds like he could use a little more!
