My Lady used to get the same thing. They are called sebaceous cysts. If I recall, my vet said they were related to Lady's allergies. I have been giving Lady 3V caps for her allergies for several years now and she hasn't had anymore. Not sure if this is a coincidence or not, but it might be worth a try. Fatty acids have all kinds of health benefits.
Sebaceous Cysts in Dogs