I guess if it made them feel superior because they're dog was smaller than yours, they don't have too much going for them.
People like that are to be pitied. Nothing you could have said would have gotten through to them anyway, so you may as well have bitten your tongue.
Some people are just too dumb to get insulted.