If someone doesn't want to look at your blog, then that is fine. But there are others who enjoy looking at your blog! I wouldn't worry about it. You should be flattered that so many people are discussing your blog, good or bad.
Here is my philosophy:
People are going to talk....might as well give them something to talk about
There's no such thing as bad publicity...if people are talking about you, whether what they are saying is good or bad, then that is a GOOD thing! I personally like to get people talking!
Great Minds Discuss Ideas. Average Minds Discuss Events. Small Minds Discuss People.