I agree with everyone.... but if I were you I would be pretty upset if my husband honestly thinks "counseling" is a sincere apology!! He should be defending you and his child.. doesn't he feel angry with what his side of the family say about ur guy's kid?? It's his kid too! I dont know... everyone is saying to ignore it and just not be a part of their lives, but I feel like your husband should be more supportive of you and defend you more if he knows how much pain this is causing you... maybe have another talk with him?? Or one of your close family member/close friend have a talk with him..?
Good Luck and so sorry that this is happening to you. Pay NO attention at all on what they said about your son.. if anything they are probably jealous theirs didn't turn out as cute as yours

keep your head up and just ignore them!!