It's hard to talk about things when you or he are upset. Try just talking, talking calmly and non confrontational and let him know why you are upset. He probably saw you got upset, then he got defensive, then you got defensive and since you don't see each other very much that's sad. So try explaining to him calmly your feelings and then LET him telll you how he feels, without interrupting. None of us can really help how we FEEL, we just have to keep the communication lines open...calmly.