Appologies come in many different forms. I hope he knows that you just want to "hear" him say it.
It's been my experience that if you're direct and polite and they still won't give an ounce, then it's best to leave...things won't get better at that point.
I'm sorry about your situation, I hope this is the best thing for you.