Oh my gosh I feel so badly for your situation
I'd hold firm on leaving your babies, though, especially your little AAI girl.
It might be time to get a power of attorney for his finances, too. If he's schmoozing up women, one of them could scam him out of all of his money
There are SO MANY bad bad women out there just looking for an opportunity to fleece an old gentleman.
Perhaps there are YT'ers in your area that would be willing to dogsit. You'd at least know that your babies would be in good hands.
Hugs to you!!!