First of all, his great Aunt is wrong , Leo is
adorable !
As far as the rest , I would just leave Leo home if your only going over for an hour or two. If your going to be longer I would tell Eric to tell them, " Look we want to come over but the cat is always stalking and trying to hurt Leo and we don't want that , we know it's your house but if we are coming and bringing him with us , you are going to have to put away the cat for a bit ".
It seems like his mom likes when you guys visit and while I know it is their house , they need to understand that you want to protect Leo , and if they want you there they will just have to put the damn cat away .