These dogs constantly stand at my fence....staring at Simon
That alone would have me worried. There was a situation just like this on Animal Cops but with Rottweilers. They managed to get through the fence and kill the neighbors Chihuahua.
Don't trust them for a minute.
Sorry, I don't have a solution to your problem since you don't want to keep them inside but I think you are right to be concerned.