Yikes, I'm so sorry this happened to you. And don't feel bad about not picking him up. You were in shock and stopped dead in your tracks! Thank God he is okay.
I don't want you to make enemies with your neighbor, but they shouldn't be able to hop the fence like that! I'm sorry, I don't know what you should do.