Hi there and welcome to YT

I was thinking that he may have experienced sopme kind of Trauma too. Something that tells him touch is a bad thing, and he is very scared.
With Lots of patience, and time he should come around. I am glad he is in a loving home now. taking him to the vet needs to be done as soon as possible. talk to the vet about what you have observed , maybe he can give you suggestions.