Yorkies are usually pretty forgiving if they can tell you really want a close relationship with them. Can you give it your all for 6 months to a year and really WORK at winning him back?
If that isn't an option for you I'm sure there is someone here with experience with bringing out the best in your little one