I think maybe, Busters instincts are kicking in and, he senses your dislike for him.
Yorkies, are VERY smart dogs and he is trying to make friends with you and wiggle his way into your heart. I think also he must sense you as the real ALPHA leader in the family and is being submissive to you.
The most beautiful sight I've ever seen was my Nephew who was a CEO in FL for DOT. He and his wife had a Yorkie. We all went to the Mts. together on a mini vacation. My Nephew took his dog out to potty and at the door where he thought nobody could see, he gave his Yorkie baby a good night kiss. I still tear up when I think of that moment. They are both dead now so that makes the memory even more special.
I hope you change your feelings about Buster. If you do you'll have the best friend you ever knew.