hm... did you "love" him too much when he was a puppy? because some yorkies apparently doesn't like to be cuddled/bothered too much as a puppy.
my parents said i did that to mine (i was only 9 y/o i always wanted to hang out w the dog) and ever since he avoids me as if i have some deadly plague
however, if you don't feed him and don't take him for walks at all, that could be the problem
i agree with other posters if your dog eats treats (my dog doesn't for some weird reason) try bribing him
