That's a hard one. I say if you are getting attached, definately keep him!! If you're not, find him a good home, he deserves to be with someone who thinks he is perfect.
That being said, I think sometimes people get set on a dog weighing a certain amount, myself included. I have a friend who has a yorkie, and she told me 3.5 pounds was the perfect weight. I had never seen a dog that weight, I just trusted her opinion and looked for a dog that size. I ended up fallling in love with my little guy, and the breeder said he might be 3.5, but he could be 4 or more. I got him and now he's at 4.5, I love his size, but he could be bigger and that would be fine too. People remark everyday about how small he is, I can't imagine if he was smaller. I just think now I was pretty ignorant thinking I wanted one so small, not ever seeing any dogs in person that size. If you haven't already, I suggest looking at some adult yorkies in different sizes, and see if you still want one that small. Hope this helps, good luck!