He's very cute! Now, in that picture, he is on your furniture and looks just as happy and content there as any yorkie I have ever seen!
I have never punished a doggie and I've had them from the time I was a very young child. Positive reinforcement will get you ten times further with a doggie than anything in the world. Punishment will only push a doggie away from you and break the bond between you.