Congratulations.
It can be a little scary having a little Yorkie for the first time, and the most important thing is to keep him safe and fed every few hours.
He should not go outside on the ground until all his vaccinations are complete, as he could get parvo which is deadly. Make sure everyone in the house is aware of things that are toxic to dogs (there are lists) including grapes, raisins, Xylitol in sugar free gum etc., macadamia nuts. and many plants. Puppies are wigglers and can wiggle right out of your arms and break a leg, so hold securely. Be careful not to let him jump or fall off a bed or furniture.
Have a potty training plan in mind, and don't give him unsupervised freedom in the house until he is reliable. Clean up any "accidents" with an enzymatic cleaner or he will go back to the same spot and potty again.
Here is a link with more info:
http://www.yorkietalk.com/forums/pup...w-parents.html
Enjoy him, and share stories and pictures when you can.