Yorkies tend to take more abuse than they should from kids. They don't bite or get grumpy, but you can see it in their eyes they're not having fun. I would worry much more about the Yorkie than I would about him getting grumpy with kids. It can be done, but with strict rules, and the bigger the better.
My Grandkids grew up with my Yorkies and their puppies. Here are their rules;
1. No running in the house. Use the Yorkie Shuffle at all times.
2. Never pick up and hold a puppy. They can sit down on the floor and get all kinds of kisses.
3. Make sure there is no puppy under your little bottom when sitting down.
4. At no time is there rough housing, carrying the Yorkie around, or using the puppy as a baby doll in a doll stroller.
They do really well, and they know I am a nut when it comes to my Yorkie's safety.