I have a yorkie and I also have 3 children ages 6,4 and 2. They did and do great with him. Granted now he weighs 8 lbs.
So not a big deal now, but I also have a chihuahua who is 4 lbs at the moment and probably won't get bigger than 7lbs. You just have to make sure the kids know how to handle them. I always told/tell my little 2 year old to "pet easy/be easy". And she does great with them. And I don't let her carry them around. She has to sit to play with them. My 4 and 6 year old don't play rough with them, but since they are older they understand. And actually, it's my doggies that are alway trying to play with the kids.
I don't think you'll have a problem as long as you teach them what to do and what not to do with the little puppy.