It depends on what kind of growl it is. You don't want him to continue that behavior if he is being possessive or protective over you especially with your own daughter. There's a difference between a playful growl/bark and a protective bark so hopefully you can detect which one it is. I see far too many Yorkies who guard their owner ferociously, don't let other dogs or people near them, etc and you do not want to allow that to continue in my opinion. Nothings wrong with a lap dog
some dogs are just naturally like that... but I also wouldn't baby him/spoil him too much as hard as it may be because you want him to be able to socialize with other dogs and people too.