You've gotten and will get all different opinions on this subject.
I would certainly not bring one home any earlier than eight weeks....that said, we did get Kiki at eight weeks, and never had a bit of problem!
In my (unexpert!) opinion, I would go by the size of the pup. I'd be uncomfortable bringing home one that young if it weighed less than two lbs.
Someone also mentioned the weaning process. I think a lot of problems occur with pups when breeders deliberately wean them or separate them from their moms too soon. But often the mom on her own weans them early. At eight weeks, Kiki had been weaned (by mom!) for quite awhile, and was well established eating solid food.
Oh, and that's another consideration....how good they're doing on solid food. Hopefully you have a breeder who will be honest with you on all these points.
Congratulations, and good luck!!!