Congrats on your puppies!
Vet's normally suggest that you let the mama let you know when she is tired of nursing, normally around 5 or 6 weeks of age. I started weaning my puppies off their mama milk when they were 5 weeks old, but every situation is different.