I would have the vet pull them even though it can be a little costly. It's a one time expense. The odor you smell is teeth rotting and could even be painful for your little one and worsen with time. I would be afraid it might also lead to more problems like gum disease.
Jackie & my 
Sophie 