Yep, get them pulled. Chewy went yesterday for a teeth cleaning and had one last baby tooth to get pulled... His was 349.00. His baby teeth were pulled when he was neutered, but one last one grew in and never fell out.
Make sure you brush your babies teeth every day... the cleanings are a lot of money and no fun for your baby to go through.
