Retained baby teeth can become infected and the infection can spread to the adult teeth. They can also make the adult teeth crooked and weaker.
Here's a good article for you to read:
Chinaroad Lowchens of Australia - all about retained deciduous canine teeth