From what I understand, what is happening with you dog isn't uncommon. I'm not sure what the best thing to do is. You might want to call your vet and see what they say.
Oscar has double canines on his bottom, but as they don't seem to be causing a problem, I'm going to leave them for now. Someone told me there is still a possibility they will work themselves out.
I'll be intersted to read others' replies as I'm also curious about this.
Good luck!