So Vet looked at it and said this is nothing to be concerned about at this point. She basically said to just keep an eye out for inflammation in case it gets infected, but that we can leave it alone for the time being and re-evaluate once her adult canines start growing in, or it's time for her spay. She also recommended waiting until at least until she's 6 months old for the spay.
I guess this was such a minor thing, the vet decided to not charge us for the visit
But for future readers, I would still caution you to take your little one to the vet in the case of a broken tooth. Every situation is different; I just lucked out.