They may or may not come out on their own, Josh--you're doing the right thing by giving him stuff to chew to make them fall out. Another great thing you'll notice soon is the "foul stench of death" breath from the food that gets stuck between the 2 sets of teeth!
Many of us have the vet pull the baby teeth when our babies are neutured. That way, they only need to go under anesthesia one time. I know it sounds like a lot, but Basil was neutured, had 7 teeth pulled and was microchipped all at the same time. I was sure I'd be picking up a very sick little guy that afternoon, but he was bouncing around like a nut and ate like a horse when he got home.