When Peanut was younger, he would pick up everything too. You just need to be consistent about not letting them pick up things they shouldn't have. When we would go to the park, he would try to pick up every leaf and twig. I started taking a small soft toy with us and would give that to him to carry. It seemed to help. It should get better as your little one gets older. They really are just like little babies, everything goes in there month. You need to watch them every minute.