Oh how funny and totally normal. They are like little human babies and yes will want to eat anything that is not allowed.
You are doing your best it sounds by picking up anything "forbidden" that you can find, but yeah they will still manage to find that last little hidden object and go at it!
Good luck!
