Elizabeth ... you were absolutely within your rights ... quit beating yourself up!!!
There is absolutely nothing more irritating than a child/baby misbehaving and the parent just seemingly ignoring it! What?? Do they actually think it is cute???
Every church we have ever attended has a nursery where you can leave smaller children! Even if they don't provide one for every service, they certainly provide one for those special services!!
Don't feel bad at all!!! The worse that can happen is for you to forever be known as
"Mean old Mrs. Eensor"!!!! 