I think it's awesome that you finally used your "stern voice" at a time when it was completely necessary. Because you always talk so sweetly to him, he probably really clued in that this was SERIOUS and that you aren't messing around when it comes to him running out the door. Don't be so hard on yourself!
