Jesse will be fine..Im sure it scared him as much as it scared you but with gentle encouragement and time he will enjoy walks again. The other night when I was walking Reece I did the exact same thing and off Reece went which is unusual for him and I FREAKED out..I couldnt beleive I just let go of the handle..but IT DOES happen and it dosent make you a bad mommy..
Dawn