I don't think it will bother him too much...and you are definitely not a bad mommy! He'll be fine, it will probably just take him a few days to get used to his new surroundings, and then everything will get back to normal. It will help a lot that he likes his crate so much!
Good luck!
