I keep my babies harnesses on all day and when they need to go out it's just clipping on the leash and go... I keep it this way until they are potty trained! You never know when you need to make a mad dash to the door!
I take them off before they go into their crates at night. It's part of our routine. They know once it comes off it's bed time