We have put our puppy out since he was 8 weeks old (when we got him). He's a puppy, it's very natural for them to go OUTSIDE. There are days when it was below zero, he learned really fast, if he goes potty, he goes in. Luckily for my first few weeks the temp was mid-20's and we had smooth sailing, and by the time it got so blasted cold, he already knew what to do
It's been upper 20's and low 30's with about 2 feet of soft snow, and HE LOVES IT. He charges through the snow like crazy and has a LOT of fun outside with the kids, and he's only 3.5 months old!! He knows that if he sits by the door, it's time for him to go in. I think my little spit-fire will go NUTS once it's REALLY nice out like your 54 degrees, he won't know what to do with himself.