I think he will be fine going outside for a couple minutes - even in the cold.
It gets very cold where I live, and you would think Lexi would get cold - but she loves being outside and playing in the snow. She doesn't wear a coat or sweater.
On the really nasty days (-40c) she is usually done her business in less than a minute and she is back inside.
