He will be fine. Make sure you pack up his stuff last and unpack it first. Loki doesn't like change but as soon as his crate comes out he settles in no problem. We stayed with my brother for a weekend and he was restless for an hour or two and he kept going to the door to leave. As soon as I pulled out all of the toys I brought, his water and food bowls, his crate, etc. he realized we were staying for a while! Then he claimed my brother's bed as his own, HA!
Sammy doesn't care - she is happy wherever she is. Sometimes I think the boys are more sensitive.