Oh my he is such a cutie! I'm Jealous!
Well being in a new house is hard but he will get better. I would not let him have free roam of the house. Some never get free roam. If you can not have your eyes on him at all times then into the crate or pen he goes. You will need to get him on a schedule for feeding and potty time. And I can't remember if you ever said he was fixed but it would be very important to do this as soon as your vet says it is safe. This would also help so he won't start marking.
Congrats on your little baby! I have been watching for your post since you said you were going to get him.