Thanks to all of you for encouraging me
Last night I put him on his crate in our bedroom and he didn't bark all night long. He did a couple of times and I told him to be quiet and he did... I also placed his favorite bed inside the crate. He seems to love the bed so he doesn't pee or poop it. The bed is dry and he slept on it all night long!!!! We had to take him out a couple of times last night but at least I didn't wake up to a mess.
He is going pee outside without any problems but still refuses to poop outside. Is like he holds it until we get in and then he goes. I have him for 3 weeks now and planning to put him on a tight routine. I don't work so I have the time to stick to a routine.
Thanks again! I feel confident that this will come to an end eventually...