Have you considered trying to litter train him?
I use a grid system, and Harley will go inside and outside, it would take a bit of initial work, but then you or anyone else wouldn't HAVE to put him out, then he would just have to go out to play etc.
check out this link.
http://www.yorkietalk.com/forums/gen...while-ago.html