Do you mean he's pooping all over or peeing, or both? Was his initial training for outside or for pad trained?? Is the poo normal or does it look unhealthy? How often is he pooing?
If it's not a health issue, then you truly do need to start over from scratch...even if it means tethering...
Welcome to YT

!