In the long run, the belly band won't hurt him and it will give you some sense of mind. I know of others that have used them and I understand it does take a while for pups to get used to them...but they do get used to them. Stop feeling guilty...you'd feel much more frustrated and guilty if you never got him trained!!
You Can Do It and so can your pup!!