[JoeyP]

I agree,
Don't be pulling him or be tugging with him with the leash

Say NO!
and wait for him to calm down
don't take him out until he is calm

If he does this when he is outside say NO! and stop
ignore him until he stops doing this and then and only then do you move on