Pepper used to do the same.
More so when he was younger (he is 10 months now). As if he was trying to find a hiding place for the family jewels...Someone told me, it is because in the wild, pups want to find a place for their waste that best protects them from being found by predators.