To answer very simply, YES, this will (and is already) most definitely negatively affect this poor little dog. Is the brother ever at home alone w/ the dog? If so, I'd be severely concerned for this poor baby's safety
. If it were me, my dog would never, ever be in the hands of someone like this.