Yes! They will get used to it though. I think the sweater is distracting at first, and distracts them away from remembering where the potty is
It just takes them getting comfortable with it and continued training. Good Luck! Have a pic with the new sock-sweater?