I agree with what everyone else had said. If you really don't feel right about it, then I'd suggest voicing your concerns to your husband taking him back to the breeder.
However.. there is hope. The second day we had Franklin, I realized how much of my time would be taken up and how much less freedom I had to do what I wanted and I started second guessing my decision. They grow on you, though.. and then they capture your heart and you couldn't let them go even if you wanted to. It does get better with time. You get used to having him around and they do eventually calm down once their older. Everybody has those moments and every now and then I still have them.. but then I think about how sweet he is when he's cuddling on my lap and everything gets better.
Hang in there.
