As it's already been said, all you really need to do is follow your heart
It will never steer you wrong! But, your hubby may have a point as well. It's only been a week, just as you have to adjust to a life outside your home by means of a job, your kids have to adjust to mom not being there each and every day. I'm a working mom and when my boys were little, especially the oldest, it was so hard to leave them the first week I returned to work after their births. I just wanted to stay home and love them and attend to their needs, not have someone else doing it for me! But - I love my job, enjoy the "adult" conversations I have and when the day is done and I'm home with my family, I enjoy them even more because of the time I've had away from them - if that makes any sense! If your heart isn't in it, then you'll have your answer but - my vote would be to give it at least a little more time if you truly enjoy what you are doing (and I can tell from your posts about your job that you do
). Best of luck and I'll keep you in my thoughts and prayers