Yes I would keep any dog I brought into my life unless
for their own good I had no choice but to rehome - but I'd do everything in my power to not let that happen.
My girls bonded to me BIG time within the 1st 24 hours - and while they love my husband they don't have too much to do with him unless I'm right there. As long as you love the dog then let them bond in their own time and even if they never do - providing the best home possible is something every dog deserves.
I don't want to sound rude but you keep calling your Yorkie an 'it' ...do you have a male or female ? It doesn't sound like you bonded yet as you haven't even called him/her by name in your post...and that's just an observation only !!!