Hehe, I know exactly how you feel. Cash used to be like that. He didn't snuggle, he didn't give me kisses, he just plainly seemed not to care too much. I used to get so jealous when he liked other people.
I think what helped our relationship a lot is clicker training. At about 5 or 6 months, we started training and now have a great relationship. I think ,for the less people-orientated dogs, you need to show them that constructive behaviour towards you will reward them. Everything improved greatly when Cash realized that we can work together and we can understand each other.
Cash is also more affectionate when there are other dogs around, so I am getting another yorkie

. He is getting a friend and I am getting loads more cuddles. Heaven for everyone.
I would definitely suggest training - I don't know what I would have done without it.
Good luck. It gets better - he will become more attached to you with time.