GIve the puppy more time!! you got it recently and you are not at home that much; you cannot expect him to be attached to you that way, especially if there is someone else in the house who spends more time with him. Take him on walks, feed him, do stuff that an owner does, so he feels you are also the pack leader. And also, do not put the dog under pressure, he know if you are mad at him, and he''l be more scared of you.
Personally, I wouldn't rehome a dog unless he's putting the a member of the family in danger. But if I had a dog that just prefers to be with another member of the family, I would get a dog that would prefer me