My hubby feels this way from time to time. Our girl loves him and I know trusts him, she just prefers her mommy.
I think it is because I am her primary caregiver, I mean I feed her, take her out for potty breaks, even take her on errands with me. She alway meets me at the door, and will run past him to greet me if we both come in.
I know it has nothing to do with trust. Since we have added another furbaby, her daddy has found her in his club moreoften lately. LOL He's gotten used to the idea she's using him.