MY DH was the same. He wasnt very thrilled when I wanted to get a Yorkie. ( we had Germand Shepard, Doberman before ) He said just remember the yorkie is yours and I dont want to be seen with one.
The night we got Veer. DH was the one who said why dont we take him to bed with us, so Veer wont be afraid and stays safe.

Now Veer sleeps every night with us in our bed. DH plays with him all the time. Its funny to see DH chasing Veer around the house. DH never stops me from buying Veer new cloths or toys.
We take Veer on vacations. We are leaving to Orlando for 5 days and Veer is going with us. DH made sure to book a resort that accepts dog and didnt sulk to pay $25 a night for Veer.
DH even has a pet name for Veer "my little creep".
DH wont admit Veer is our dog but he readily admits he enjoys Veer more than any dog we owned. ( i will have to take a pic of them both sleeping )
Only a true man wont mind being seen with a Yorkie