Welcome to Yorkie Talk!!
Nope, you're not crazy.
There are a lot of people that take their Yorkie with them.
I don't because unfortunately most places around here don't allow dogs.
Mine wouldn't stay still in one of the carriers.
If she would I might try to sneak her into places with me.
So....I say do it!!! Especially if dogs are allowed in places around you or if your little one will be still in a carrier. Good luck.