Personally, unless there is something about the lab's personalities that would have you worried, and there would be no way to keep them separated if needed, I would lean toward taking your yorkie with you.
Labs are big but typically gentle, I think if they are introduced slowly and controlled they would be fine. My odds are your yorkie would rule the pack by weeks end.
As for leaving him at home 11 weeks is still sort of young to be left alone that long. Bentley will be 7 months this month and will be next week that he will be alone all day for a couple of days. I keep him in doggie daycare at my parents while I'm at work.