Not based solely on size. The subtle difference, as I can tell, is found in their ears (location on head and shape) and snout, though size does generally help, too. Of course, each doggy is a bit different, and some may not be full-bred Yorkies. Check out this site for some additional clarity:
Silky Terrier Vs. Yorkshire Terrier