The poor little guy is through alot already in his short life. My guess would be that he is still recovering and somewhat confused about the back and forth. He just needs tons of love and body contact. Maybe you can hold and carry him around as much as possible (even in a "sling" blanket like for babies), and of course he has to sleep in your bed at night... (As you can see I'm an advocate for Yorkie babies that miss their birth family...
)