I wouldn't worry about it. I did at first when Ziggy was a baby. I had to leave him in his crate(mainly for his own safety) when I had to be gone for awhile. Then I realized he just went to sleep in there and didn't seem to mind. When I came home he would be yawning and groggy but glad to see me. I knew he couldn't have been in there being hysterical.
