As long as your puppy is safe and has room to eat, sleep and go potty this shout be ok. Your puppy will probably start sleeping while away, and then when your back want to play and demand your attention.
If your still not sure about the set up, then maybe a close friend or family member could come over and check on her/him and spend time with your puppy during the day.
