sounds good to me! that's actually what i do. Kash stays in his ex-pen all day while i'm at work with his covered crate, toys, food/water, and pee pad. when i get home, he is let out and i play with him (or he plays with the cats) until it's time for bed, then he sleeps in my bed with me. he holds his pee through the night. come 6 a.m., it's back to same routine (monday-friday).
you have my blessing. lol.