Welcome to YT. Your baby is adorable. The baby wipes are a good idea.
When Trixie had her pups, we gave them a bath for the first time at about 5 weeks. Very warm (not hot) water and would wrap them up in a warm towel out of the dryer. They have such short hair at that age...they were dry before the towels could get completely cooled down. And very gentle baby shampoo...a very small amount.