Thanks for all of the advice. And he is a very squirmy baby.
I chose the route of washing just his head and face since his head seems to look oily. Then I just use my fingernails and gently get the gunk out quick. May not be the best idea, but it works.