I was cursed with oily skin that caused skin problems in my teens and early 20s (now that I am in my early 40s, I see that my skin type is a blessing
).
I tried every kind of medication and product available. In the end, I found the main problem was that I was trying too hard to dry out my skin. The drying and harsh chemicals made my skin problems worse. Dry skin clogs pores and harsh chemicals aggravate the skin.
I recommend trying a mild cleanser like Burt's Bees Apricot Scrub. Then use really good organic, cold-pressed olive oil or organic coconut oil (I use Nutiva from the Vitamin Shoppe) as a moisturizer or just on your spots. Both of these kill bacteria without being harsh or drying.
It's seems weird and yucky at first to add oil to your skin, rather than drying it out. Try it for at least a couple of weeks. I have converted my entire family.
Also, change your pillow cases daily and wash them in a mild soap.