Did you remove the latch part? That goes through a hole in the side of the door frame and joins the workings of the knob.  Otherwise, give both sides of the knob a good jiggle and it should come apart.     
				__________________  Gracie loves Bailey. Holly loves Tucker. Proud member of the YT Gracie Girls.     |