Linda gave you some GREAT advice!
I leave dry out and my cats hardly touch it, I feed EVO from innova, the canned is 95% meat. And the kibble has Zero fillers. Its really good food, second best to raw if you ask me, but there are alot of good diets out there.
The key for you is Feeding WET! If your cats load up on the dry, pull it! Feed the wet and offer smaller bits of dry. My cats hardly touch their water as well because they get their water requirements from their wet foods, amd let me tell you, they poop firm little logs! No squishy piles here! The myth that wet food causes runs only holds true if your feeding crap and cheap treats!
You will spend a bit more for the food now, but save a small fortune in vet and medication bills later!