I never use fertilizer on any of my herbs or veggies. Remember, you are eating them! There are some fertilizers for herbs and veggies though. I am guessing they would be safe.
depending on how cold it gets, the herbs will usually not last through the winter. You can try bringing them inside! If you planted them in the ground you can put them in pots for the winter. If they are in pots just move them inside.
Just for example, last year at our old house I planted cucumber plants in the spring and by the fall they looked like prickly pickles! So it does take about a year for the veggie plants to get going for full bloom!
