I don't think you are over reacting,she is only 4.2 lbs. My bab is 5 lbs six month old and dose not drink much at all.
You should at least,call the vet. It would not take much for a little dog to be dehydrated.
I would be a little worry (freak out) too