As for the hearing, I would wonder if it is different pitches or tones he is having trouble hearing. Have you tried talking in a high, squeaky voice or a really low and deep voice to see if there is a difference?
Sadly, my guess with the agitation is that his mental functionng is slowing down and you might even say senile. If it is not that, I would think something is up maybe in his brain?