Some people are lonely and not good at conversation (maybe why they are lonely?) Since you say Mrs W. and Bapsi are "nice" - maybe you can steer the discussion to some other topic and continue to socialize your little one with Bapsi.
My neighbor doesn't like to hear the dogs bark yet teases them thru the fence!
I explained to him a few times what he was causing- now I just let it go, life is short.
