I used to do this! I would be listening to what a person had to say and already forming a reply in my head! When they would question whether I was listening I would get offended!
It took a long time for me to understand that you listen by hearing the words, feeling the atmosphere, seeing their body language, and not thinking about a reply until they had said all they needed to say! 

 Yess!!!