"Taken Back"

I was having a conversation with one of my employees about his performance and laid out a specific area where he had failed to perform. He apologized and said “I’m really taken back by what you’re saying.”

I think he meant to say he was “taken aback” but it did make me wonder whether he meant that we were having the same conversation about his shortcomings that we’d had before and that he was reminded of it.