Wasn't Damer Flinn a soldier in Andor before he became an Asha'man? I think that as a soldier, he must have been in a lot of stressfull situations. And he hadn't even started slowing when he came to the Black Tower, so he can't have channeled almost anything. I mean, even Morgase is pointed out as someone who looks younger than she is, and she can barely channel.
Once again, let me point out that I don't believe that Mat (or Perrin) can channel. I just feel that we can't be 100% sure that: