This doesn't work that well in practice:

- Humans can lie

- Human memory is too fallible to serve as this verification, particularly for every detail

- Small details with big impact can be changed in a verified speech without some people noticing

Of course if someone reliable records the actual speech, any copy can be checked against that. I'm not sure why human memory would be considered superior, as humans have poor memories and can lie.