From the video, one of his major complaints is that people learn RSA in their first year of university, understand the math, then roll their own. How hard can it be, its modulo and exponents. People don't tend to do this with ECC. They just pick a library.
You are right in saying that the same roll your own problems that occur with RSA would occur with ECC.