We build entire JavaScript, Ruby, and Python interpreters using the native code generator, so we do know it works for non-trivial applications and libraries. I've also used it to do things like compile the third-party Apache SIS geospatial library for use from a native application without issue.
The author's tried just one benchmark - there are many other benchmarks and use-cases. Twitter report it's around 11% faster for their real and extremely large codebase, so we also know for other people it's significantly faster.
That must be a nice benefit of being part of a large corporation is being somewhat more delineated from the hype cycle of innovations like this.
"Yes ma'am I understand your router keeps rebooting, but I made it so that you can flush your toilet now."