I dunno, there are a few things I like highlighted that you can’t easily do with just a tokenizer, like parameters or function calls.
> Auto-formatting is also easy: just don't do it.
I agree with this, except that auto-closing grouping symbols is extremely useful and turns out to be pretty easy to support.