> ... if it doesn't do full recognition of your input before you do any processing then you're likely boned.
There are languages where you need to process some of what you've done before a later part of the source can be dis-ambiguated. How does that sit with what you've said here?