Will there be "extended context" releases like 01.ai did for Yi?

Also, is the model GQA?