MPT-7B-8K: 8K Context Length for Document Understanding

MosaicML has retrained their 7B model with an 8K context length window for their base, chat, and instruction tuned open source models.

Base & instruction tuned versions are available for commercial use with Apache 2 license!