It seems like there are many apps that can be run locally that use LLMs. Although I haven't used this, I found it on reddit and it's made by a student. https://github.com/theJayTea/WritingTools

Seems like there could be others that are better.