It's maybe not even possible to expel all the loanwords from Norman and more recent French, as well as Latin, from the language. But things like Anglish[0] exist.

[0]: https://anglish.org/wiki/Anglish