I just discovered elixir-tools which has an LSP and it works instantly, and seems to have a more robust architecture than ElixirLS. I used ElixirLS for a couple years now but it was the best option for a while, but elixir-tools (which I literally installed 30 mins ago) has been a delight to work with.
The instant feedback actually feels like how it always should've been.