While BEAM is indeed great I'm wondering why you didn't use Scrapy? It handles concurrency well and is a battle tested production scraper.
The point is that the integration Python<->Elixir can be so tight and that there's little overhead when using each language for things it's good at.
Love that!
I will look it over, and because I favor LFE (Lisp Flavored Erlang) over Elixir, try to do something neat like this. Although, Elixir is growing on me from my initial take on it a year ago.