I run on an eight year old Thinkpad. I run my own config now, but used Spacemacs for quite some time. I've never had problems with speed. I didn't use it with Elixir though.

Perhaps try disabling your layers one at a time to see where the problem is.