Your concerns are artificial! Let go of your concerns and be free. The hundreds of Emacs users around the world are already doing it. It's great.
It used to be a bit of a wild-west without lexical binding but we have that now and it's going over pretty well. Fewer libraries step on each others' toes as adoption spreads.
We have package management built-in. We have awesome introspection and debugging tools. There are a lot of wonderful built-in packages.
My init file isn't even written in raw elisp anymore. I use a well-documented org file. The amazing org-babel library is bundled in. My init file is written for humans to understand and only incidentally for my editor to execute. It's great.
I only wish more software was designed this way.