As per other sibling comments, there are already many efforts underway. Void Linux in particular, which I've used, has a surprising number of packages.