I tried Linuxbrew but didn't stick with it for exactly the reason you point out:
> However it turns out Linuxbrew manages it’s own version of all the packages it tracks (makes sense I guess). This end up duplicating many of the packages available or already installed by the system package manager. This works on macOS since there is no system package repository but did not sit well with me on a Linux system.