Gaia: An Open-Source Project from AMD for Running Local LLMs

Seems to be windows only. Also worth noting that the all the currently supported models are 8B or less based on the readme on github