Ollama just had AMD support merged. I haven't got it working with my 6700 XT eGPU yet, but I anticipate getting there soon.