llama.cpp has a web ui nowdays, but with an harness is easier to interact with existing cli tools