What's the reason to not integrate with llama.cpp instead of a separate app? In what ways this better than llama.cpp?
Gemma support has been added to llama.cpp, and we're more than happy to see people use it there.
side note: imagine how gnarly those urls would be if HN used UUIDs instead of integers for IDs :-D