Same question, so far I've found this thread https://github.com/ggerganov/llama.cpp/issues/1602 where people work on it.