Yeah I though llama.cpp had this during the very early days, if my memory serves me correctly.