I am not sure how this is JEV, but just a llm following the JEV api, as it is using standard LLMS. The main contribution of JEV is not the API but the model itself. Can someone please explain ?
Likely they have some encoder (eg ModernBERT) trained to do late interaction or latent states along the lines of ColBERT, Perceiver IO or poly-encoders.