A few months back, we embarked on what seemed like another regular project. Little did we know, it would turn into such a game changer for LLM deployments.
Feels surreal that this gateway is already processing upwards of 3B tokens a day in such a short time.