The issue is when you have many MCP tools the context becomes too large for the LLM. So Nexus indexes all the tools and lets you search for the right tool and then execute it.
10 karma · joined May 1, 2015
Here are a few key differentiators vs LiteLLM today:
- Nexus does MCP server aggregation and LLM routing - LiteLLM only does LLM routing
- The Nexus router is a standalone binary that can run with minimal TOML configuration and optionally Redis - LiteLLM is a whole package with dashboard, database etc.
- Nexus is written in Rust - LiteLLM is written in Python
That said, LiteLLM is an impressive project, but we're just getting started with Nexus so stay tuned for a steady barrage of feature launches the coming months:)
We’re excited to introduce Grafbase Extensions, a powerful new way to customize and enhance your GraphQL APIs without the hassle of building and maintaining additional infrastructure. With WebAssembly-powered extensions, you can federate any API, database, or service into your GraphQL schema, whether it’s REST, gRPC, or Kafka. With Extensions, you can bring in any authentication (e.g. OpenID connect) or custom authorization logic directly into the gateway.
Founder of Grafbase here.
Grafbase Federated Graphs are spec compliant with Apollo Federation. We've invested a lot in the developer experience of building an deploying GraphQL APIs. Local development, the Grafbase SDK and the Grafbase dashboard were built from the ground up to be easy and efficient to use. GraphQL APIs deployed to Grafbase are also deployed to the edge by default, but can now also be deployed in your own infrastructure.
Grafbase is a GraphQL platform with a Vercel-like DX for shipping GraphQL APIs with built-in edge caching, analytics and branching.
We are in the process of building the Fauna connector to make it dead simple to deploy a GraphQL API from your Fauna database.
Meanwhile, here’s an example of how to connect a Fauna database to your Grafbase project using resolvers: https://github.com/grafbase/grafbase/tree/main/examples/reso...
From a product perspective Grafbase offers a serverless, realtime GraphQL API deployed at the edge. Our goal is to provide a unified data layer on top of existing APIs and databases.
The Grafbase platform itself is built in Rust and deployed to the edge using WebAssembly. Every GraphQL endpoint is deployed to V8 isolates at the edge which translates to very low cold starts and extremely fast performance globally.
Our branching feature makes collaboration seamless with your team. Just created a Git branch and push it up to create an instant preview branch that is totally isolated from production.
The Grafbase CLI is open source and available on GitHub: https://github.com/grafbase/grafbase. We are planning to open source the GraphQL gateway itself later this year.
Stay tuned for end-to-end type safety with TypeScript configuration.
Glad to hear you like our documentation as it's something we're working hard to improve daily.
What integrations would you like to see? Our public roadmap is available here where you can upvote missing features: https://grafbase.com/roadmap
- The client can ask for the data it needs, which also improves performance by reducing bandwidth
- Aggregating data from multiple data sources with a single request
- Widely adopted and loved by frontend and mobile developers
We are well funded and backed by leaders in developer tools.
We recently launched our Private Beta and are working towards a Public Beta launch later this year.
If you're passionate about Developer Experience, GraphQL, Serverless and Wasm you will feel right at home at Grafbase. Join us and build the data platform of the future!
We’re currently looking for Backend Rust Engineers (Rust/GraphQL/Serverless): https://grafbase.com/careers/backend-engineer
You can see all our open positions here: https://grafbase.com/careers
We are 100% remote across US and Europe.
Apply using the link above or email us at join@grafbase.com
Grafbase is a data platform for developers. Deploy globally fast GraphQL APIs with a top-notch developer experience.
We are well funded and backed by leaders in developer tools.
We recently launched our Private Beta and are working towards a Public Beta launch later this year.
If you're passionate about Developer Experience, GraphQL, Serverless and Wasm you will feel right at home at Grafbase. Join us and build the data platform of the future!
We’re currently looking for the following roles:
- Backend Engineer (Rust/GraphQL/Serverless): https://grafbase.com/careers/backend-engineer
- Frontend Engineer (Next.js/TypeScript/React): https://grafbase.com/careers/frontend-engineer
- DevRel: https://grafbase.com/careers/senior-developer-relations-engi...
You can see all our open positions here: https://grafbase.com/careers
We are 100% remote across US and Europe.
Apply using the link above or email us at join@grafbase.com
Grafbase is an edge-first data platform for developers. It will allow you to deploy globally fast backends using a Git workflow.
We're also betting big on server-side WASM.
We're launching the private beta in a few months. Sign up for early access if you're interested in building this with us: https://grafbase.com
Our mission is to enable developers to deploy globally fast backend apps in seconds.
If you're passionate about Rust, GraphQL, Serverless, DynamoDB and Edge Computing you will feel right at home. Come join the founding team!
Backend Engineer: https://grafbase.com/careers/backend-engineer
You can see our open positions here: https://grafbase.com/careers
Apply using the link above or email us at join@grafbase.com
Grafbase is a data platform for developers that enables you to deploy globally fast applications in seconds.
If you're passionate about serverless and edge computing you will feel at home at Grafbase. Come join the founding team!
You can see our open positions here: https://careers.grafbase.com/#section-jobs
We are based in Stockholm, Sweden, but the company is fully remote.
Apply using the link above or email us at join@grafbase.com
Looking for a Platform Engineer to work our next generation platform. Experience building REST APIs in Ruby and/or Go is required.