what-the-grump

API gateway is a thing…

LLMs perform significantly better and faster when you strap them to plain old apis/and an open api spec with a search tool.

My current MCP design is… grab a fastapi spec shove it into fastmcp, shallow wrapper, search tool for the full schema.

Oh boy so exciting I just wrapped an api spec for no reason and have to host infra for the translation layer. If only we invented api gateways.

But I am Mr. AI now.

Who the hell is going to take the risk on and for what? Take x billon dollars to build from scratch or near guaranteed profit to buy 50 practices and shittify them for near guaranteed profit.

Show me an example of trend reversal please of this happening in any sector. These are essentials and basics and they are captured, this isn’t a froyo start up that has a 3 year cycle.

Buy a failing business and leverage debt on it until you can’t, spend the money on yourself restructuring the business.

Buy a working business and gut it for multiple.

Buy failing businesses to offset tax burden.

This a meta level game, they don’t care about the outcome as long as it produces profit.

Product quality goes down the drain? That product is retirement homes, healthcare, food, utility, schools, it doesn’t matter. There is a million levels of separation and paperwork and a corp structure to prevent shit swimming up the stream.

Net result, if you live in America look around you, go to an auto service center, or a clinic. It’s been gutted for profit one way or another.

You got brake fluid, calipers, but it’s not even close to a regular car.

The dealerships and shops are doing every one a huge disservice by lying about how frequently engine oil needs to be changed. It’s in the manual but even that should be on page one. And then they set reminders on the car inside whatever last changed or when near, miles. So they’ll set it for 5k instead of 6-8k as the manual says and reminder at when you hit 3k. Like cmon.

Or tell me that I need a balance every 3k miles in a Tesla. Shameless.

I got service centers trying to rotate my tires every 3k miles because "ev". The oil change as well, oh you need to change oil every 5k because... because why?

Half the smallest dose, keeps my headaches away for 2-3 weeks. My food intake simply changed, I got used to eating less / healthier.

And daily I maybe use 4-6 apps at most.

E.g. ask it to make contract for a spec in code and then ask it to violate that contract. Overall an excellent model, just need to stop and put it back into we are harnessing or specing not building for a few turns not just try to pivot it off with one prompt.

No.

This whole 1 million context window is a lie after 300k Claude degrades to unusable, and compact doesnt help. I've had Codex tabs open for weeks, I have to regularly restart Claude.

You’ve been busy.

Stop shipping features, ship stability and quality.

So what does that tell me?

Better yet, for about 30% having the LLM slop it would have yielded better outcomes, but having them slop something nets terrible slop. But at least I can reshape because even the LLM wont do something that stupid.

… realize that it’s nonsense and the LLM is not smart enough to figure out much without a reranker and a ton of technology that tells it what to do with the data.

You can run any vector query against a rag and you are guaranteed a response. With chunks that are unrelated any way.

The ones that continue to survive all build around a platform of services, MSO, Adobe, etc.

Most enterprise product offerings, platform solutions, proprietary data access, proprietary / well accepted implementation. But lets not confuse it with the ability to clone it, it doesnt seem far fetched to get 10 people together and vibe out a full slack replacement in a few weeks.

I can vibe code what a dev shop would charge 500k to build and I can solo it in 1-2 weeks. This is the reality today. The code will pass quality checks, the code doesn’t need to be perfect, it doesn’t need to be cleaver it needs to be.

It’s not difficult to see this right? If an LLM can write English it can write Chinese or python.

Then it can run itself, review itself and fix itself.

The cat is out of bag, what it will do to the economy… I don’t see anything positive for regular people. Write some code has turned into prompt some LLM. My phone can outplay the best chess player in the world, are you telling me you think that whatever unbound model anthropic has sitting in their data center can’t out code you?

A year after llms came out… are you kidding me?

Two years?

10 years?

Today, by adding an MCP server to wrap the same API that’s been around forever for some system, makes the users of that system prefer NLI over the gui almost immediately.

Ponzi schemes the new suicide prevention thing.

I am not trying to be funny but the Claude itself is smart enough to catch destructive actions and double check. Its not going to wake up and start eating your machine, googling a random script and running it which what a lot of people do in many cases leads to worse outcomes, here at least you can ask the model what might happen to my computer.

I can recognize the short comings of AI code but it can produce a mock or a full blown class before I can find a place to save the file it produced.

Pretending that we are all busy writing novelty and genius is silly, 99% are writing for CRUD tasks and basic business flows, the code isn’t going to be perfect it doesn’t need to be but it will get the job done.

All the logical gotchas of the work flows that you’d be refactoring for hours are done in minutes.

Use pro with search… are it going to read 200 pages of documentation in 7 minutes come up with a conclusion and validate it or invalidate it in another 5? No you still trying accept the cookie prompt on your 6th result.

You might as well join the flat earth society if you still think that AI can’t help you complete day to day tasks.

What Microsoft has done to windows 10 and 11 is ridiculous.

Why is my taskbar still crashing in 2025. Why does opening task manager spike my cpu to 100%. Search its 2025, search still broken. OOBE experience is a joke.

For crying out loud I don’t even care if you make the entire gui rest based and hosted in azure it would perform better than the trash running now.

At this point the Azure management portal has a higher SLA and uptime than my task bar.

To me this is an insane position to take or to expect from anyone, its some just world fallacy thing perpetuated by too much Hollywood.

I am going to flip the script for a minute. I am a killer, driver, pilot, mechanic one the best ones out there, I beat the game, I won. So let me just stop and change the world, for what?

You dislike them because they don’t benefit you indirectly by benefiting society at large.

The incentive structure is wrong, incentivizing things that benefit society would be the solution not judging those that exist in the current system by pretending altruism is somehow not part of the same game.

What are some of the elements that have major impact?