matrik

For the same performance, one could even go about 50% cheaper with 16 channel ddr4 + a rtx3090 for prompt processing.

But still, even for mid level projects API is orders of magnitude cheaper, since you don't need to set it up and maintain it.

And why should one prefer GitHub Copilot over OpenCode? Worse harness, more expensive prices, unreliable product strategy, limited model support, the list goes on.

I'm not sure this information is grounded, but I remember to have read somewhere the inference is indeed profitable. My personal experience is similar. Running 2x3090s draw 500-600W and you can locally run amazing models with a similar setup.

Claude.ai uptime 89.2%. That's a stunning zero 9s.

At this scale, some bugs become features. I think fixing the bugs would need lots of conceptual work, due to the fact that there are millions of users of these apps.

I find LLMs very efficient in a lot of things except writing big chunks of code that require some organization. They’re good at closing knowlwdge gaps, finding strategies to solve problems, writing code for defined scopes and even reviewing large PRs. However, as others said they can easily alienate you from your own project.

MobileNetV3 and EfficientDet are othwr possible alternatives to YOLO. I was able to get higher than 1.5 FPS on Raspberry Pi Zero 2W which draws 1W on average. With efficient queuing approach, one can eliminate all bottlenecks.

what’s the name of the backend provider?

Just out of curiosity, and haven’t read a similar comment here, why not create another Google account for ads?

(I mean this account for ads looks dead and a separate account is unrelated with the new one.)

It’s not better but more consistent than GCP cloud console.

there is a way to count unique visitors without cookies and storing ip addresses indeed. have you heard of hyperloglogs? it’s very limited but works.