Hacker News Reader

How does 12 tokens/sec equate to satisfactorily severing thousands of end-customere?

I did enjoy the headline, and the register has formerly been an incredibly good news outlet. Prior to the founder passing away last week.

View on HN

From the article, it's not 12 total, but 12 per user for 100 concurrent generations.

Thank you atherton friend.

Capacity doesn't equate to quality, but I could easily see an 8B finetune with exl2 at low context working for short, simple customer interactions, akin to oversubscribing a 1Gbit uplink for 100 customers at 50Mbps.

Reply on news.ycombinator.com