New TIL: How Streaming LLM APIs Work

Discussion (40 points, 2 days ago, 23 comments) https://news.ycombinator.com/item?id=41615404