HNHacker News
TopNewBestAskShowJobs

yz-yu

372 karma · joined December 28, 2018

submissionscomments
yz-yu··on Nano-vLLM: How a vLLM-style inference engine works
The comments here turned out much more interesting than I expected—this has become a great place to discuss the difference between AI-generated, AI-written, and AI-assisted content.

So let me start from @jbarrow's comment: "AI written, generated from the codebase."

My actual learning process looked like this:

1. I walked through the nano-vLLM codebase, asking Claude Code some high-level questions to warm up. 2. Then I asked detailed questions one by one, let it explore, and double-checked the code myself. As someone without an ML background, it sometimes took hours to understand a single concept. 3. Once I felt I understood enough, I started drawing Excalidraw diagrams to explain what I learned.

Does this count as "generated from the codebase"? I don't think so.

Where we might disagree is the writing process.

As a non-native English speaker, my workflow looks like this:

1. Write a short paragraph (<100 words), then ask my writing agent to "fix this for readability and grammar." 2. Review the output. *If it changes any technical meaning, I correct it.* I consider this a responsible way to write a tech blog. 3. Move to the next paragraph.

Is this "AI-written"? I'd call it "AI-assisted." Every idea in every sentence is mine. Honestly, things like "em dashes" never stood out to me when reviewing. I suspect that's common for non-native speakers.

I wrote this comment the same way. The LLM fixed 14 grammar mistakes that I think would distract readers more than any LLM-ish phrasing.

That said, I'm open to suggestions on how to improve my writing process :)

yz-yu··on Nano-vLLM: How a vLLM-style inference engine works
Since HN only allows one link per submission, dropping Part 2 here.

https://www.neutree.ai/blog/nano-vllm-part-2

yz-yu··on Nano-vLLM: How a vLLM-style inference engine works
Cool, humans hallucinate too. — AI
yz-yu··on Nano-vLLM: How a vLLM-style inference engine works
Hi jbarrow, thanks for your feedback and the links you shared—they're great readings for me (and likely others too).

That said, I need to clarify: the content was not written by AI, and certainly not generated from a database in one shot. If there's some agent + prompt that can produce what I wrote, I'd love to learn it—it would've saved me two weekends :)

Before addressing your questions further, some context: I'm a developer with no ML background but plenty of Cloud Infra experience. I'm currently building an open-source AI Infra project, which is why I studied nano-vllm. So my writing reflects some gaps in ML knowledge.

To your specific points:

> it goes into (nano)vLLM internals and doesn't mention PagedAttention once

I didn't find any explicit "paged attention" naming in nano-vllm. After reading the first article you linked—specifically the "Paged KV Caching" section—I believe the block management logic and CPU/GPU block mapping it describes is exactly what I covered in both posts. It may not be the full picture of paged attention, but I interpreted what I saw in the code and captured the core idea. I think that's a reasonable outcome.

> Part 2 will cover dense vs MoE's, which is weird because nanovllm hardcodes a dense Qwen3 into the source

This reflects my learning approach and background. Same as point 1—I may not have realized the block design was the famous PagedAttention implementation, so I didn't name it as such. For point 2, seeing a dense Qwen3 naturally made me wonder how it differs from the xx-B-A-yy-B MoE models I'd seen on Hugging Face—specifically what changes in the decoder layers. That curiosity led me to learn about MoE and write it up for others with the same questions.

---

I completely understand that in this era, people care more about whether what they're reading is AI-generated—no one wants to waste time on low-effort slop with no human involvement.

But as I explained above—and as my hand-drawn Excalidraw diagrams show (I haven't seen an LLM produce diagrams with logic that satisfies me)—this is the result of learning shaped by my own knowledge background and preferences.

yz-yu··on Show HN: Dewhale – GitHub-Powered AI for effortless development
We released vx.dev a few days ago and received some feedback. After adopting everyone's suggestions, we rebranded vx.dev to Dewhale and gave it a simpler and more beautiful landing page.

Looking forward to your feedback.

yz-yu··on Show HN: Vx.dev – GitHub-Powered AI for effortless development
I see...It's just published like a blog, and maybe worth a redesign as a landing page.

Thanks for the suggestion!

yz-yu··on Show HN: Vx.dev – GitHub-Powered AI for effortless development
Since the prompt part of this project is highly inspired by Vercel's v0.dev, I chose a name that shows my respect for that product.
yz-yu··on Show HN: Vx.dev – GitHub-Powered AI for effortless development
yes you are right, the domain is a little expensive and already sold out:)
yz-yu··on Show HN: V0.dev OSS Alternative, Customizable, Budget-Flexible, Live in GitHub
yes, now I found the time mainly caused by: 1. openAI API call, which could not be optimized for now 2. the time to build and deploy, which can be optimized by a preset setup
yz-yu··on Show HN: V0.dev OSS Alternative, Customizable, Budget-Flexible, Live in GitHub
~6000 tokens
yz-yu··on Show HN: Sunmao – A framework for developing low-code tools
https://github.com/smartxworks/sunmao-ui/blob/develop/docs/e...

here is an example of integrating a react component

yz-yu··on Show HN: Sunmao – A framework for developing low-code tools
Good question. Sunmao focus on the UI part means it was designed to integrate any kind of backend. And for FastAPI and other frameworks that provide OpenAPI schema, there should be a bigger potential to play with Sunmao, e.g, tables, forms, and other UIs that can connect to the API seamlessly.

As a personal suggestion, I think Sunmao is a little low-level(which brings great flexibility) to build such a kind of integration at this moment. It will be much easier after we provide some tutorials or examples of integrating with a backend framework. In the meantime, it will be appreciated if to join our slack channel and have some deep discussion.

yz-yu··on Show HN: Sunmao – A framework for developing low-code tools
there is a huge area to improve on our mobile site!

yes I mean it's not very attractive at this moment LOL

yz-yu··on Show HN: Sunmao – A framework for developing low-code tools
Thank you for the feedback and really sorry about that! Just published a new version with fallback language.
yz-yu··on Show HN: Sunmao – A framework for developing low-code tools
Sunmao is an open-source framework for low-code tools. You can integrate custom UI components in Sunmao to create your own low-code tools.

More details can be found in this post: https://github.com/smartxworks/sunmao-ui/blob/develop/docs/e... and our Github repo.

yz-yu··on DOM recording for web application demos
rr inspired me when I choose the name rrweb:)
yz-yu··on Show HN: SessionForward – Simple user session replays and heatmaps
rrweb's author here. Very happy to see people building commercial products on top of rrweb. Also paid a lot of time in the last several months to design and implement some new features to help the rrweb scale in production, such as the storage size. Hope it will keep helping people make more interesting stuff in this area.
yz-yu··on Show HN: Syncit - An open source privacy-first co-browsing Tool
Hi hackers.

If you are interested in the details of Syncit, you can check my introduction post: http://www.myriptide.com/syncit-introduction.

yz-yu··on Show HN: Open source JavaScript library to record and replay the web
Definitely learned a lot and enjoy the process and thanks for your really important suggestions.

Quote from my introduction blog post:

===

Today we already have some commercial session replay products like Logrocket, Fullstory, etc.

If you are just looking for a ready-to-use tool and would like to pay for its service, I would recommend you to use the above products, because they have well-tested backend services that can store the data for you and perform some higher order features.

===

So I don't think rrweb is a competitor of these commercial products.

Actually, I would like to see rrweb grows into a base of many commercial products in the future, which means it handles most of the privacy and security issues, so the other developers can build many fancy projects base on it without spending time on the hard part again and again.

yz-yu··on Show HN: Open source JavaScript library to record and replay the web
Totally agreed with your consideration about privacy. Unfortunately, as I wrote in my blog post, some commercial products already shipped features like this.

So another passion of rrweb is to teach people the 'power' of the modern browsers, and I also wish rrweb has a chance to improve the standard of web privacy.

yz-yu··on Show HN: Open source JavaScript library to record and replay the web
I know there is some MuationObserver(which rrweb used to observe DOM update) API's shim library, but not sure the impact on performance.

BTW, rrweb is also a project to explore the power of modern browser, so IE issues may not be considered in a high priority.

yz-yu··on Show HN: Open source JavaScript library to record and replay the web
MIT https://github.com/rrweb-io/rrweb/blob/master/package.json#L...
yz-yu··on Show HN: Open source JavaScript library to record and replay the web
Great idea! As I said on the landing page, demonstrate is an interesting use case for rrweb and the annotation feature will make it even better.
yz-yu··on Show HN: Open source JavaScript library to record and replay the web
Hi, hackers, the author here.

Since I've seen some people are talking about the open source idea and comparing rrweb to some commercial products, I'd like to share a blog post about the vision of rrweb.

http://www.myriptide.com/rrweb-introduction/

Also, you will know about how rrweb works in this post.