Show HN: A review of books and tutorials on Apache Kafka

Why is this a Show HN? It's a blog post/article.

See the Show HN rules here: https://news.ycombinator.com/showhn.html

"Show HN is for something you've made that other people can play with. HN users can try it out, give you feedback, and ask questions in the thread.

On topic: things people can run on their computers or hold in their hands. For hardware, you can post a video or detailed article. For books, a sample chapter is ok.

Off topic: blog posts, sign-up pages, newsletters, lists, and other reading material. Those can't be tried out, so can't be Show HNs. Make a regular submission instead. "

Related, I was recently in the depths of understanding Kafka from the consumer side, specifically a very busy topic with many partitions. Some blog posts I enjoyed:

1. https://blog.cloudera.com/scalability-of-kafka-messaging-usi...

2. http://www.vinsguru.com/kafka-scaling-consumers-out-for-a-co...

3. https://medium.com/@jhansireddy007/how-to-parallelise-kafka-...

4. https://medium.com/@durgaswaroop/a-practical-introduction-to...

5. https://blog.newrelic.com/engineering/effective-strategies-k...

And a fun one from Microsoft:

https://azure.microsoft.com/en-ca/blog/processing-trillions-...

- Kafka the definitive guide.

This books is available for free from confluent https://www.confluent.io/resources/kafka-the-definitive-guid...

Off topic, but here goes:

If you're using Apache Kafka or similar I'd love to understand how you're using it and which problems and annoyances you're running into. Please shoot me a mail at cohen1@gmail.com if you're up for a brief Zoom call or email exchange.

I'm doing customer/product research on Apache Kafka and similar systems to inform a software project I'm working on.

So this is not a tutorial, but it can significantly help anyone doing his first Apache Kafka steps. I'm creating a desktop visualization tool that facilitates you to visualize what's in your topics and clusters without knowing about the very specifics of Apache Kafka.

You can try it out here https://kafkaide.com.

We also have a learning hub with articles like https://kafkaide.com/learn/consume-kafka-topic, which deep dives into many different ways to read data from Apache Kafka.

Please let me know if you think it is useful. I will try to answer everything I can :-)

For an intro to Kafka that explains all the core concepts visually, I've written "Understanding Kafka with Factorio" https://medium.com/@ruurtjan/understanding-kafka-with-factor...