Hacker News Reader

Okay, thank you. I've been looking into Rabbit quite a bit. I like the stream processing aspect of Kafka, where you can introspectively peek into things as they happen rather than a straight message queue.

Some of our stuff is on the GCP, so have also been investigating Pub/Sub and DataFlow, which seem more viable since we don't have the up-front cost of hardware and maintenance but pay for resources used. If we don't use much, we should not pay much.

View on HN

One thing to note about Pub/Sub vs Kafka. Pub/Sub does not offer as strict of guarantees around ordering as Kafka. If you don't need that strictness I'd definitely recommend Pub/Sub over Kafka but if you do I don't believe any of the Google Cloud Offerings will provide you that (Kinesis on AWS will).

Its worth mentioning that kafka only supports guarantees for ordering inside a partition, not globally. (nifty little detail :) )

Ordering guarantees are offered by Dataflow.

within a window

I'd also recommend taking a look at nsq.io. Super easy to setup and supports almost everything.

Oh, that looks really interesting. I'll definitely give this a bash

Reply on news.ycombinator.com