Fluvio – Lean and mean distributed stream processing system written in Rust

We have had 5 major releases since I posted last time about Fluvio on Hacker News.

This is a special update since, the community has been asking for this for a loooong time!

Finally - Fluvio is a single binary that can be run locally and deployed any way you want.

We have decoupled the core streaming system from Kubernetes and you can install and have a data streaming setup locally.

Follow this post and you would have Fluvio running on your system in 2 minutes.

Step 1. Download Fluvio Version Manager:

On your terminal run

$ curl -fsS https://hub.infinyon.cloud/install/install.sh | bash

Fluvio version manager will give you the ability to download different versions of Fluvio: - Including our read only edge cluster with built in compression, caching, and mirroring to never lose data even with extended downtimes... - Or our Developer Preview of Stateful Streaming which we are building using the web assembly component model to support all web assembly compatible languages.

Step 2. Add the install directory to path:

Copy paste the last line of the installer log that looks like this on a mac -

$ echo 'export PATH="${HOME}/.fvm/bin:${HOME}/.fluvio/bin:${PATH}"' >> ~/.zshrc

It will be different based on the terminal flavour you have bash on Linux -

$ echo 'export PATH="${HOME}/.fvm/bin:${HOME}/.fluvio/bin:${PATH}"' >> ~/.bashrc

Step 3. Start local cluster:

The following command will start a local cluster by default -

$ fluvio cluster start

Step 4. Create Topic:

The following command will create a topic called hello-fluvio:

$ fluvio topic create hello-fluvio

Step 5. Produce to Topic, Consume From Topic:

Produce data to your topic. Run the command first and then type some messages:

$ fluvio produce hello-fluvio

Consume data from the topic, Run the following command in a different terminal:

$ fluvio consume hello-fluvio -B -d

Just like that! You have a local cluster running the leanest and meanest streaming engine that exist in 2023!!!

Documentation is available here - https://www.fluvio.io/docs/

Looking forward to your feedback.

P.S.: We are currently running Developer Preview of Stateful Service Development Kit - to build end to end stateful streaming workflows.

If you are a seasoned data and platform engineer and you would like to try the Developer Preview, you can register here - https://infinyon.com/request/ss-early-access/