datadeft

So in the larger Earth history there could have been a higher increase. We are talking about a super small sample on a huge scale.

First time in what timeframe?

This is great for something like Git and terrible for something like how to make the borrow checker happy in Rust. SO was the go to platform for questions that require human ingeunity.

This website is not mobile ready.

Kuvasz is a Hungarian dog breed if anyone is wondering.

mise, uv, ruff, starship is my current list.

Next should be this -> https://x.com/lemire/status/1869752213402157131

What a progress we have with these. Amazing times.

Having growth hormones in your ultra processed food helps

Polars is a life saver. We used it in a fairly complex project and it worked very well.

They are so popular because the decisions are made by managament in many companies and they have a good sales team.

Using popularity as justification of anything is the definition of slippery slope.

Is Tauri and Dioxus similar projects, or those are made for different purposes?

I am not sure what is going on with k:v stores and I do not understand how to hell we ended up with Redis. Using Redis in production for some time I am not impressed.

Redis does not natively scale across multiple cores in a traditional multi-threaded sense, you can still scale it horizontally (across multiple machines or instances).

This horizontal scaling is also problematic. Some of the cloud solutions we used would die during a scaling event.

I went on the hunt to find an alternative but not sure what to replace it with. At this stage the interface has to be Redis compatible because devs really like it.

I found this so far: https://medium.com/@shafreeck/titan-a-distributed-redis-prot...

¯\_(ツ)_/¯

> if you believe that a CEO should be the sacrificial lamb for the systems politicians have set up.

It is much better if the gen pop is the sacrificial lamb.

How would you go about cache hits instead of using a sampling profiler? Would you use eBPF / BCC?

> Superluminal is the new industry-standard profiling tool.

Never heard of it and I do a lot of performance related work. Is Superluminal really that popular?

Because this is a production like workflow in many companies and for performance measurements running in docker can have significant impact.

> disabling NAT results in "exposed" LAN devices

"In theory, theory and practice are the same. In practice, they are not."

NAT was used as a blocking method for all incoming connections for SOHO networks for decades.

No Erlang/Elixir?? The author would be surprised.

As an anecdata most of my friends believe that we know everything about ancient history. They are also very eager to hear about other parts of human knowledge to be progressing, for example AI models. Yet, when it comes to history they have this sort of static view.

* that we are aware of as of 2024.

I think most historical discoveries should be prefixed or suffixed with this because as we dig up more things we might learn that there was an even older writing system (in this case).

Same could have sad on any random subject.

Examples:

- High-fructose corn syrup is eating the world. . You can fight it like so many people before, but you will lose like everyone else

- Cancer is eating the world. You can fight it like so many people before, but you will lose like everyone else

Etc.

I think bad things could be replaced with better things where we have this luxury. Taking a passive stance on this is pointless and lazy.

The real benefits of LLMs is to give me a good summary of these documents. Still, using these abstractions is probably not worth it.

One thing that might help you in this madness is:

https://github.com/dhall-lang/dhall-kubernetes

Type safe, fat finger safe representation of your YAMLs is grossly underrated.

Yes I have some experience with TiDB. It is pretty amazing actually. They came up with a novel way of distributing data across nodes and having strong consistency while also maintaining great performance. We are recommending it to some of our clients who are looking for an easy scaling option with MySQL (TiDB is MySQL compatible on the connector level.)

Curently when we use filesystems we actually rely on kernel functionality to have persistence. Relying on syncing[1] can introduce interesting bugs. I can imagine a scenario where the FS has an API that is actually transactional and we can use that to transactionally mutate the content of files. instead of relying on fsync.

      1. fsync, fdatasync - synchronize a file's in-core state with
       storage device

For a long time Riak was my favorite key value store. It went into production without any significant issue in several companies and was running without interruption despite the face of hardware issues.

I think it stability was due to the fact of combining great technologies like LevelDB and Erlang. I wish it was a bit more popular.

Well these are the details that many of us is interested.

I am not sure what is the use case for this.

I would love to see the following projects instead:

- exposing a transactional API for S3

- transactional filesystem

I think we need a composable system but I am not sure if the current frame where this problem and these tools exist is good enough. We might need to rethink how we handle access and usage patterns well. I only have wrong answers. Docker compose is amazing for local dev env, k8s is terrible for production. These are my experiences with this domain.

In summary:

Accidental complexity, accidental complexity, accidental complexity and when we use a tool that is designed for problem A for a problem B it is not sufficiently dealing with complexity. This is why we need a new tool.

¯\_(ツ)_/¯