olavgg

The numbers are quite interesting, does bcachefs run on Almalinux 10? I only see Fedora supported. All my servers run Almalinux today and I am super happy with it, no plans to use something else.

How is root support for bcachefs? This is the one thing I really miss with ZFS today, its just too much work. I do love my FreeBSD systems with a root ZFS though.

I have already created a croos-platform solitaire game in Rust with Opus 4.5. Done in one evening. I absolutely do not understand why OpenAI could not write a proper application in 6 months. Do they struggle to use the product they sell?

ROCE do require proper nic/switch tuning. But if you go all in on Mellanox NIC's and switches, its basically on knob on the switch: roce

If you buy CX3 and Mellanox SX6036(easy fan adjustment and low power usage) switches on Ebay for cheap. Which are great up to 56Gbps. You can run infiniband which is way easier to setup, just remember you still need to enable IP over IB to start the handshake for the RDMA connection.

Yes, nfs with rdma will increase your performance significantly.

I fully agree with the author, and I have stayed on vanilla JS for decades now. I like the simplicity, ownership, zero dependecies. I have my own bundler in Spring Boot using Google Closure Compiler, which works autonomously with the javascript assets. No nodejs needed.

Also with the developer disruption of agentic coding AI, the arguments for using vanilla JS is even stronger. Code reviews of code/solutions is much easier. Scoping of code paths for each server-side render templates is easier. The AI does all the boilerplate coding, while keeping it readable and debugable. Implementing design patterns is just common computer science stuff, and the coding agent is pretty good at it.

I also what to mention, as a business owner, and boss of a startup. All developers here work with vanilla javascript. They were first surprised, but today they prefer it by a huge margin because of the simplicity and zero dependency and non existing build steps. The web browser is the framework, you need another abstraction over the web browser.

The MSSQL developer experience is ok, until you want to pipe the backup over ssh. Then you understand that the Linux support is a joke, with no stdout(https://linux.die.net/man/3/stdout) support.

Yes CX5 can offload more. I believe CX4 has similar offloading capabilities as CX3, except that it supports 100G.

Another note: In my experience, RoCE works much better on CX4+ generation. CX3 is best with Infiniband. I think some firmwares on the CX3 generation, has a messed up config for RoCE. But running Infiniband is not a complex task, is way easier than people think, like 10x easier and faster to setup than Ethernet.

Maybe you have priced it wrong? I just checked Ebay, a 16GB 12800 Registered ECC module goes for 40-50USD ea. That is crazy! Last year they were like 5 USD each.

With NVMe-oF and RDMA I can saturate a 25G link with spinning disks easiliy with around 16 drives.

I disagree, I play a lot around with enterprise stuff. Its insane that I need to buy enterprise grade hardware that costs 1000x more for lab/experimentation/learning. My only alternative is to wait a few years, and get it from Ebay.

I also believe that a strong reason that Optane pdimm's failed, was that it was only available on enterprise servers so hackers didn't get a chance to play with it and build software that took advantage of this special hardware.

Just look at how specialized Infiniband is, even though its awesome and has some great use cases. If it was a commodity tech, there would be 100x times more applications/software that took advantage of it.

We're a self hosted shop, we went with Valkey. Valkey also has support for RDMA, which we already is running in our infrastructure.

But that is his point. If you cannot find the session id in redis, you login again. If your Redis server crash, you start a new one and everyone just login again. No data is lost.

When I look at the oil & gas sector, I remember MS-DOS + Wordperfect was the beginning. Then Windows 3.1 + Microsoft Office took over, and since that, its been Microsoft, Azure, and SAP.

They refuse Google Cloud, AWS, and many still believe open-source is cancer. They are Microsofts best customers. They prefer consultants over hiring software developers, and the consultants just to what they're told and never question the status quo.

Whenever I spending time at these companies, my head is filled with dinosaurs.

Where I live we have something called The ONS event/Exhibition, where the oil sector gathers to promote themself. 2 years ago AWS had a big stand there, but it was mostly empty. This year, AWS doesn't participate at all.

I just paid 120 000 USD for replacing the exterior drainage system. I knew it was expensive, but not that expensive.

Every time I give Photoshop a chance I give completely up, the thing doesn't even start on neither Fedora or Ubuntu and I have no interest in configuring Wine for this. GIMP is the least painful way to get the job done. I have been using it for over 20 years, and it has been a pain-free experience. That GIMP is bad is just as wrong as the people who say Java is bad.

But you know what's even worse, people that use Illustrator to create SVG's for the web. Inkscape creates proper readable SVG's at 5KB, compared to 50MB SVG's I get from Illustrator experts.

It is a bit different, Mellanox with iSCSI/iSER over IB/RoCE is much less complex than iSCSI over TCP. RoCE runs over UDP, but requires switches with PFC, and ECN. Chelsio plays nice with any switch. Mellanox has much better offloading of NVMe-oF, where the network card can directly communicate with the NVMe device over pci-express so it can completely bypass system ram and host cpu. In fact, Linux will know nothing about the transfers to and from the NVMe device.

To get accelerated iSCSI, you need to install Chelsio or Mellanox drivers. While both work out of the box with the inbox drivers, they have special drivers that you have to download and install to unlock the extra performance. I think Chelsio has everything included in FreeBSD, so there the inbox drivers already come with top performance unlocked.

ZFS supports self healing, you do not have scrub, it will be corrected during a bad read as long you have a copy. Metadata has 2 copies by default for additional safety for a single disk.

Using a proper NIC (Chelsio) with their iSCSI accelerator will boost your iSCSI performance significantly. Another alternative is Mellanox with RDMA. You need CX4+ for optimal performance over TCP/IP, while the cheap CX3 is excellent with IPoIB. If you have a lot of packet drops and retransmissions, another option for boosting iSCSI performance is getting a network switch with a lot of memory for packet buffering. This helps with incast congestion. There are special switches with gigabytes of memory built for this.

NVMe-oF is the best protocol with least overhead for network drives, with a proper setup you lose only 10-20% latency compared to local disk even with Intel Optane. Throughput should be almost similar.

A 42U rack filled with 1u servers with 8 drives each, will have 84PB of data. It feels like it was a few month ago where you could buy a rack with 1PB of storage, and that was awesome. Not anymore.

I would not worry about running a distro. Most things are similar, there are some minor differences between the GNU applications and the FreeBSD alternatives. But for most people there is nothing to worry about. Most applications runs fine on BSD. Bind, PowerDNS, Java Applications, PostgreSQL, Python, rsync and many more. Getting PyTorch to work with Nvidia and Cuda is most likely another story.

My main culprit with FreeBSD is that upgrading the kernel is not a simple dnf update command. But its still easier than upgrading RHEL from 9 to 10.

I just started with FreeCAD this weekend, and in 3 hours I managed to create a simple pci bracket that I could 3dprint. I just followed some YouTube tutorials. When I learned 3D Studio Max 25 years ago, I struggled a lot more.

Gitea is one of the easiest projects to to self-host. And to do regular upgrades, you only need to update one file. It has been a joy to self-host for many years now.

You are correct that writes are not guaranteed to be atomic. PostgreSQL has a feature to handle torn pages: full_page_writes = on, which is enabled by default. This means you do double write.

For RocksDB I believe torn pages are not a problem as SST files are immutable. But correct me if I am wrong.

I have tried multiple enterprise SSD's, for sync writes. Nothing comes close to Optane Dimm, even Optane NVMe is 10x slower than PDIMMS.

https://forums.servethehome.com/index.php?threads/so-i-teste...

It is my text, enchanced by AI. Without AI, I would never have used the word "Monopsony". So I learned something new writing this comment.

Its not only about performance, Redis data structures offer an even more advanced caching and data processing. I even use Redis as a cache for ClickHouse.

On average I get around 4x compression on PostgreSQL data with zstd-1

> I would rather pay a competent cloud provider than being responsible for reliability issues.

Why do so many developers and sysadmins think they're not competent for hosting services. It is a lot easier than you think, and its also fun to solve technical issues you may have.

The biggest advantage of ZFS from a operational experience, is that when you have problems, ZFS tells you why. Checksum errors? Something wrong with the hard drive or SATA/SAS cables. Is the disk slow, zfs events will tell you that it spent more than 5 seconds to read sector x from disk /dev/sdf. The zfs cli commands are super-intuitive, and makes fully sense. Compared to ie. virsh, which is just weird for managing vm's.

It definitely worth the hassle. But if everything works fine for you now, don't bother. ZFS is not going away and you can learn it later.

ZFS snapshot, send, receive, clone, spin up another postgresql server on the backup server, take full backup on that clone once per week