HNHacker News
TopNewBestAskShowJobs

iMil

146 karma · joined January 16, 2016

submissionscomments
iMil··on RTX 5080 and RTX 3090 Setup: 80 Tok/s on Qwen 3.6 27B Q8
CNS means Chipset not supported and I doubt it is the case, are you sure you are using the patched nvidia module? modinfo nvidia to check which one is loaded
iMil··on RTX 5080 and RTX 3090 Setup: 80 Tok/s on Qwen 3.6 27B Q8
Good call, I really hesitated between the X570 and the X99, are you using P2P?
iMil··on RTX 5080 and RTX 3090 Setup: 80 Tok/s on Qwen 3.6 27B Q8
I am actually surprised with the power draw, the box itself idles at 20W, which already amazes me for a Ryzen; when computing, I barely pass the 600W bar, and as I am not really using it to vibecode an entire system, I don't even notice the spikes on the power monitor (Shelly + homeassistant).
iMil··on RTX 5080 and RTX 3090 Setup: 80 Tok/s on Qwen 3.6 27B Q8
2xRTX5080 would be awesome. You'd only be able to run a q6, which it's already pretty good, but moreover you'd be able to use P2P and use Blackwell full speed, which I can't.
iMil··on RTX 5080 and RTX 3090 Setup: 80 Tok/s on Qwen 3.6 27B Q8
This one: https://es.aliexpress.com/item/1005010123289822.html?spm=a2g...
iMil··on Sailor, a native and portable container system for NetBSD and Mac OS X
And so it is, I just commited changes so both PM2 and gunicorn are started with a specific user.
iMil··on Sailor, a native and portable container system for NetBSD and Mac OS X
Right, the "container" word is now vastly associated to docker, yet I picked a word I know IT people will get and which is generic enough. I'll think on an alternative buzzword ;) Thanks for your support!
iMil··on Sailor, a native and portable container system for NetBSD and Mac OS X
Duly noted, I just added a word about it on the GitHub page, and you're right, I should run the examples services with a dedicated user as I already do for the nginx process. Thanks for your feedback!
iMil··on Sailor, a native and portable container system for NetBSD and Mac OS X
sailor's goal is definitely not to bring security, we all perfectly know chroot is not the way of isolating a host filesystem from attackers. Instead, sailor provides a convenient way of testing environments without compromising your workstation / dev station filesystem.