HNHacker News
TopNewBestAskShowJobs

TrueDuality

2,337 karma · joined July 21, 2016

submissionscomments
TrueDuality··on Falcon 180B
This is a pretty cool and neat comparison that I haven't seen before. Probably worth including the rest of the server required to run 2 H100s because those aren't trivial either... I think the 100W might just be for an estimate of the human brain so maybe it is an equivalent example.

I know this isn't the spirit you meant it in, but I'm also impressed with humanity that we've managed to develop something as capable as it is (admittedly significantly less reliable and capable than a person) at only an order of magnitude difference in power consumption.

TrueDuality··on Ask HN: I’m an FCC Commissioner proposing regulation of IoT security updates
I strongly suspect that regulation at the IoT product level will have a very small practical impact because I think its largely targeting the wrong issue. The vast majority of the vulnerabilities aren't coming from the manufacturer, many of them are making relatively small changes to a reference design provided by a company like Broadcom (which is notorious for exactly the behavior I'm about to describe).

The reference design problem is an issue where a manufacturer like Broadcom creates a specialized chip. To use this chip they create a "reference driver" for it, package it in a custom firmware, then will never update that reference software. I've worked building internet routers for homes and small business and there are pieces of software we couldn't touch because they had been modified and only the fully compiled version is provided.

Broadcom passes the buck by calling it a reference design and washing their hands of it. Some upstreams do provide the source, but it's the complete source, not just the changes they made and usually without any specific reference to what the specific version they based their changes on was. Trying to tease specific changes from the Linux kernel's raw source code is quite the needle in the haystack problem.

I'm not sure how a lot of device manufacturers _could_ handle this. They tend to have very small development teams that are more electrical engineers than software engineers and usually their only directive is to make it work under an extraordinarily tight deadlines. Maybe part of the answer is they need to hire more to be more responsible... But even with experienced developers _every single hardware manufacturer_ is going to have to repeat the security fixes that companies like Broadcom refuse to fix.

I don't even know where to begin proposing a legal foundation for reference design software. I do think if the penalties and pain were strict enough at this level it would lead to a different shortcut that would be much more beneficial to the world... If Broadcom and other companies doing this kind of malicious apathy were forced to keep their reference designs up to date, my money would be that they stop doing it entirely and instead get those driver merged into the Linux kernel proper where it can be properly maintained and updated by the legion of developers that care.

The act of getting that code into the kernel would force them to improve the code and not take the shortcuts that cause so many headaches because the kernel developers gate the quality of code they produce.

TrueDuality··on A deep dive into Single Pair Ethernet
Great write up. Looks like the GitHub repo with the project hasn't been posted yet. Look forward to poking through that!
TrueDuality··on Ask HN: Where do I find good code to read?
Is there any particular language you're looking for? I've found some languages hideous until I understood them and could appreciate their respective graces. Off the top of my head the I can think of a couple of projects you and others may be interested in.

The first is Jones Forth (https://github.com/nornagon/jonesforth), start with jonesforth.S and move into jonesforth.f. I really enjoyed following along with it and trying my hand at making my own stack based language.

The other is Xv6, a teaching operating system from MIT (https://pdos.csail.mit.edu/6.828/2021/xv6.html), not all the code or implementations are top notch but it shows you non-optimized versions (just because they're simple and more readable) of different concepts used in OS design.

If you're interested in the embedded world, there is a really neat project I've been following that feels a more structured and safe (as in fault-tolerant) while still staying pretty simple (both conceptually and in the code itself): Hubris and Humility (https://hubris.oxide.computer/).

TrueDuality··on AI-generated art lacks copyright protection, D.C. court says
The code here isn't producing a specific, designed, or planned output. It is effectively doing refined data analysis and interpretation of an intermediate format (the weights) that is exclusively dependent on its input data not on the code itself.

I don't see any inconsistency in this ruling.

TrueDuality··on Cryptography may offer a solution to the AI-labeling problem
This appears to simply be a tool that adds additional signed metadata to the content which is trivial to strip from the file, allowing malicious users to not have that "AI generated" label show up... Optional metadata is not really a protection mechanism except in walled garden ecosystems.
TrueDuality··on Ask HN: Could you share your personal blog here?
https://stelfox.net/blog/

It's been on and off for a long time, mostly quick "this is how I solved this specific issue" posts but I get enough natural traffic it's clearly helping some people. I want to make time for more long form writing though.

TrueDuality··on Fedora considers “privacy-preserving” telemetry
Yup I absolutely think that should be fixed before they try this telemetry option. Anonymous bug reporting (just crash details) are probably more palatable than this proposal but that would be more work on the bug report side to aggregate and filter out garbage, and they want something that is minimal effort on their side (stated directly in the discussion).
TrueDuality··on Fedora considers “privacy-preserving” telemetry
I see people complaining about instinctive reactions about the usage of the word telemetry, but they're rightly justified in those reactions. People have those instinctive reactions for a very good reason even with this specific proposal. If you read the discussion post, the following becomes clear:

* The proposer has clearly not done any research on how to actually collect anonymous data (they'd never heard of differential privacy for example).

* They want a plug and play solution (they specifically say they don't want to do more work than that)

* They are not open to discussing privacy regulations such as GDPR

* They are not willing to bend on the most contentious points of their proposal

* The system they want to use collects invasive metrics that can be de-anonymized and has only been used by a niche distribution

Because the de-anonymization bit might not be clear, let me summarize some of the things that the Endless OS metrics collect:

* Country

* Location based on IP address to within 1 degree lat/long

* Your specific hardware profile

* Daily report that includes your hardware profile, along with the number of times the check ins have occurred in the past

* Detailed program usage (every start / stop)

* An unspecified series of additional metrics that can be sent from anywhere else on the system via a dbus interface

Additional this proposal wants to explicitly collect:

* What packages and versions of such are installed

* Specific application usage metrics (the example they give is the gnome settings panel)

They discard the IP address, but how hard do you think it is to differentiate users based on the combination of hardware profile, +/- 1 degree of location accuracy, their specific set of packages (and knowing the history of package installs/uninstalls already through their package manager). The proposal doesn't meet its stated intentions of being anonymous, and the proposer actively understands that users don't want this but believe their desire for the metrics overrides the end users desire of not being tracked.

TrueDuality··on Fedora considers “privacy-preserving” telemetry
Adding to this, bug reporting in the Red Hat ecosystem is an extremely painful process. Multiple accounts, no feedback, mandatory detailed system information collection if you want to use the built in bug report (which also needs an account). No automatic aggregation, processing, or association with similar issues.

It's a black box with no incentive to participate unless you're one of those specific types of users that is dedicated enough to put up with all of that, or users that have never done it before and are trying hard to contribute back.

TrueDuality··on Fedora considers “privacy-preserving” telemetry
While true, the requestor had never heard of differential privacy techniques and that is not what they were planning on implementing. This was brought up in the discussion thread.
TrueDuality··on Programming languages going above and beyond
I didn't notice that it is kind of called out in the post... It's the very last line and left as an exercise to the reader to infer which is almost worse since I would call this a flaw in the implementation of the functions and is being shown off as a sterling example of the capabilities of the language.

The conversion between `[]` and `0` is the flaw that is hard to reason about here and propagates through any code that interacts with it in a way that violates a programmers expectations.

TrueDuality··on Programming languages going above and beyond
This is pretty cool!

I do have a nitpick I think is important. An empty byte array getting converted to zero seems like a bad edge case that should probably produce some kind of error invariant.

This isn't a minor concern if the intent is to use this in serious applications that require this degree of formalism. The two proofs are easy to break: `ToBytes(FromBytes([])) != []`. It's an obvious example of the issue: FromBytes handles inputs ToBytes can't generate therefore they are not true inverses of each other.

It's a simple case but it was quick to find in this simple example, and it hints at dangerous oversights that could lead to severe bugs in more complex scenarios, like in cryptography. It's critical to account for such edge cases.

TrueDuality··on The .meta directory: let's tidy things up
There is an existing standard for this: https://specifications.freedesktop.org/basedir-spec/basedir-...

It's generally really well respected by a lot of software. It's just not well known enough that its annoying. In my experience a lot of the failures are from Apple developers assuming that this is a "Linux spec".

TrueDuality··on The .meta directory: let's tidy things up
The XDG standard covers most of these as well. Cached data that is safe to delete? There is a directory for that. Runtime data that needs to live as long as the instance of the app? Directory for that. External data your app might rely on but contains no user data? Directory for that.

It's very flexible and widely accepted. It's just not accepted _enough_ to be annoying.

TrueDuality··on The .meta directory: let's tidy things up
It kind of is... There is a formal standard that everyone ignores called XDG which defines the ".config" directory along with a few other handy common ones.
TrueDuality··on FediBlock Meta's new Threads domain
Just a guess but I think they're going to do a full two-way federation with injected ad content. This could be very sneaky in how it works with the existing fediverse protocols. You really only have the power to block an instance or a user. What if each ad has its own user ID and is returned inline with any remote query for content? What if they take it a step further and inject ads using desired user's own IDs to show them when you follow your grandmother's content who would be very difficult to move off of FB?

As a fediverse host you can probably make custom spam like filters, and I'm sure there will be some distributed tools to fight this kind of thing... But right now a lot of the fediverse is assuming that moderation of external hosts is pretty straight forward and not actively adversarial. If you disagree with the policies or the populace that is attracted to a particular instance block the instance. That doesn't work with something at this scale.

I don't agree with instances proactively blocking Meta before they've shown their true colors, but I also don't think they're wrong. I just think we should let the monsters take off their mask and allow the social consequences to come when the blocks happen for a good reason.

TrueDuality··on Adversarial Collaboration Project
I'm curious as to what you mean by rank. Is this a instead of a simple up/down signal you get something like a +10/-10 scale to rate how much you (dis)agree with a particular comment/link and then looking at the distribution of scores? Or maybe something like a rank vote of all comments at a particular tier?
TrueDuality··on A chiral aperiodic monotile
Hmmm... I wonder if these spectres are potentially a basis for a new form of cryptographic algorithms. Unique non-repeating sequences exclusively derived from a set of rules and an initial state in multiple dimensions sounds like a promising candidate.
TrueDuality··on Brex’s Prompt Engineering Guide
Whoa that was a lot of fun. Are you aware of any other games like this? A sort of CTF for AIs?
TrueDuality··on Brex’s Prompt Engineering Guide
I would argue the same is true of farming as well, you're just comparing differences in final outcomes. You can start learning basic farming techniques with a few pots, some seeds, water and a sunny spot in the same way you can get a raspberry pi and a keyboard sourcing information for both from YouTube fairly effectively.

There might be an argument for cost at the highest scale in each field which few in either profession really make it to but I'd bet even then its pretty on par.

I've been a huge fan of comparing the complexity or cost of a profession. We as a species specialize because doing these tasks in the most efficient way requires managing large number of details that are not obvious at first glance.

TrueDuality··on PaLM 2 Technical Report [pdf]
That's true but also not relevant to current wide spread use of the term. Concepts and common understanding evolve with language and I'm not even sure what point you're trying to make by pointing this out. Your first link even includes the language:

> "open source" marketed as trumping "open system".

Common use and understanding of the use "open" evolved decades ago.

Your comment also tries to side step the issue at heart people are annoyed and frustrated by. The founding principles of the OpenAI foundation laid out exactly what that usage of "Open" meant for their organization and they have since backtracked on their own principles.

TrueDuality··on Ask HN: Most interesting tech you built for just yourself?
It's not personally useful but I wanted to see if I could design and build a navigation controller designed for a satellite with different configurations. I started with a sandbox simulator that emulated all the hardware sensors down to the noise (according to their data sheets) and a microcontroller emulator that ran real code compiled for a microcontroller I chose for the task (STM32G431).

I tested different control schemes and thrust firing plans, added support for different types of thrusters, errors in sensor readings, atmospheric drag depending on altitude, weird anomalies in the earth's magnetic field, simulated bit flip events and hardware lockups (I left the internal watchdog out of the hardware lockups which is probably not realistic).

In an effort to stress test my simulator I ended up writing a genetic algorithm solver for thruster, magneto-torquer, and reaction wheel placement on arbitrary craft bodies with different mission plans and let it solve it.

I ended up designing a physical circuit board matching the simulator, flashing the board with the same code that was running in the simulator and it worked! I roughly made an approximate cube sat (10cm^3) (had a mechanical engineer friend design me a frame and manufacture it for me) with some small cold gas thrusters out of pressurized CO2 cartridges, controlled by solenoids, and placed by my genetic algorithm.

I dropped it off a cliff that was ~600ft high (best I could do for a "zero gravity" environment that was away from people). It was able to completely arrest its angular rotation before slamming into the ground which is better than I was expecting.

TrueDuality··on Semantic Tokenizer for Enhanced Natural Language Processing
Tokenization use one-hot encodings, so that matrix will always be n^2 the number of tokens. This has an impact on all the subsequent layers and final number of parameters. You want to use as information dense tokens as possible, while being able to represent weird or unseen tokens, but discrete enough to allow differentiation of concepts.
TrueDuality··on I made my blog solar-powered, then things escalated
I haven't heard of a setup like this before. It seems like you would be loosing a lot of efficiency having to translate the voltage to AC and back to DC to charge your batteries.
TrueDuality··on Ask Wirecutter: Can you recommend a not-smart TV for me?
This article doesn't touch on any of the reasons why I don't want a smart TV. Sure I care about my privacy and security, I do have a smart TV, and I do keep it disconnected from my WiFi. I also have a Roku plugged into it that is likely capturing more information than I would like it to, none of that is why I don't want a smart TV.

It comes down to upgradability for me. The display is going to last far longer than the smart software running on it. Turning on my TV takes a full minute and a half before it will accept inputs from its remote, I've periodically connected it to the internet to check for updates and in two years there hasn't been a single one.

That's not true for every TV but in general my experience has been the built-in Roku, and other smart TV features are poorer quality than the stand alone sticks and either don't get updates at all or significantly less frequently. Because of the nature of these appliances they aren't as disposable so manufacturers have less incentive to provide those updates and high quality experiences as the stand alone products.

All that smart poor quality software on the TV itself compromises the core functionality of the TV itself which is being a good medium for the display of a user's choice content.

TrueDuality··on I wish GPT4 had never happened
I think your response is equally naive. I am still largely undecided on whether something like a universal basic income would actually be a net positive for society, but the fallacy that receiving a fixed income immediately means that people won't do something productive with their time is ridiculous. I can't imagine _not_ working, I develop open source software in my free time and I would spend more time producing software others find value in if I spent less time working for my livelihood.

This doesn't just apply to software development. There are a lot of garbage jobs, dead end positions, where the people are effectively not doing anything. That is a weight on our economy but we can't just cut them out. What would those people do if they didn't have to waste so much of their time to live? Sure there are going to be people that go all in on becoming puddles on the couch, but I'd argue more people have passions they would actually have the energy to pursue.

People could spend more time with their families without being stressed out and burned out by everything else in the world. I'd argue that would most likely lead to healthier childhoods for kids, likely with better supplemental education as well leading to a smarter society in the long run.

People get tired of partying, and the people that don't make good examples for the next generation of what not to do. You can see that in our current society as the younger generation is drinking significantly less and doing fewer drugs to the point major alcohol manufacturers are concerned about their bottom lines.

There will always be degenerates, but people want the fulfillment that comes with actually doing things like you said. They will find that one way or another.

TrueDuality··on Near-lossless image formats using ultra-fast LZ codecs
I don't agree with the argument that high-speed bandwidth is more available. The mean may be going up but from what I've experienced, and deployed is that places that already have good internet are getting faster links while little progress is being made in areas with slow or no-internet accessibility.
TrueDuality··on Swarm M138 Modem
The limit of 60 bytes of down link is really what threw me off. For IoT sensors out in the wild that I've worked with we've still wanted the ability to remotely update their firmware. A 14kb firmware is do-able for a lot of systems, but if that update fails you don't get to retry for a month unless your firmware is incredibly tiny...

For systems that I've worked with that have firmware that small or even smaller have had power budgets in the <50mA/hour range... This modem uses up to a full amp at 3.3V (presumably only while transmitting but I'd bet its receive mode still busts that power budget in under a minute).

I can't think of the use cases for these modems that use that little data and have that much of a power draw...

TrueDuality··on Chromium's impact on root DNS traffic (2020)
The roots are a "common good" and yes they're designed to handle this level of traffic because they have to. I also agree application developers don't have to be generally restrained in their use of DNS when using the protocol for its intended purposes.

Attempting to look up domains with the intention that they don't exist and are expecting the general case to be a failed query is not using the DNS system as intended. As I mentioned this could be solved by the application including a domain they control so they are not excessively consuming a public good at the expense of others (someone does have to pay for these servers).

The roots should not be expected to double their capacity because one application implements a feature in bad faith.

← PreviousPage 7 of 17Next →