10,979 karma · joined February 28, 2014
Distillation is alive and well... Earlier work on model printing also found that it's pretty easy to find smaller sets of parameters which can replicate the behavior of the entire network with pretty good fidelity.
Large parameter counts give space to explore, and give routes out of what would be local minima in a lower dimensional space.
In other words, there's no guarantee that any given trained model is a minimal representation of its training set.
Timothy Mcveigh (and Terry Nichols) weren't members of a terrorist organization, but they were terrorists. Meanwhile, the ku klux klan has actual initiations, membership, and organizational structure. As do Isis and al qaida.
Blue Prince is an example of what fills are calling 'notebook games' -- instead of giving you lots of qol stuff, you just use a notebook to keep notes. The act of writing and arranging your notes is actually quite immersive. It's also fun!
Blue Prince has layers of puzzles and story... It's pretty reasonable to play to the credits, and not get into the depths of the post credits game; it's a very reasonable cutoff point for non-sickos.
It's a fantastic work of complex history, told with the tools of science fiction and fantasy writing. But it remains a high quality academic work: the tools are used to unravel the telling of a gay and complicated topic, but you still get the vastness.
If you like ACOUP, it should be right up your alley.
I'm playing through Clair Obscur now. It's above average for aaa stuff. But there are way too many cut scenes, and dodge/parry mechanics continue to be tedious. And the story is fine, but isn't really grabbing me. Sigh.
Blue Prince, on the other hand, is quite probably the best puzzle game I have ever played. My partner and I worked on it for months, and have a 50+ page Google doc of notes.
Here's one example: https://github.com/sammlapp/ovenbird-individual-recognition
My impression is that the hardest part is knowing whether or not you're actually doing a good job. For vocal learners (like the ovenbird example linked above), it seems to be pretty easy using embeddings from existing models (like perch or birdnet). For non-learning species (possibly including your swifts), you can use timbre clues to differentiate many individuals, but may not be able to really nail down individual identity.
The importance of safety process is largely a function of the risk of failure (ie, how unreliable the production process is) and the cost of failure. If you've got a very reliable production process, perhaps you need less safety process. But if the cost of failure is measured in lives, you're still going to want to have checks in place, regardless of who/what is responsible for designing the bridge.
As someone with a PhD in combinatorics, I believe that I'm qualified to say that, yes, there are problems as useless as calculating more digits of pi.
The two places were seeing lots of movement are:
* Updates to lower/upper bounds. In many cases, these kinds of problems are the deep-math equivalent of calculating more digits of pi. Yes, if you throw time at it you'll break the record, but it may not be terribly worthwhile.
* Finding counter examples which disprove conjectures. This is really useful, and helps offset some positivity bias on the human side, often bringing together known tools from distant silos.
If you read the list of ten results, almost all fall into one of these buckets.
In other news, have you considered ditching your car and becoming a vegetarian? Not emitting the carbon in the first place is much easier!
Learning from and building on previous work is civilization. Copyright maximalism is a plague.
When you hire someone to work on the stairs for you, you /hope/ they know what they're doing, especially if you don't have the skills yourself to judge their work. Same for an agent.