12,951 karma · joined August 6, 2013
Oxford, UK
I know people working both at Galois and Mondragón, and they seem to be relatively similar in spirit.
This is why it's so important to separate functional from stateful code. Functional code is generally easier to specify. And, by isolating stateful code, one can e.g. fail fast and avoid stepping into undefined behavior.
The biggest issue was always cost. But there's still an alignment problem. Without human supervision, things might drift away from the original specification and intent.
From my own experience, what works best is some kind of Hoare/separation logic (contracts), as these are quite easy to follow and decompose.
Even something as simple as a minimal Haskell subset, plus a bit of LiquidHaskell, can get you really far if you are pragmatic.
Some banks limit functionality on web apps, which is annoying.
More importantly, many refuse to provide a decent 2FA other than push notifications inside the app or SMS, which is insecure and EU has mandated its phaseout.
The thing that works for me is to pretend to be clueless and get an old hardware OTP generator, but those are susceptible to impersonation attacks on the bank side.
I miss these simpler times when devices were made to serve users, and not the other way round.
But without formal verification and a human reviewing specifications to ensure alignment, I think code will end up being broken in unexpected ways or drift away from the original intent.
It was Kafkaesque, discontinuing a product before release.
I think I was one of the first developers that got an N770 engineering sample (the first product in the N770-N9 saga) and it was really clear that they were onto something. Sadly, internal politics won over company and consumer interests. It took them extremely long to let this be a phone, not just an "Internet tablet". It was bizarre.
The same team is now behind Jolla/Sailfish. It's pretty remarkable how far they've got, but it's obviously not a perfect product given how small they are compared to the other mobile juggernauts. However, it's usable as a daily driver and, with a critical developer mass, it could get somewhere. There are already quite a few indie apps.
Crucially, I think it's the only platform that has the potential to set you truly free. GrapheneOS is the other alternative I can also endorse and tolerate, but it has a different set of compromises, and it's a bit fragile to Google pulling the plug. But it's great in its own ways.
You get paid for about a year to do nothing so that the trade secrets from your firm (trading strategies) expire.
That's very different from a non-compete. A non-compete is about your own know-how, not the company's.
China acts like an entire bloc, not as single companies, and they want to monetize hardware.
However, Lean is currently gaining significant momentum as an alternative, particularly due to its capabilities as a general-purpose functional programming language.
Personally, I think something based on Hoare or separation logic would be more practical as it'd be easier to align requirements with specifications. I like Dafny and F*.
It's not perfect, but far from useless. Some use it as a daily driver.
Depending on your country, it can be super doable. There are also lots of indie native apps.
So, we know the mechanism, and it's quite plausible that supplementation works.
In other words, as an skeptic, I don't think it's just an epidemiological correlation.
Particular architectures don't matter so much yet. It's quite possible that S3-Mamba or xLSTM could be used in lieu of transformers and we would still have LLMs.
Some mid and high-end footwear brands produce boots with Munson or Munson-like lasts. It helps tremendously. I cannot go back to narrow toeboxes.
Oddly, lots of sports footwear suffers from the same issue and wide toeboxes are not as popular as they should be.
Genomic platforms are now able to capture multiple measurements (e.g. RNA and chromatin openness) from single cells in large tissue slices/massive perturbation experiments.
Once time gets baked into the equation, we will be able to build better models of systems biology. However, human trials will still be a major bottleneck.
Agile regulations against NIMBYism and a world-class civil engineering industry with HQs in Madrid also help.
A good analogy is to ask what would need to be true for Madrid to replicate the AI hub in SF? Great VC, top engineers, certain risk-taking mentality, etc.
So, it's not easy. The environment that creates a fabric for radical innovation is quite different from a statist mentality, although hopefully, both are not mutually exclusive.
Given the massive pay gap with industry and scarce funding, it's natural lots of innovation has shifted to industrial labs.
This is confusing. Are you referring to the old 2012 version?
Volumes 1 & 2 (2022-3) contain a substantial amount of deep learning [1], including relatively recent developments.
There's also a new RL volume getting written, with some drafts deposited in arXiv [2].
TLA+, which has gained quite a lot of popularity, is a testament to that. Model checking is eminently practical. The exciting thing now is that heavier formal methods, in particular theorem proving, might become cheap enough to use in regular systems software. Writing formal specifications for functions and getting them synthesized and proven correct by some SAT/SMT, theorem prover & LLM hybrid may become the norm in the not-too-distant future.
[1] On the Unusual Effectiveness of Logic in Computer Science. https://www.cs.rice.edu/~vardi/papers/aaas99.jsl.pdf
[2] From Philosophical to Industrial Logics. https://www.cs.rice.edu/~vardi/papers/icla09.pdf
Take for example Oxford. A typical rental will be around £1,600 pcm. The median pre-tax salary is around £50,000, which converts to around £3,100 net. So, the apartment is actually more than 50% of your net income. Some programming jobs will pay a bit more, but you get the idea.
Another example, in Barcelona, a median net salary is less than a median rental. IT will pay better, but expect to spend around 40% of your net salary. I could also bring up Stockholm or Copenhagen and, unless you are in very senior IT jobs, it's going to look very similar.
In EU, even relatively good IT salaries are mediocre when you factor in monthly rental. A simple one-bed apartment can easily take 50% of your net income.
Having freedom to move, even within a particular country, allows reducing that 50% to something more sustainable.
This doesn't imply you can't get aid from a LLM to e.g. implement a function that has a formal specification (an application I think is very promising), but surely it has some profound implications on how much of a large system can be understood by a LLM at once, without supervision.