Google and a nuclear fusion company have developed a new algorithm
theguardian.com
theguardian.com
I can see this being coupled with simulations as well to understand sources of systematic errors, create better simulations which can then be used as a stronger source of truth for "offline" (computation-only) experiments.
The biggest challenge of course becomes interpreting the results. So you got better performance, what parameters really made a difference and why? But that is at least a more tractable problem than "how do we make this better in the first place?"
For this to be exciting I would expect some indication as to how this method extends and enhances the existing science of experimental methods and the trade offs involved with using their method. I dont see that.
In my career as first a scientist and then an engineer, I've found very few practical users of highly technical experimental design theory, and all of them were in industry. These algorithms move about intelligently along all dimensions of some search space, whereas in the lab we prefered to turn just one knob at a time.
One reason is that the algorithms are optimally seraching for "known unknowns" -- that is they assume they roughly understand the problem. The lab is a world of unkown unknowns where the more plodding, understandable protocols tend to be safer.
But in industry, some problems are of the known-unknowns type. And experiment runs can burn up seriously expensive hardware time. So it makes sense for fusion researchers and cloud-computing giants a like to invent new practical ways to optimise searches.
Besides, optimising searches is what Googlers are for.
> The parameter space of C-2U has over one thousand dimensions. Quantities of interest are almost certainly not convex functions of this space. Furthermore, machine performance is strongly affected by uncontrolled time-dependent factors such as vacuum impurities and electrode wear.
I'm not aware of DOE procedures that are robust to these types of issues, and would certainly appreciate any literature you have on the subject.
Regardless of theoretical literature, this procedure has enabled a dramatic shift in how these scientists think about their experiment. Furthermore it has enabled them to achieve results much faster than before (if you have been following Tri Alpha, it has been a real slog). Both of these are exciting to me even if they don't break new ground in the design of experiments.
Isn't it basically the same thing they were already doing but more granular?
Edit to add: these instabilities often look just like better performance on a shot-to-shot basis, which makes the algos especially tricky. Using a human we could say "this parameter change is just feeding the instability" vs "oh this is interesting go here"
The only thing I think that can lead someone to your conclusion is they can judge based on a host of criteria, not just a pre-defined set of criteria--may be that's what you meant. Of course, intuitively, changing your criteria midstream would lead to bias in your judgement, I'd think, but that may be the real innovation here, that is hard to do without a human judge in the mix.
Why? Humans have a much richer modeling apparatus than any computer does right now. We can draw on a very large and yet almost fully tuned to reality set of possible models simultaneously. You can estimate the number of available models as whatever number of neurons you have, in combinatorial. We also have machinery for searching that entire model space simultaneously and testing against a continuous stream of megabytes of data in realtime, in order to find good fits.
Existing AIs wouldn't even know where to start. They can apply infinite models, but have no grounding in reality, and no way to choose amongst them. The AI doesn't even have an intrinsic sense of space, seeing has how it lacks a body. It's a very fast worker that can get things done when you give it very specific instructions, but it has no real ability to understand what it is doing or why it would want to do something different.
This sounds like what the experimenters are doing. Perhaps the GP was alluding to "first order hill climbing" as evaluating the gradient in every direction and climbing the steepest one, but the "0th order" version is also usually considered hill climbing and is better for some classes of problem.
Some manifold has a goodness function defined on it, described by a (totally ordered?) relation provided by the observing scientist.
The goodness function is assumed to be (continuous/differentiable/continuously differentiable?) with respect to some metric, and the computer picks a random coordinate within some small distance of the last coordinate in the metric, and then asks the human to order them?
I don't think this is hill climbing, and my simple reasoning for that is that I don't believe the first assertion. The expert is almost certainly behaving non-deterministically. In fact, I believe that each time the expert is presented with the "same" pair of coordinates, he is more likely to yield a different ordering.
That said, I could be reading this wrong.
Those are the reasons why string-theorist will not (and should not) get any Nobel price in the next decades. Since its predictions are hard to measure on those small scales there's no way of telling if the model is any good until it is compared against suitable experimental data.
[1] https://aeon.co/essays/how-economists-rode-maths-to-become-o...
I'm wondering if they can even make use of the newfound GPU power or are just going ahead with ancient CPU based software because too much work has already been put in.
https://www.nextplatform.com/2015/03/27/rockets-shake-and-ra...
I'm wondering about all the research that goes on in all the universities where large investments have been made on CPU based clusters. The simulation in the article you linked was run on NERSC servers, which are Cray supercomputers[1], which pretty much are Intel Xeon class servers with fancy interconnects.
So looks like it is CPU based, but I'm still interested in the software they use.
And yes, GPUs are increasingly being utilized, depending on the algorithm. But, GPUs aren't magic; they don't speed up every kind of problem.
So we can't simulate it because we don't know enough to simulate it. And even if we did know there's not enough computing power to do so.
You start off with 4 (3 space plus one time (ignoring 11-dimensional space-time)) and add which dimensions exactly? Can the individual interactions between wave/particles be reduced to 2 dimensions? Aren't they going to interact along the whole range of forces they exert: gravitational, weak, electromagnetic, strong?
> Two additional complications arise because plasma fusion apparatuses are experimental and one-of-a-kind. First, the goodness metric for plasma is not fully established and objective: some amount of human judgement is required to assess an experiment. Second, the boundaries of safe operation are not fully understood: it would be easy for a fully-automated optimisation algorithm to propose settings that would damage the apparatus and set back progress by weeks or months.
> To increase the speed of learning and optimisation of plasma, we developed the Optometrist Algorithm. Just as in a visit to an optometrist, the algorithm offers a pair of choices to a human, and asks which one is preferable. Given the choice, the algorithm proceeds to offer another choice. While an optometrist asks a patient to choose between lens prescriptions based on clarity, our algorithm asks a human expert to choose between plasma settings based on experimental outcomes. The Optometrist Algorithm attempts to optimise a hidden utility model that the human experts may not be able to express explicitly.
I haven't read the full article nor do I understand the problem space, but the novelty seems overstated based on this. Maybe they can eventually collect metadata to automate the human intuition.
Edit: here's their formal description of it: https://www.nature.com/articles/s41598-017-06645-7/figures/2
I remember Tri-alpha being listed on one of the slides near the bottom left of the plot, 4 or 5 orders of magnitude away from break even, where Q = 1 (someone please correct me if I'm remembering incorrectly).
Is the 50% improvement described in the article meaningful, as that would only be a fraction of an order of magnitude?
I understand the broader concept of combining experts and specialized software on complex problems is a powerful idea -- I'm just wondering if this specific result actually changes the game for Tri-alpha.
According to their model, the plasma should get more stable at higher temperature. They just finished a new reactor they'll use to test that. It'll hit temperatures closer to 100 million degrees.
If they're right about plasma stability, they'll be ready to attempt net power with a full-scale demo reactor. Since they're using boron fuel they'll need to get the temperature to about three billion degrees, but they say pumping in more heating is relatively easy.
(Source for all that: I saw one of the Tri Alpha people speak at an MIT Solve conference the other year.)
So the 50% improvement isn't a make-or-break thing, but I'm sure it'll help. In general, being able to run simulations in hours instead of months will probably help a lot.
The video was eye opening though, I had no idea that high temperature super conductors were set to revolutionize tokomaks. If the potential is there, it seems like the prudent thing to do would be to reset the ITER project, and redesign utilizing the current generation of high temperature super conductors. But I'm just an interested observer, what do I know?
When it comes to industrializing the idea, the scope is far broader. For example, the speaker was saying that they can use the neutron streams as the result of fusion for creating tritium. In reality, capturing the neutrons is much more complex than that [1]. Some of those may deposit on the inner surface of the tokamak and have to be recovered by 99% to have breakeven. The nuclear waste is another concern in the opposite case.
Given all these, you get a sense that why companies like General Fusion [2] get funded. He showed that General Fusion is very far away in his metrics. But the pinching technology the company is offering, allows for continuous use of the fusion in rapid bursts (like an automatic rifle). When I met them at the Globe conference, they were claiming that they will be ready for production within 5 years of achieving a surplus. I am not sure how fast the tokamak can get there.
Source: 1. http://thebulletin.org/fusion-reactors-not-what-they%E2%80%9... 2. http://generalfusion.com/
A 50% increase could be much much more significant depending on the parameter optimised. Tokamak magnetic field strength for example has a factor ^4 effect towards net energy.
Have a look at https://www.youtube.com/watch?v=L0KuAx1COEk , as previously discussed here: https://news.ycombinator.com/item?id=14834390 .
Keep in mind tokamaks have reached Q=0.7.
Microsoft: They make an Operating System and Office Suite. From Microsoft Research they have labs on Quantum Computing, they have five Turing Award winners (One is Leslie Lamport) and he developed TLA+ while employed there.
Facebook: A social network Funds a bunch of Deep Learning Research and NLP.
Elon Musk: Helped create PayPal, now does electric cars and rockets, (Tesla, SpaceX)
NVIDIA: Made graphics cards for video games. Now those same devices allow for deep learning.
Kudos for Google for using their vast funds to finance their ambitions rather than just hoarding it away.
You'd think the advertising staff would get pretty good treatment at Google.
Do they?
I can't speak for the entire advertising staff, of course.
Addressing the wider article, it always surprises me that the focus fusion approach is never mentioned in fusion articles put out by the mainstream media. I don't know what to attribute that to, but it's surprising that one of the most promising fusion approaches is constantly overlooked.
To give an idea how drastically overlooked focus fusion is, here's a graph showing R&D budgets for different fusion projects...
http://lppfusion.com/wp-content/uploads/2016/05/fusion-funds...
... and here's a graph showing energy efficiency of fusion devices (running on deuterium I believe)...
http://lppfusion.com/wp-content/uploads/2016/05/wall-plug-ch...
You'd think that the second most efficient device would've gotten more than $5 million in funding over 20 years (I think the original funding was from NASA back in 1994).
The millions of possible "solutions" and algorithms for working fusion reactors may be what has made fusion research so expensive and fusion reactors seem so far away. Quantum computers may be able to cut right through that hard problem, although we may have to wait a bit more until quantum computers are useful enough to make an impact on fusion research. I don't know if that's reaching 1,000 qubits or 1 million qubits.
Even the title "optometrist algorithm" is telling, because that paradigm is a basic model for how a lot of testing is done, except that it's not the optometrist doing it, it's a computer.
Suppose a big breakthrough comes out of a private company, and such innovation is necessary to use nuclear fusion.
The company will be free to do whatever it pleases with the technology or it will somehow "force" to let other use, maybe behind the payment of some royalties.
Suppose a private company manages to lower the cost of electric energy by 90%, using a device self produced fast with virtually no capex. From an economics point of view, they build free money printing presses, essentially.
How would they benefit from this the most possible? Selling the energy? At what price? Take over sectors of the economy where electric price generates most added value? Aluminium production? Data centers? ...
Selling the energy mostly wouldn't make sense, since it means replacing regulated utilities. You could sell the reactors themselves but you'd have to be good at scaling up factories fast; unless that's a core competency you'll probably make money faster by licensing to people who are good at it. Or, just outsource the manufacturing.
Either way, if you can churn out lots of reactors fast, just sell them to everyone. Don't bother trying to take over e.g. aluminum production; what do you know about producing aluminum? How long will it take you to learn? Just sell the reactor to the aluminum producer.
The modern approach seems to be to just let people find a way around the patent, or simply ignore and litigate.
This only matters for the life of the patent, and is consistent with the intent of patents.
But simple assisted hill climbing is not a new algorithm, you might call it "Wizard" though. This would attract the right audience.
People invest in Tri Alpha because if things work out, a practical reactor is more like one decade in the future, and it would be very economical. The return on investment would be enormous.
Often I'll skip the article entirely.
From what I always understood is that the high-energy neutrons produced by the fusion reaction irradiate the surrounding structure and that there is still considerable nuclear waste (although lifetimes are better than with nuclear fission). Do the scientists not care or is this outdated info?
You need to use materials that stand up well to neutron bombardment. Many materials upon neutron capture have a half life measured in seconds, which isn't a big deal. As nuclear waste disposal goes, this really isn't a concern.
I know it's better than fission, but still not nice.
If is indeed seconds, then it doesn't matter of course. I was kind of hoping to understand more about material design in the recent scientific past with this question.
This is in contrast to a fission reactor where the fuel itself turns into dangerously radioactive elements when exposed to neutrons.
EDIT: The exception is that fusion powerplant designers will want to surround the reactor with lithium in the hopes that it will absorb a neutron and turn into tritium. The tritium is then carefully gathered because it forms the the fuel for the reactor and it's hard to get except in a nuclear reactor.
OTOH, danger from irradiated materials (whatever that is, this is the first time I'm hearing this TBH) doesn't seem very pressing. I highly doubt any of the irradiated stuff would have a half life of millions of years.
https://en.wikipedia.org/wiki/Nuclear_fission_product#Radioa...
With the reactor discussed in this article, the situation is even better, because it would use boron fusion. That reaction doesn't produce neutron radiation at all. There'd just be a tiny amount from side reactions.
"Google and a nuclear fusion company have developed a new algorithm"
sounds way better than:
"Nuclear fusion company has developed a new algorithm using Google"
They may not mean the same, but in today's world faking it until you make it might pay off.
Google entered the self driving cars research, and we have yet to see them driven around.
This heavily reminds me of Intel and their diversification, up until recently, they were in IoT, makers market and what not. One solid push from AMD and they jumped out of everything way too fast to track.
Google seems the same with the nuclear fusion. They have the advertising money to throw around, but that just it, they are in different segment, and from investing side I'm more inclined to stay away from their stock then buy it.
You see their working prototypes flying around mountain view all the time. And, they've been transparent with their progress.
People have been working on this since the 80s.
And I live on a side street.
https://www.slashgear.com/waymo-launches-early-rider-beta-pr...
They're easily 5 years ahead of the competition.
In fact the more I think about it the more I'm confused by your comment. What are you skeptical about? Google here has demonstrated their computational resources can be of great benefit to scientific causes such as nuclear fusion. If you're saying that you're skeptical Google can do nuclear fusion, I think you're missing the point.