We're building computers wrong [video]
youtube.com
youtube.com
But it's like, a one in a thousand shot.Almost all modern tech is better with regressions lasting a decade at most.
Occasionally there are rumors of some modern medical treatments being worse even though medicine as a whole improves, but mechanical and electrical stuff is much better understood and more controlled.
The exception is a few specific appliances that are seemingly designed to fail. Even then there's no lost tech. I'm pretty confident we could make a much better washing machine today for much less money if we tried, than anything from 30 or 50 years ago.
> Occasionally there are rumors of some modern medical treatments being worse even though medicine as a whole improves, but mechanical and electrical stuff is much better understood and more controlled.
Such as the iron lung probably being better than the invasive machines we have today.
> The exception is a few specific appliances that are seemingly designed to fail. Even then there's no lost tech. I'm pretty confident we could make a much better washing machine today for much less money if we tried, than anything from 30 or 50 years ago.
look at the space industry, it actually costs us more (adjusting for inflation) to try and go back to the moon than when we did before when we had no idea on how to do it.
Or look at tractors, farmers are clamoring for 1980s tractors over these new expensive (break down easy with no way to repair) 'modern' tractors John Deer is pushing.
Besides, if we just redid what we had, we would not be developing any new tech that could be used on earth. And it would be less comfortable, a very bad thing if you're still fighting the losing battle to convince anyone that they'd like to be in space for more that a brief adventure.
AFAIK they have cuirass ventilation to replace iron lungs now.
Those new tractors are most likely way more reliable. In practice they may be worse because of artificial limitations put there on purpose, but were it not for those it would almost certainly be better(Although people would probably still like the same ones, because no matter how reliable something is, people seem to like things with a "substantial" feel that they can understand).
Given that, the cost of the latest moon mission is “as much as we can squeeze the taxpayer for” rather than representative of the actual cost. The various new startups worldwide (not just SpaceX) are all much more interesting, though obviously they’ll only get a price comparison when they actually land a human.
I think it would’ve been neat if the Falcon Heavy had speed-run the Lunar X Prize, but alas they had better things to do: https://space.stackexchange.com/questions/27271/could-the-lu...
Certainly, Roman engineers built incredible unreinforced concrete structures. But this was accomplished through structural engineering techniques designed to keep the concrete compressed (e.g. arches, domes). Modern structures like elevated highways and skyscrapers would be impossible to build this way, and require steel reinforcement.
While the mix the Romans used was slightly different (apparently it contained a bit of volcanic ash and used less water), modern engineers deliberately choose a different mix based on the structure. E.g. larger structures with natural reinformcement, like dams, will tend to use a mix closer to what the Romans used.
I just bought a food slicer. The motor was connected to the saw using a very soft plastic gear. Its teeth became smooth after a month of use, rendering the machine useless, and no way to buy a new gear on the internet.
This is modern tech at work: you getter a cheaper machine, but to get there, the materials used suck. And there is no stock for replacement parts because it's expensive to keep them around.
The more common everyday things like kettles, vacuum cleaners, toasters, etc all seem to have very good options for not much money.
I've never driven a car, but my family seems to need less trips to the mechanics by far than when I was a kid. Computers definitely seem better in every way, and of course all small electronics like tape players have been phone-ified and seem to be much more reliable.
It may well be that slicers are niche enough that consumer versions are worse.
Still, nylon gears can be very durable(Unless any ozone gets on them, that seems to kill them).
A truly modern slicer with the same crappy materials would probably be using the MCU to predict the gear temperature based on motor current and limiting the duty cycle, and it would last a long time and perform acceptably well.
Either that or they'd have some direct drive scheme for then really nice ones, or maybe even some kind of no moving parts linear motor.
Modern power tools do this all the time. They shut down or reduce power for what seems to be no reason or a minor reason, but the computer probably detected some subtle overload condition I wouldn't have. It's a bit annoying, but it makes them cheap and durable enough to not think twice about buying used.
The stuff at Wal-Mart usually sucks, but there's almost always some affordable modern version that beats the older tech.
It does seem that 3rd party gears exist though, for some slicers.
At this point it seems like a vicious spiral. Someone clicks on a guy on a ladder and all of a sudden you're being recommended guys on ladders, so now everyone needs to get on a ladder to get on the front page.
Does anyone have an explanation for what it is about his videos that is so grating?
The videos are of educational, high quality, and the content is accurate. But the presentation is not for me.
It's some form of uncanny valley type of thing where every detail or facet or property I might point out, there are other people exhibiting the same nominal qualities without bothering me. But something here is just slightly off in some way, but so subtly you can't say what it is.
I honestly can't say he's doing anything actually wrong. I don't think even the most dumbed down ones are really guilty of being wrong. Not enough that I'd complain about it in a casual yt video.
I can see some people maybe not liking his basic style of exposition. That slightly affected dreamy pondering thing.
One thing I can observe is that another guy that just turns me right off even worse is the Smarter Every Day, and these two appear in each others videos at least a few times. Or maybe it was just one time and that one time just bugged me that much :)
I don't know what it is but I frequently see a video from either of these guys where the topic they are presenting looks interesting, but then I do not like their video on that topic.
I think it's down to the presentation just seems a bit too affected. And it's not even as bad as seeming fake or insincere. They both actually strike me as perfectly sincere.
I guess to summarize, with Destin it feels like you are learning with him and Veritasium feels like you are being lectured.
I see the distinction you make there now that you point it out.
I saw something similar all the time as a dance teacher: explaining stuff and showing over and over made the students feel like they learned a lot. But they just didn't. It was mostly a total waste of time. I switched to showing ONCE then they had to try. Then I showed again. The speed of learning went up dramatically. The problem I had then was that the students didn't like it!
"Make people believe they're thinking and they'll love you. Make them actually think, and they will hate you."
It'd be nice with a real scientific test! There's a lot of subjective feeling here and not anything very solid. Veritasium at least backs up his position with his own thesis research. I find that more compelling as an argument than having a position not backed up by anything at all.
Ok that one has something I can identify clearly: The way Justin (Smarter Every Day) seems to be just badly hamming up the whole "this is so weird and hard to visualize" as though to pander to the audience who are expected to be baffled by the idea being presented. That was Justin though not Veritassium.
I agree with what you point out about this one.
I've unsubscribed from this channel and smarter every day because while I believe the authors feel like they're doing the right thing. They let themselves be highly biased/influenced by their sponsors that I cannot watch the video and believe that they're being honest.
His videos don't strike me as intending to educate. They strike me as intending to show how much more clever he is than you - and it's entirely that he came up with some weird gotcha that people logically assume he couldn't be talking about because it's nonsense.
It's like watching a smug teenager who never grew out of it. No thanks, I don't need that reminder of how grating I was.
What I really don't like are the new video titles. At some point he started A/B testing them to maximize his revenue. He even made a video about it [3]. Of course, this selects for the most outrageous clickbait in order to get that sweet engagement. I am starting to wonder if he took into account, how much this is starting to alienate long-term followers.
[1] https://www.youtube.com/watch?v=pTn6Ewhb27k
I imagine that, over time, this may shift his target audience. But if a new audience is comprised of a demographic he's aiming to reach, and it gets him the views, I can't fault his decision on how he titles the videos, even if they have me skipping them.
I think he’s experimenting with clickbait.
Besides that I think the topic is prescient; there's a company local to me in Australia called Brainchip that is doing something similar I think. Given that NNs are just a bunch of matrix multiplications it's a promising approach.
I occasionally used to watch Smarter Every Day then he started doing a lot of this stuff, I think one of them might have been for an oil or defense company which I found utterly gross and I've avoided watching the channel ever since.
This has been disproven by people doing experiments
Someone set up some long wires over a farm field, and measured the time to first current flow, which was faster than if the current had to travel the whole wire length. Granted, the full current flow doesn't appear until later, but the first little bit of current is there, which is exactly what Derek said in the Veritasium video
(The fact that the loop is closed can't be relevant by simple thought experiment, because otherwise it implies you could get ftl signaling by having a switch on the physically distant checking whether the "tiny current" flows when you close the source)
Whether the distant end of the loop is closed or not makes a difference eventually, where 'eventually' means once the initial EM wave has reflected from the end and returned to the load.
And considering the fact that Derek has a Ph.D. in physics education research [1] that seems like an odd mistake for him to make, unless it was intentional.
As another commenter pointed out [2] Derek's content lately seems to be tailored to the maxim of "Make people believe they're thinking and they'll love you. Make them actually think, and they will hate you." It seems intended to invoke incredulity rather than understanding, presumably because he's decided the former is more marketable - because providing incomplete understanding and phrasing things in a way that's just technically correct enough to invite flame wars boosts engagement and therefore virality.
Yet another commenter [3] invoked https://xkcd.com/169/, which I think is apt.
[1] https://en.wikipedia.org/wiki/Derek_Muller#Early_life_and_ed...
I understood even less after watching it I think..
I have done this personally with shorter coax and TDR.
At the end of the day, specialized hardware, particularly on the analog side (neuromorphic, optical, etc.) locks development into the path of highly uniform feedforward networks by optimizing large matrix multiplications, and it is unclear if this tradeoff is worth it as we still have so much to figure out about which methods will make progress in AI.
First of all, there is no single accepted definition of "neuromorphic" [1]. Still, as a point in favour of the "neuromorphic systems are analogue" crowd: the seminal paper by Carver Mead that (to my knowledge) coined the term "neuromorphics" specifically talks about analogue neuromorphic systems [2].
Right now, there are some research "analogue" (or, more precisely "mixed signal") neuromorphic systems being developed [3, 4]. It is correct however that there are no commercially available analogue systems that I am aware of. Unfortunately, the same can be said for digital neuromorphics as well (Intel Loihi is perhaps the closest to a commercial product, and yes, this is an asynchronous digital neuromorphic system).
[1] https://iopscience.iop.org/article/10.1088/1741-2560/13/5/05...
[2] https://authors.library.caltech.edu/53090/1/00058356.pdf
[3] https://brainscales.kip.uni-heidelberg.de/
[4] https://web.stanford.edu/group/brainsinsilicon/documents/ANe...
1. Flexibility. Reprogramming digital computation is easy and quick.
2. Robustness. One can mass-produce devices that operate in the digital domain and sell them as working as spec'd. But operate them in the analog domain, and you will work with a million snowflakes that all operate slightly differently, giving different computation results. And when temperature changes, the result of your analog computation will inevitably change, too. You can work around that by adding more circuitry, and partly also on the algorithmic end but it will cost efficiency and precision.
Matrix multiplication on an analog device is great, unless you want an exact and reproducible result.
It will take a while though. It is still quite hard to remove noise for opamp circuits.
I think that is a myth. Predictable, reproducible and explainable outcomes are the holy grail of computing, in particular in AI.
If stochasticity is desired, there are methods to inject it, with precise control of the level of stochasticity and the distribution.
This level of control is absent in analog computing. Device mismatch introduces some randomness, but it cannot be controlled in practice. Instead of adapting the randomness to the algorithm, one ends up adapting the algorithm to the randomness.
Working with analog computers is a fascinating academic exercise. For practical applications, I doubt we’ll see it compete with digital computation anytime soon.
He's not totally correct because, like I said, the way we think of analog computers right now is likely not going to get us to where we need to be. Noise is a huge problem. Our own neurons do not seem to use continuous voltage, for example, and use pulse density coding, at least for some of their operation.
A digital computer transistor has to operate(assuming ttl logic) at around 5 volts and 2 volts the transistor behavior in between does not really matter.
The analog computer transistor has to operate to a high precision at all voltage ranges.
Go ahead and start pricing out high precision transistors and the environmental controls needed to keep them there and you will see why we use digital computers.
The history of the navy NTDS air defense system is interesting because they were in a position where they could have gone ether way. use known and understood analog computers or go with the unknown new tech, digital computers.
https://ethw.org/First-Hand:No_Damned_Computer_is_Going_to_T...
1: https://en.wikipedia.org/wiki/Tensor_Processing_Unit#Third_g...
(My zorojushi rice cooker still mentions fuzzy logic, but they must be just implementing the fuzzy "transfer function" with an mcu at this point, right?)
There's some (relatively) new ideas that now the performance of computers will be pushed more by dedicated silicon for a dedicated purpose, and tools. See for example there's plenty of room at the top [1], or Hennesy's talk at Google [2].
This of course does not mean that analog computers are suddenly viable, but it does mean that they could potentially fill a niche where they failed previously.
Anecdotally, when looking at jobs for hardware design by the likes of Infineon, STM, Cyient etc. there seems to be a relatively high ask for (senior) analog designers, and a new focus on mixed-technology chips. It might turn out to be a dud still, but it isn't the same situation as decades before.
1: https://www.science.org/doi/abs/10.1126/science.aam9744 , or the IEEE article https://ieeexplore.ieee.org/abstract/document/7863324
2: https://www.youtube.com/watch?v=Azt8Nc-mtKM , around the 12:15 mark, but the entire video is relevant.
found it bit interesting, goes on about the history of AI/ Neural Networks and says these do not need the precision of digital computers (manly requiring matrix math)
and this can be done faster with analogue computers (using variable resistors type of transistors)
In the 1800s, Lord Kelvin spent years working on tidal rise and fall patterns, applying Fourier Transforms to break them down into ten individual sine waves, then combining those sine waves back together to predict future tides. And built analog computers to do all the involved integration, multiplying and summing. It's a part of the history of computing I'd never heard of, despite hearing quite a lot about the dawn of electro-mechanical computers in the early 1900s.
Along with a meccano numerical analyser, and bits of babbage's original work
The argument for analog is weaker. I've tried some stuff with analog computers, and at one time I was into op-amp circuits. The basic problems are noise and inflexibility. However, that may change as people develop ICs that are reconfigurable, like an FPGA.
Flash memory cells as multipliers by a changeable but not dynamic value are a new idea. That only leads to analog ICs that do a pre-trained neural net, though. Running neural nets isn't that expensive. It's training deep neural nets that needs entire data centers. If they can figure out a way to do the whole backpropagation thing in analog, that would be impressive.
For digital storage the data can change quite a bit before a 1 becomes 0 or vice-versa, but for analog even a small change can be a problem. So I don't know if we can extrapolate the typical Flash memory data retention number to the expected aging for this device.
https://engineering.dartmouth.edu/community/faculty/kofi-oda...
He's interested in creating analog circuits that are more efficient than digital ones for signal processing and machine learning.
I've programmed an analog computer when I was working in the military-industrial complex long ago, implemented a standard missile guidance algorithm for an IR missile using a dual feedback loop and adjustable nav ratio. It was kind of like programming with wires to implement math. It had noise limitations on accuracy, in part because of the many wires exposed to florescent lights and digital computers in the room. Quite interesting. I think the Analog Thing might make a good EuroRack music making module! Turn math into music.
A few people said that they "knew" it would be veritasium, but I had guessed it would be Mill computer folk :D
So, compare that to a 4 bit ALU (an old one, at that) the 74HC181. At 5 volts it consumes 80uA at idle.
Analog circuits require transistors have bias flows through them at all times to ensure linearity. CMOS digital logic has the transistors either fully on or off, except during switching times.
Going analog isn't as great an option as this video makes it seem.
[1] https://leonardo.info/review/2019/07/review-of-the-discrete-...