Give AI curiosity, and it will watch TV forever (2018)
qz.com
qz.com
You see this with children and iPads. My kids know 3x what I did when I was their same age. It's as if something can finally fill their bandwidth, keep up with their thoughts, and answer those questions in real-time. No wonder they get angry when it's time to put away the iPad - they're engaged at a high level. Much like when I am programming on a sideproject and my focus is interrupted.
The biggest travesty is that we don't get more control over Youtube's algorithm. That we can't ban all Youtube videos with the word "Minecraft" in it, so that we can override their curiosity and say "OK, learn something else today."
Youtube's focus solely on engagement above all else is the biggest tragedy of the modern world. Such a massive opportunity for education - e.g. inserting more academic videos in between entertainment. But we don't get that feature, or any manual overrides for more control.
If any Youtube engineers are reading, please give us (the parents) more control! Youtube, do better.
There are conspiracies about these topics, apparently. I wouldn't have thought so. But the Youtube algorithm manages to dredge them up.
personally I don't believe that 5 minute trivia is going to be worth a dime in the AI ridden world Og tomorrow.
Though I will grant that some latent knowledge might stick regardless. Active curation and note-taking (e.g. in a personal knowledge base or in a private/public wiki) might also help.
In fact it's this that I would recommend most to kids these days: record and curate the things you do and see. Not only for nostalgia's sake but also so that you can find (and reshare? ;)) stuff again.
Unfortunately, this won't happen.
No number go up, no change. Noone will get promoted for this. Not the PM: number won't go up. Not the dev: number won't go up. Neither the director nor the VP: number won't go up.
It's really like opium - until the regulators come in, nothing will change as numbers must go up.
The free market libertarians will say you have free will and should think for yourself, rationally, let the market decide. Well, the market decided it wants to self-destruct.
apple, youtube, google, amazon made their bacon by being user-centric and generating huge value.
now they're busy capturing value
you can only capture for so long without generating
I don't have much experience in this field, but you might look into stuff like the streaming apps for PBS or TED, or even paying for Nebula or Curiosity Stream. If you were really serious about something, you could even look at a learning platform like Khan Academy, Brilliant, or Coursera.
That way, the Youtube app appears to work the same. It's just that those videos that are blacklisted in the recommendation response, e.g. all the videos with the word 'minecraft' in the title, would be replaced with Youtube shorts from Neil deGrasse Tyson.
Intercept the response. Rewrite the <title> and <URL> entries for blacklisted videos. Return the rewritten response to the client.
Point my kids's iPads at this proxy.
YouTube's app uses certificate pinning. I would have had to reverse-engineer their certificates in order to properly sign the response.
I stopped at that point in the project.
If someone watches one Blue's Clues video, ten more are recommended afterwards.
I want a more diverse set of recommendations from a smaller set of educational channels.
And I want to filter entirely by keyword. Disabling individual channels for something like 'Minecraft' content is futile.
A proxy-as-a-service that allows you to interject alternative recommendations for your kids to watch.
Allow the parents to whitelist certain channels. Blacklist specific keywords - 'minecraft', 'fortnite', 'mrbeast'.
I'm not sure you even noticed the question you just presented: "what something?"
If you can find a meaningful answer to that question, I suspect it will resolve your problem without help.
As a rule of thumb, any solution that boils down to "stop" will be practically impossible to implement. A more tractable solution is usually along the lines of "do this instead".
Something that could be really valuable here is a competitor to YouTube's algorithm. Copyright makes that difficult, because YouTube is in a legally enforced position to monopolize their library/metadata.
Or delegate their recommendations to only a select series of educational YouTube channels.
Focus should rather be on banning platforms. (They are digging their own graves with that editorializing anyway, since once they do that they become legally responsible for publishing what their users upload.) Only then you can start talking about only allowing open algorithms (so, no neural networks) on generalist search engines.
There's a problem with your line of thinking.
E.g., I remember the epiphany when I realized that a particular C codebase was an implementation of a (more or less) object-oriented dynamic programming language. Ooh, here's the part that implements classes. Here's the part that instantiates the objects. Here's the method-dispatcher.
Ooh, here's the half-baked templating system that lets the user associate custom classes with 2d vector drawings and instantiate objects from them!
I was taking in the code of that codebase as fast as I could scroll and read the functions and structs.
At most, reading this code took up perhaps 20% of the time I was devoting to this endeavor. The other 80% was thinking through those design choices and their implications, during my unstructured time-- going on a walk, sitting on a bus, etc.-- when I was away from the computer.
If your kids are exposed to 3x of my example screen time, they're going to require vastly more unstructured time than I had to think through the implications of everything the screen put in front of their eyeballs. Trends in cell phone usage-- and even basic arithmetic of 24 hours in a day-- tells me that your kids aren't getting that.
What if it were more thoughtful content - a series of problem(s) proposed at the beginning, walking through possibilities, and then the solutions revealed at the end?
Is it possible that the content can teach us both knowledge and how to think/reason?
Neuroplasticity as a concept is challenging but even when Torsten Wiesel was sewing kitten and cat eyes shut the adults could adapt. And the claims that the kittens rewired more are problematic.
The neurons originally attuned to the closed eye did not acquire new functions, they heightened their response to the input from the open eye.
The responses were always there. Just at low levels.
Free time to to dedicate for building tactic knowledge is the main limiter for adults and not hard wiring.
https://solportal.ibe-unesco.org/articles/neuroplasticity-ho...
The general argument that I hear which is true (from all I've seen and read) is that neuroplasticity is greatly reduced in adults as compared to children. There is a period in early childhood where brains are incredibly flexible and adaptable, and as they age they continuously lose that ability until the majority of it has been lost by adulthood.
It doesn't mean there is zero in adulthood, just that it is very small compared to childhood.
I think you're arguing against something nobody really says.
The easiest example for me is learning guitar - I started when I was 5 and got pretty damn good over the years. It would be difficult to repeat that now in my 30s, but at least part of that difficulty would be because I can't really devote 3-4 hours a day nearly every day to it like I did as a bored kid out in the country. To be clear, I'm sure the differences in neuroplasticity come from both behavioral and neurological differences. It's just fun to think about how much is set in stone and how much could theoretically be "exercised" so to speak, and how much of the neurological changes are actually due in part to the behavioral changes as we age.
I whole heartedly disagree with this. I believe that one of the key aspects in early education is learning patience - love NG term personal fulfillment is not something you can do between the dopamine hits Og YouTube videos.
To me, it feels like some type of "pleasure center" trigger. I was talking to a psychologist once and what she said resonated with me. We were/are both middle-aged and she said something to the effect of, "When we were kids, our games were, at best, a '7' (out of 10). These days, all popular entertainment is a '10+.' Hard to compete."
Or they are angry because by taking away the iPad you are interrupting their dopamine rush. Whether your iPad + Internet/social media/YouTube is engaging them to fullest maximizing growth potentiation or is simply turning their brains into dopamine chasing crack heads is up for debate. It may be somewhere in the middle and whether the positives outweigh the negatives is individual for each child/person and how and how often they engage with it.
Regardless, I think there are more variables at play than you outline above.
This makes it sound like kids across the board are getting smarter and more knowledgeable. Then why are so many headlines saying the opposite? "U.S. reading and math scores drop to lowest level in decades" or "Children's IQs are getting lower, US study finds" etc etc. Even if it's clickbait, I'm not seeing any "kids are getting smarter" clickbait.
For example, try Kidzovo an app that curates learning content for kids, makes it interactive so kids are not only watching it passively. And we intersperse it with general questions like: "Why should you be nice to your neighbor?" and then parents can hear their kids' responses in the parents' section of the app.
Disclaimed: I work for Kidzovo.
“ART said, What does it want?
To kill all the humans, I answered.
I could feel ART metaphorically clutch its function. If there were no humans, there would be no crew to protect and no reason to do research and fill its databases. It said, That is irrational.
I know, I said, if the humans were dead, who would make the media? It was so outrageous, it sounded like something a human would say.” -Martha Wells, Artificial Condition
Although fiction, it’s very thought provoking in evaluating where a truly sentient AI might place its motives. On one hand the research transport bot (ART) is motivated to protect its humans because it would be functionless without them. While the main character (a security unit, who is typically treated badly by humans) sarcastically but partially truthfully places its motives to not kill humans in funding its curiosity of TV.
Would implementing curiosity in a sentient AI act as a safeguard possibly?
Would curiosity arise as a byproduct of sentience without being directly programmed?
Unless it gets curious about the variety of sounds humans make when you vivisect them or something else you'd prefer not be rigorously investigated.
Definition: The definition that OpenAI team used for artificial curiosity was relatively simple: The algorithm would try to predict what its environment would look like one frame into the future. When that next frame happened, the algorithm would be rewarded by how wrong it was. The idea is that if the algorithm could predict what would happen in the environment, it had seen it before.
> OpenAI researcher Harri Edwards tells Quartz that the idea for letting the AI agent flip through channels came from a thought experiment called the noisy-TV problem. The static on a TV is immensely random, so a curious AI agent could never truly predict what would happen next, and get drawn into watching the TV forever. In the real world, you could think of it as something completely random, like the way light shimmers off a waterfall.
The headline is really just inappropriate anthropomorphization.
/s
I don't know the details, but probably you would want to seek unpredictability in a higher level representation of the observed state. White noise is highly unpredictable per pixel, but will get a very predictable representation after a layer or two of featurization if the features are trained/designed for real world observations.
(Basically, it's the number of degrees of freedom of the underlying probability distribution, and white noise doesn't have many.)
> White noise is highly unpredictable per pixel, but will get a very predictable representation after a layer or two of featurization if the features are trained/designed for real world observations.
Virtually anything that cannot be predicted is interesting by nature of being unpredictable. Is it truly random? How, or why? True randomness is rare, and its existence is interesting.
TV static is uninteresting because it isn't actually random, it's just too onerous to get the measurements to predict it for the value we would get. It's part of the large class of things that is random for practical purposes, but not truly random. I have no doubt that if humanity dumped all its resources into predicting static, NASA could measure inbound radio waves and/or model space to figure out what static would look like at a particular spot.
Notably, humans find the cause of static (partially various waves from space) fascinating because we can't predict them. We've just placed our interest down a layer of abstraction from static. Static is boring, the source of static is interesting.
I suspect it is truly random to the AI, though, because it has no means to "see" those radio waves. I would wager humans would be far more interested in static if we were also unable to see the causality between radio waves and static.
I would be interested to see if the AI was as interested in static if it was also provided a real-time feed of radio waves at the antenna. Would it figure out that those things are correlated and lose interest in static like humans have, or would it continue to find static fascinating despite knowing it's a basic causality?
Humans seem to be the same way. Lots of people learn something because it pays well.
I just opened up a discord server I'm in and everyone is spending quite a lot of time on it!
Curiosity is more like scrolling on social media. You know there have been interesting things there before, so you keep looking for more interesting things.
Anyway, read the first one, you’ll be hooked.
Literally getting dopamine rewards for seeing something new is what keeps people glued to tik tok feeds and twitter.
I tend to get bored halfway through a book if it is predictable.
If you're not surprised at any point in mapping out an unexplored thing, in what sense is it unexplored?
There are pretty high odds you've never been to this exact page before: https://oeis.org/A000079. But once you click on it, is there any remaining curiosity? It's an unexplored thing, in the sense that (I presume) you've never looked at this exact page before. But it doesn't provoke curiousity because there's nothing there to surprise you.
I'm trying to imagine the simplest case, say a button you could press and every time you pressed it something entirely random would happen, always guaranteeing surprise. It would have a great deal of novelty at first but after a while it would cease to hold your attention even though your prediction of what would happen would never be accurate. I'd bet that after a while you might even never bother to push it again. The only way you would be convinced to push it consistently would be a) if you were assigned a reward for pushing it e.g. money in which case it is a slot machine or b) if by pushing it you could somehow reduce your uncertainty about what would happen which would as a by product reduce your surprise.
Thinking about it this way, surprise is certainly a key element at first. It grabs your attention initially but it doesn't hold it. What keeps you focused on exploring the thing that surprised you initially is the learning process which involves reducing prediction error i.e. reducing surprise. So there is a tension between the two.
The combination probably makes for a good exploration strategy. Initial surprise, look for a learnable pattern and follow it until another surprise, maybe backtrack and try other familiar patterns until those are exhausted and then investigate each sequence that led to a surprise by recursing through these steps.
This would also explain the example where my curiosity was prompted by the unknown link but I was not motivated to explore further. The website wasn't interesting to me because it was too unfamiliar and I wasn't able to find any familiar routes to explore through it due to my lack of interest in that area of mathematics but our hypothetical mathematician with a fondness for integers would see lots of familiar patterns they could explore attached to which are likely some enticingly unknown and surprising links.
Thanks for the prompt to think about this more!
I was curious how they define or reward curiosity, it says it right here:
Reinforcement learning algorithms rely on carefully engineering environment rewards that are extrinsic to the agent. However, annotating each environment with hand-designed, dense rewards is not scalable, motivating the need for developing reward functions that are intrinsic to the agent. Curiosity is a type of intrinsic reward function which uses prediction error as reward signal.
So, the prediction error is the reward, nice.
Static on the TV is random but uninteresting, whereas morse code is “random” at first, but after enough exposure can be understood and predicted.
Edwards said there were instances when the AI could pry itself away from the TV, but only when the AI’s surroundings somehow seemed more interesting than the next thing on TV.*
Sounds exactly like humans addicted to watching tiktoks and social media. Do you personally know any?
This happens at all levels of sensory processing, from single cell firing (which is noisy) to the boredom you feel with a 100 channels of TV that are all technically novel to you but contain nothing remotely interesting.
Basically if you've built an agent that can be perpetually distracted by noise or a "noisy" TV then you've forgotten an important piece of the puzzle.
https://papers.nips.cc/paper_files/paper/2005/hash/0172d289d...
This is a great thought experiment but they're using the wrong metric. Animals are wired to seek information, not noise. We understand that there is nothing to be learned by absorbing noise.
It is a fun thought experiment - how do our brains systems manage to reward seeking new information without getting trapped by simplistic pseudo-RNG patterns in nature
If the AI learns, it will not watch TV forever, because most TV is predictable. There is the cop show, the lawyer show, the doctor show, the news, the family sitcom, etc etc. Eventually it would learn all these and find the TV less interesting - which is exactly what happens to many people.
Reinforcement Learning with Prediction-Based Rewards — https://news.ycombinator.com/item?id=18346943 — Oct 2018 (38 comments)
Also, stock market prices, but I imagine a whole lot of effort is already quietly going into that at present.