Learning Is Remembering
saveall.ai
saveall.ai
Let me give you an example in programming: I sometimes have to google for the names of functions I've already used a hundred times. Sometimes extremely simple functions (just a while ago it was list.size() in Java), only because I can't remember the name of the function, but of course I understand the concept - the length of a list/array. I just can't remember if it's length(), or size() or count(), or whatever.
This deep understanding feels quite different from simple memorization. It feels more like something in my body, similar to muscle memory or like playing a piano piece. It's something I feel I will never forget.
I'd love to learn more about this kind of understanding. For years I've tried to find good reading about it, but much has been disappointing.
From the papers Abstract:
"No longer do we have to make costly efforts to find the things we want. We can “Google” the old classmate, find articles online, or look up the actor who was on the tip of our tongue. The results of four studies suggest that when faced with difficult questions, people are primed to think about computers and that when people expect to have future access to information, they have lower rates of recall of the information itself and enhanced recall instead for where to access it."
[1] Google Effects on Memory: Cognitive Consequences of Having Information at Our Fingertips - https://www.science.org/doi/abs/10.1126/science.1207745
[2] https://news.columbia.edu/news/study-finds-memory-works-diff...
The more you do something, or think about something - the more it becomes a "System 1" operation(fast, intuitive). Like typing on a keyboard for example, when you first started using a keyboard you had to think about every letter you want to hit, but now you probably don't even think about it for a millisecond. I guess what I'm trying to say is: Intuitive understanding = Action * Repetition.
Read the book if you haven't, it might be the kind of material you're looking for. I'm not a big fan of psychology and I think it's 90% mumbo jumbo, but this book hit a few nails for me.
Edit: To clarify, shallow is maybe the wrong word. I think the book gets its main point across very well, and it's a good point. But the majority of the book is just further evidence supporting that main point. Which is fine, but I wish it would develop this main point a bit further. The book could be summarized in a short paper and wouldn't lose too much of its value, in my opinion.
https://replicationindex.com/2020/12/30/a-meta-scientific-pe...
This is why I have always been terrified of having to do a standard 'whiteboard' coding interview, and really don't want to ever participate in administering them to others. I know if I was ever tested in this way, I would be unable to remember the basic function names in languages I have used daily for years... and yet I have developed sophisticated software tools in these languages with a large global userbase. I fear that in an interview people would decide I am a fraud, and couldn't have really done what I have done when it appears I actually don't even remember the basics. But my mind just doesn't work that way, I can't remember length vs size either, even if I can design a complex algorithm, and turn it into a good piece of software under the actual conditions of work in the real world.
Honestly if they care that much about rote memorization of syntax, it's a red flag.
I too don't like the idea of these, but in the case where you're solving a problem in front of someone I feel like as long as you explain your thought process you'd be generally fine. If you can't remember whether the method is length() or size() or something else just pick one and explain what you're doing. Intelligent interviewers would likely understand that you're familiar with the concepts and would be able to accept your result or let you compile/execute and fix the issue.
To expand on this a bit - our memories maintain "schemas" of knowledge and whenever we learn something new it gets slotted into our "schema". The better something fits into our schema the easier it is to remember. I think if you googled schemas you'll be able to find more material on this
To be honest, I think we (humans) don't understand this type of understanding very well. Which is somewhat ironic :-)
Edit: But thanks for the suggestion about searching for schema, will definitely take a look!
The knowledge defined in the article is very rational and reductionist in its presentation. I don’t mean that derogatorily, but it does mean it can’t account for all the emergent features of our existence. The reductionist approach can be useful as a set of signposts for locating reliable mechanistic constraints.
I agree completely with your analysis of the article by the way. Beautifully said!
Have you ever gained a solid understanding of a complex topic after a lot of study? When you start to forget the relevant details of the context you’ve created, your understanding fades as well. “Understanding“ is just a complex function of memory to a large degree.
(1) That a deeper understanding of something can make it simpler/easier to remember. One way to look at this is that you remember a model of the world. That complexity of that model determines the quantity of information you need to remember. If you can find a simpler model, your mind needs to store less information to cover everything you need to know.
(2) That a concept and its name are different things. You understand the concept of an array-length-giving function, but you don't remember the name attached to it. It could go the other way: you could know there is a function with a certain name but not remember what it does. Or you could know what it does and what it's named. (This seems at least tangentially related to linguistic relativity (https://en.wikipedia.org/wiki/Linguistic_relativity), a.k.a. the Sapir-Whorf hypothesis. The question is basically to what degree our minds build ideas on words/language and to what degree we form ideas independently of language.)
> See that bird? It’s a brown-throated thrush, but in Germany it’s called a halzenfugel, and in Chinese they call it a chung ling and even if you know all those names for it, you still know nothing about the bird. You only know something about people; what they call the bird. Now that thrush sings, and teaches its young to fly, and flies so many miles away during the summer across the country, and nobody knows how it finds its way.
[1] https://writings.stephenwolfram.com/2019/05/remembering-murr...
The number of names that are misleading or almost willfully obtuse is absurdly high. (I'm actually cheating for folks in my list, as I typically see it just shown as shell sort and bloom filter. Which hides that it is named for someone.)
I also don't mind algorithms named after people, and can understand some of how that gives provenance, at the least. The Knuth-Morris-Pratt algorithm is a good example of that. What makes things difficult is that many of the other sort algorithms were not after people's names. Unless there is a Merge that I am unaware of. :D
I think your example about list.size doesn't contradict this. It's the difference between "familiarity recognition" memory vs "consolidation and retrieval".
You do not bother committing "size()" because it's unnecessary (or because there's a lot of interference from other languages which do the same thing, hence the cost of committing that fact for later retrieval is not worth doing so).
But you have committed the "concept" to memory, and this can be retrieved even without the need for the label.
"Understanding" is only part of the equation. But I do generally feel that "having the basic building blocks readily available helps you build complex understanding on top of them, which then helps you consolidate the complex stuff better" is probably the main direction, rather than "understanding a complex concept helps you better remember the basic building blocks that made it up in the first place".
This is also why anki works so well for learning theoretical subjects (even if it has traditionally been more popular for pure memorization tasks, like language learning)
I started using Anki (A spaced-repetition tool) to improve my long term memory by creating cards for everything I like to remember no matter how trivial it might be, Then the act of reviewing the Anki cards became a chore.
I'm currently trying to solve the problem of reviewing Anki cards by having an always-on review system[1] which lets me review cards when ever I want instead of a rigorous schedule.
Why?
Because it is a single entity(through abstraction). And because it is a single entity and you use it a lot, it gets connected to many other concepts.
And because you've solved problems with it,it has more emotional value.
This means you can more easily retrieve it and it has more "meaning"/context to you.
list.length gets used less often and it just a concrete implementation of the concept so maybe it's just linked to the concept.
And it's also more complex to remember and use because it's made of 10 items.
Copilot is a lifesaver here. I almost never have to google function names anymore because it just fills them in for me, while usually generating exactly the code I wanted around it.
I'm not saying you shouldn't use it, but before you go into technical parts of interviews I would recommend you do some coding without all the bells and whistles tools.
This is basically the Searl argument against AI, right?
So now I'm wondering, is my initial "learning" process wrong? Since definitions are fairly simple and I find them easy to remember at first but hard to hold onto. And my process in Anki for New cards is to rep them like reviewed cards until I pass the card; so really, I'm just staring at the kanji + definition until I remember it.
This brings me to my question: is there more Anki can do when it comes to learning new cards? Is there something we can do when learning new information that will help make it "sticky"? Especially in regards to "simple" facts, like basic kanji -> definition mappings, where there are no mechanics to understand, just simple mappings.
Edit (an addition):
Also, I love SRS, but I don't understand how it can be advertised as completely different than rote memorization. When you learn a new physical flashcard, you're learning it the same way as you would be when learning a new Anki card. The only difference is that Anki will show it to you again at a more efficient time in the future, rather than at some regular interval.
I'm recommending you some things that have completely changed my experience using Anki for language learning:
- Don't use translations. Use images instead. For learning how to say dictionary put a picture of a dictionary. It will be easier to remember. Also, you usually won't find a perfect translation for a word.
- Use cloze cards for grammar. Instead of learning the rules, understand them and put four sentences with placeholders and repeat them. This process will make this way of constructing sentences stuck in your head.
I've studied a few languages, and by far the easiest, fastest and most long-term proof way to memorize words is by free association.
It takes some initial effort to be able to create these associations, but when done, it's done. There are some words I now basically can't forget, because the association is just too strong.
Example:
Waarschuwing = dutch word for warning. With free association i did it like this.
the "waar" part of the word immediately made me think of english word "war"
schu, shoe
wing, wing
So i vividly imagined a flying shoe with a trompet warning about an upcoming war. Done. Unforgettable for me. The more ridiculous, emotional (funny, stupid, ...) and obvious the better.
Some words are easier than others, and the ones that don't have a quick association jump out quickly are at a higher risk of being forgotten, but even then, they will stay way longer and without much less effort than with brute force, which is basically just creating memories out of nowhere, with no associations to anything on your brain. Our brain loves to relate things to others. Unrelated things = useless things. Everything that is useful has a relationship to something else.
So when you try to memorize by a way that is not based on association, indeed, only brute force works, which is a way to tell your brain "welp i can't really tell you what's the usefulness of knowing this, but somehow it keeps coming back into consciousness, so i guess i need to keep it in here somewhere. A self sustaining island, a dot of knowledge with no connection to anything else i know or care about."
Thats because Anki isn't for memorization, it's for time optimization and scheduling. Nothing about Anki makes you remember a fact better, that's still on you, and the memory champions use ALL those tricks and techniques.
Anki just schedules the non-memory-champions needing to mostly remember most of the things, and minimize the time taken to try and do that.
Said as a multi-year daily Anki user getting really close to a 1000 day streak.
They focus intently at seemingly incomprehensible complexity. Then they play with the small fragments they can get their hold on. "ba-ba-ba-ba" when they're learning to speak.
They play. They combine two (or more) different things they're interested in into a single experiment which we think of more as play. Mushy food? I wonder what happens when I throw it on the floor? Oh look how it landed all funny! Look how mum and papa reacted!
Grinding through cards learning languages never really did anything for me. Immersion and regular (but not exhaustive!) play stretched over time makes the neurons of my mind much more reliable.
For others, no. It's joy. And their secondary benefit is learning.
That has to be achieved by actually practicing the language, either via listening, speaking, or writing.
Anki is there to help after that step by keeping you refreshed with the exact tones, strokes, multiple pronunciations or more ambiguous CJK characters etc. but it can't be the motor behind the process.
For spaced repetition, although it is a form of rote memorization, the key insight is that memory is formed through recall, not review. The system then (purportedly) hits you at the very moment you are about to forget the card. It's counter-intuitive but it's easier to encode things in long term memory by recalling them at that point as opposed to when it's still fresh in your mind.
This is analogous to studying in university via explaining things to yourself versus just highlighting and rereading the textbook. Every student knows the former is more effective.
Anki might help some, maybe reading, but speaking and listening require actually speaking and actually listening.
For me, a big part of learning a new word involves creating chunks. Those chunks then form bigger chunks. Let's use 辞書 as an example: 辞 is talking/words (and also used as kanji for quitting) and 書 is books. So word book = dictionary.
The kanjis are also broken down by radicals. 辞 is 舌 (tongue) + 辛 (spicy). There isn't a logical connection between the combination of radicals and the kanji, so I'd make a memorable story instead [1]. Thus the only things I have to purely memorize are the radicals.
I go through above process when I'm creating a card and I believe the process itself helps me learn the word much faster than just rote memorization. Of course, you need to start using the word in your daily life too!
Edit:
[1] When I create a story, I close my eyes and try to imagine the story happening as vividly as possible. I also have a rule where radicals in the story must appear in the same order as in the kanji
Have you looked at something like wanikani.com with the mnemonics or some of the more historical derivations of the different characters? Those might help build an internal story for why those characters mean what they do. As an adult, that helped me.
One way that Save All (a company i run that's like anki, https://saveall.ai/) helps you with encoding is that it suggests alternative ways that we can quiz you on a card you just made. This helps you engage with the card a bit more as you're making it which makes it more sticky.
Other than that a good way to also improve encoding is to link new knowledge to existing knowledge. Things like Roam help you do this with their backlinks
SRS is great for the characters -> definition pathway, but we need so much more. Listening, speaking, interacting, using the language to describe the world around us in conversation and navigate through it.
Don't stop using Anki though.
I think you are understating the difference this "more efficient time" makes. SRS outclasses every other approach we have for long-term memorization by several zeroes.
Bringing your car to the shop when the "check engine" light is on and bringing it into the shop after every single drive is superficially the same, but only one of them makes actual sense...
- You do not truly understand until you "forget" what you've learned.
I know, it's weird and opposite of what Feynman Said. But it makes sense.
You have not truely mastered something until you've forgotten the step-by-step process of it (and presumably had to reconstruct it by doing it and paying attention to how you do so).
(This is also why it can be hard to teach something you're very good at - often, you literally don't know (well, remember) "how to do it" in a form that's actually useful to them.)
I think that generally is a characteristic of something who's mastered something.
It does make sense, but I don't think it's strictly true. You can understand something without making it second nature.
Why is that "good" teaching? ---> Its because if they arrive at the answer themselves then both the answer & the process for figuring it out will be more ingrained in their long-term memory!
> Instead, learning the content rapidly (meanwhile forgetting a lot of the content), getting a whole picture, and gradually gain more understanding repeating the process using different textbooks/courses, is a much more faster way of learning.
I agree to an extent. It's inefficient to try and remember everything beyond a point. But spaced repetition is very efficient e.g. with Save All it might only take you 5 minutes to remember something for 10 years... so it is much more efficient than you think to try and remember more things.
Learning is mostly model building. Building a model to predict future sensory inputs from past sensory inputs. Building a model to predict future sensory inputs from past sensory inputs and control inputs.
Learning is not just recording sensory inputs for future recall, it is taking them and building useful abstractions with them.
Wikipedia is factually correct but often lacks insight. It puts the learner at the wrong level of abstraction, limiting how much more can be learned.
For example, a sine wave looks complex, and has a great deal of inherent complexity around stuff like transcendental functions. But it's just a spiral, the side view of a radius arm turning through time along the x axis with a period of 2 pi radians and a radius of 1.
But if readers don't know that, they get stuck at the abstraction of trigonometry instead of the far deeper relations between things like complex numbers and higher dimensions.
That's why I think it's difficult to learn quantum mechanics without a teacher. It just ends of being a bunch of matrices and handwaving that makes little sense intuitively.
This is why the debate around higher education is silly IMHO. Sure, someone can avoid college and get hands-on experience in application. But they'll miss out on the theory and abstraction that allows them to transcend their area of expertise. That's good enough for most people, but most likely won't result in true mastery. No schooling is not better than schooling if one wants to do important work.
You wrote "learning limits in isolation of the whole picture, optimizing for less percentage of forgetting, often leaves learners confused". The is true. The reason is because, if you do it in isolation, you're not forming connections to related knowledge.
The main split in brains is short-term memory vs long-term memory. And I suspect (speculating here) that forming more connections to items in long-term memory helps in moving a fact from short-term memory to long-term memory.
And alternatively put, there's a difference between learning to read, and learning to speak. Yet both would boil down to primarily rote memorization, as languages tend to do.
Language is not a good example to prove your point on.
So there might be more information you're expected to know in modern jobs -- but if you spend a bit more time consolidating rather than acquiring new information, you can build the foundations on which more advanced skills can rest.
For transparency: I work with the OP
We likely store information more in some type of loose graph structure, where we recall / "remember" something by re-creating links to that piece of information. There seems to be very very little "storage cost" for the billions of pieces of information we keep in our brains.
I would also argue that the time we spend memorizing "facts", of questionable utility, takes away from the time that could be spent on learning better methodologies for thinking.
- https://www.patreon.com/posts/71081197
- Literally a related quantum computing / physics example (with Michael Nielsen): https://quantum.country/
The Inner Game of Tennis frames this as a difference between the two selves. Maybe that could be considered through the lens of decreasing the number of things you need to remember in order to improve.
This! learning materials who master this way of information giving based on their importance is key to effective learning, and I think a lot of them don't give importance to it.
How do you trust your memory when (as I understand it), every time you recall something your brain changes in ways that can affect recall later?
Is there a distinction between learning and knowing? For example, in my undergrad days I learned about Simpson's rule for numerical integration. I jammed enough of it into my memory to pass the test and quickly forgot all the details. Now, 30+ years later, I needed to calculate the volume of a pretty complex space. I remembered the existence of Simpson's rule but absolutely nothing else about it. Looking it up on Wikipedia I was able to re-learn it well enough to apply it in my job and move on to the next problem.
If, over the past 30 years, I had been using flash cards to remember the details of Simpson's Rule, I would have wasted a lot of time. Re-learning it when needed also means I don't have to rely on my faulty, dynamic memory. For me, it seems like there's a sweet spot to remembering enough to know the concept and then relying on the internet to fill in the details as needed.
Yeah that phenomenon is called "proactive & retroactive interference".
> For me, it seems like there's a sweet spot to remembering enough to know the concept and then relying on the internet to fill in the details as needed.
I think i agree with you to an extent. For example, there is no point memorising all the digits of pie so that you can use it when programming, it's much more efficient to just remember what pie is at a vaguer higher level than to put the energy into memorising all its digits.
But i would say that most people go too far the other way and only remember less than the efficient amount.
These strong connections are why when you go back and look at it, you recognise it and you know how to apply it - because you still have some of the residual memories from this strong encoding. But in the meantime, you probably haven't been able to apply it in an analogy for example.
Secondly - there's a classic on the topic of Spaced Repetition written by Gwern.[0] Gwern calculated that, given the average amount of time you spend testing yourself on something, and the exponential increase in how long you remember it, if you would spend more than 5 minutes per 10 years looking something up, you should use spaced repetition to remember it.
For transparency I work with OP on Save All.
I'd vote for the ability to perform a skilful epistemic analysis of the retrieved information being more useful. I prefer this because it can overcome any natural immutable shortcomings in the underlying process.
When I study something, I go for awhile, but eventually it becomes difficult, confusing, hard to see the forest for the trees. Particularly with technical information and skills like programming (or natural) languages.
When I come back a little bit later, I find that I only remember the things that made sense; my confusions are forgotten, and there is fresh mental space and energy to master a bit more of the terrain before I need another break.
When I'm studying a foreign language, I learn some words and they stick, but I'm exposed to a bunch more that I don't remember next time. I forget those meanings, but the ones that stuck are now vivid and with me, brighter.
When I'm studying Kubernetes, I end up reading a ton of information that's irrelevant to the task at hand, and lots of it doesn't make that much sense because I'm new to it. The next day, when I come back, the things that I actually understood remain, ready to be the foundation for new learning, which they couldn't have been when they were mere data points in an overwhelmed brain. I don't remember the parts I was confused about yesterday, just this stuff that now makes sense.
If you read a book you might not remember the previous pages, but if you start in the middle you wont understand anything.
The nodes of knowledge might be forgotten, but its ok if you have the graph. The nodes of knowledge that were available to you initially might have been biased. Then you need to unlearn, that is often harder.
Leaving the "working-memory-max=4" hypothesis aside (I'm sure it's all true), the "stack learning" paradigm has been hugely successful for me post-classroom, and (amusingly) specifically with Quantum Mechanics.
About ten years ago, I tried to understand what QM was about, by doing exactly what the article describes, starting at Wikipedia's "Quantum Mechanics" page. I got the exact result described: no understanding of the material.
However, the search eventually led me to ocw.mit.edu, where the same LIFO-based stack learning was super effective. Along the way, a refresher calculus course (also from OCW) got pushed onto then popped from the stack, as did the course "Vibrations and Waves" and the entire Walter Lewin lecture series (he has since been removed from OCW, but can be found on youtube).
This author seems to believe in the Nuremberg funnel and the hydraulic model of learning, but simply with a limited "flow rate" for the brain. It's disappointing to see such as simple-minded idea, which has been so profoundly debunked by huge amounts of research, on the front page of HN.
My read is that the author actually agrees with you. The author points out that all students have a starting non-empty state (long term memory), and the goal of learning is to build on top of that. It's just defining the space of "learnable" things as distance from long term memory. This doesn't seem that controversial?
They even call out all the things you call out as effective:
> Everything we know about learning efficiently is directly related to memory - "good" teachers, "good" explanations, images, diagrams, maths problems, essays, practical assignments all are good for learning because they help move things into your long-term memory.
I suspect the thing upsetting you is the call out to spaced repetition?
I’m saying the reason why applications and exercises are useful are that they lead to a change in your memory. Not that they aren’t useful.
And the way I'd see your "funnel" criticism applying is that each student can easily begin with a different set of mental tools, some of which let them take an idea as one relatively small "chunk" and some of which might process the idea as several "chunks".
For me, this _does_ work and I have proven it many many times over the years by adding entire categories of technical knowledge to my repertoire. And not superficially, either - I get paid very well to do things professionally that I taught myself by reading Wikipedia.
If my experience were commonplace, the "it won't work" statement would be highly contentious in the comments here. Since it isn't, I guess I can deduce that I must be an outlier.
This article focuses on the number of new things overwhelming our working memory, but I'd argue another big problem is the difficulty of leveraging abstractions even if you don't understand them.
In this exercise, both myself and the article get sidetracked in understanding the basis of all the abstractions as well, rather than just letting the abstractions be, with all of their uncertainty. But if I were better at the latter, I could see this approach working.
Perhaps "comfortable with knowing that I don't know things, yet proceeding anyway" is a better description.
The working memory limit explained in the article must apply to you unless you have some sort of a very special form of photographic memory
I've never studied quantum mechanics aside from snippets I picked up through pop science articles or such, so it's not like I started with a big body of knowledge already in place.
It's hard for me to imagine what feeling "lost" in Wikipedia would be like. Maybe reading some article about a complex historical battle would do it - lists of people with important names would probably become a jumble without really clear identifiers of who did what and why.
I'm going to send you a wikipedia page written in chinese. You're going to read it once. For every chinese word you're allowed to look up the meaning on google translate once as you read. You're not allowed to do any other form of learning besides reading.
Do you think in this case you'd also not get "lost"?
In practice I end up reading the same wiki articles dozens of times as I go up and down the link trees, with each pass connecting various ambiguous ideas together.
If I could annotate the pages with arbitrary amounts of translation notes as I read them, I could probably get through the article though it would take a very long time.
Maybe it's more like my working memory can hold more things by aggressively discarding details until I need them - same capacity, but with better lossy compression. Not sure if I could measure that either, but it feels closer.
"The process of simulating actions is the process that changes the structure of your mind"
0. https://www.sciencedirect.com/science/article/pii/S187705092...!
1. https://www.creativemachineslab.com/uploads/6/9/3/4/69340277...
* Childhood development. A child who has had early childhood adverse experiences mind is effected. A fMRI or chemical detection can see physical differences in the brain. But the brain is plastic (it can change) over time. Works on this subject have been published by Dr. Dan Siegel https://drdansiegel.com/books among others. The key insight here is that academic learning is not significantly different at a core aspect then behavioral learning.
* Physical sports/martial arts depend on a reaction time much smaller then what is afforded by going through the full frontal cortex. "muscle-memory" isn't real (it isn't "memory" as you think of it). What you have in these cases are "short-circuits" (this implies structural changes) that are able to act before you are consciously aware of what is going on. The same applies to math facts and other fundamentals, you move things away from memory that needs to be retrieved and into reaction. Reading C-syntax for programmers or signing your name is something that has been turned into structure that doesn't need "memory".
I think your initial premise is correct. We have limited memory. How do we overcome that? We write. Writing is important because with it we can overcome our natural memory limitations. You cannot think about complexities (well or clearly) if you cannot write.
The danger of writing is that you can produce something that is both irrational and nearly impenetrable to the casual reader. For example:
> Foucault's use of the concept is descriptive, that is, analytical and explanatory, and at the same time normative and critical: he describes the grip biopolitics have on individuals through technologies of power in a way that makes manifest the repression at work in these biopolitical processes.
The above, taken directly from an "academic" published journal, could be said to have meaning. Unfortunately, each one of these words has an alternate meaning that is not normative to English, making the entire (actual) meaning opaque. "contecpt" "analytical", "explanatory", "normative", "critical", "biopolitics", "individuals", "technologies", "power", "manifest", "repression", "processes" are all defined differently then a standard English dictionary. So even if you can get past the convoluted sentence structure, the intended meaning will still elude you.
But the answer to memory limitations is clear writing using common definitions of words. I bring this up because as you extend your memory beyond what it innately has, the more likely you are to fool yourself (and others) with sophistry.
Very interesting. Is the theory here that by writing things out on a page we are then able to manipulate the ideas in our head without the usual limits of our working memory? Working memory is still limited but because all the information is so nearby and within view we can quickly put things in and out of our working memory so its limit doesn't impede us as much?
But does it effect the field like programming? When programming, if I can remember the context, then I can easily search it (research paper, books, documentation, forums etc) Now, with Co-Pilot, isn't it effectively beneficial to understand a topic and develop a general problem solving framework for ourselves so that we can let the AI do it's thing?
What are your opinions regarding it?
Specifically you won't be able to solve a programming problem if the answer requires you combining over 4 things you don't have in your long-term memory (even if you can look them up). This is the main reason why Jeff Dean is a better programmer than me even though we both have access to google - he has more knowledge & experience of programming in his memory than me that means that even though we can both look things up he is able to solve way more problems than me.
Co-pilot slightly changes the type of thing that's valuable to remember, but it doesn't change the importance of remembering things. I think, as you implied, co-pilot probably makes remembering some types of syntax or boilerplate less important.
I think what the article misses is that there is a ton of knowledge we can't 'write down' and therefore memorization is not enough. For example learning to solve Integrals. Yes, there are some rules and tricks one can memorize which helps but I would argue the only way to get good at solving integrals is to interact, resp. solve them.
Another point are second order effects of how one learns, for example curiosity and resilience. There might be a long time negative effect on motivation of a topic, when there is too much focus on 'memorization' (It certainly was that for me in my French class;)).
I really enjoyed the 'bad reputation' part and agree that it is sadly viewed as not important enough by many.
Speaking completely personally, forgetting a lot of information is the easiest way to ruin my motivation to learn a topic.
[0] https://link.springer.com/article/10.1007/s10648-022-09677-2
Anyhow, you can learn to have better "interfaces" to your automatic unconscious abilities and leverage them to e.g. remember instantly and durably any mathematical equation, etc.
- - - -
As an aside, the strategy you sketched out at the start of your article would be workable if you have great recall, however an even more better strategy would be to recapitulate the discoveries of physics in roughly historical order. Your understanding of quantum mechanics would be much deeper and richer, and you would be following a story (an epic story made up of so many fascinating smaller stories, and one that is still going on! Albeit things have calmed down this last century or so, but no one thinks we have reached the climax yet.)
That would be the way to do it: start with the Greeks and the Alchemists and proceed to follow the trail(s) of how we as a species sussed out the mysteries of the physical Universe.
For example, in machine learning, there is something called stochastic gradient descent, where to learn you present a single random element at a time from the dataset. In the end it will have learned of all concepts, by becoming more and more confident in each individual concepts.
For example to learn QM, you pick a random QM wikipedia article, and try to push through the article, even though there are some things you don't understand. Then you do the same thing, for a different unrelated QM article.
For learning tennis, you don't learn specifically forehand, then learning backhand, but you alternate them at random so that you have a single unified way of playing with smooth transitions, instead of having to switch between different "modes" of thinking.
Sure more memory can allow some speed-space trade-off in learning ability, but using your memory too much may make you miss some fluency that may have emerged. For example the old-school of machine learning was using databases and K-near neighbors, which used a lot of memory and was slow. But the new-school of machine learning are using constant memory algorithm and compressing the data in it, and it can learn to generate all the pictures in the world with only 4 Gb of weights.
Learning is imagining, once you bootstrap your imagination, its bandwidth to synthesize new examples from which you can learn from, is much greater than the bandwidth of looking up new data material to learn from.
however long-term storage is just one vital factor, another one is the 'deep learning' neurons that understand the content it stores and more important to connect the dots among various neurons.
we need both: understand and store. Neurons do both for us.
My takeaway from this article is that if you only focus on understanding (and so do not commit it to memory), you cannot reason using this information in unfamiliar contexts later on, once you've forgotten it.
So the best thing to do is to: 1. Make sure you understand something thoroughly 2. Test yourself on it using spaced repetition to ensure you keep it forever
For transparency: I'm one of the cofounders of Save All (linked site) alongside Petros the author
I am utterly baffled that no response in this thread so far has taken issue with the statement "As you probably know intuitively, it won't work." For me, this _does_ work and I have proven it many many times over the years by adding entire categories of technical knowledge to my repertoire. And not superficially, either - I get paid very well to do things professionally that I taught myself by reading Wikipedia.
If my experience were commonplace, the "it won't work" statement would be highly contentious in the comments here. Since it isn't, I guess I can deduce that I must be an outlier.
If you want to experience this yourself but you already know the time tables, you could try to memorize log tables and then you can do those fancy arithmetic tricks that old school engineers used to do with slide rulers.
This is taught, at least at German schools. It‘s just that nobody pays attention.
> learning what matters in the world (and therein how to be happy)
This is way too subjective to be part of a curriculum. Trying would border on indoctrination.
Interesting, is the curriculum anywhere online? Curious to take a look.
> This is way too subjective to be part of a curriculum. Trying would border on indoctrination.
I see it as the opposite of indoctrination. Teaching students how to choose their own values (and how happiness is a function of your values) gives them more freedom not less. You wouldn't want to push any specific value framework, but you do want to teach students that it's possible to choose your own adventure, instead of getting indoctrinated by your society's prevailing values. A curriculum such as:
- What are values?
- The connection between happiness and values
- Value traits (e.g. extrinsic vs intrinsic, behavioral vs situational)
- Value prioritization and hierarchies
- Different cultures and their distinct value frameworks
- Practical applications (e.g. learning how to change your values; trying out different values for a day/week)
> Interesting, is the curriculum anywhere online? Curious to take a look.
They are, but in German: https://www.mk.niedersachsen.de/startseite/service/rechts_un...
Also, it’s been a while since I went to school. Not sure what changed in the meantime.
> Teaching students how to choose their own values (and how happiness is a function of your values) gives them more freedom not less. You wouldn't want to push any specific value framework, but you do want to teach students that it's possible to choose your own adventure […]
I fully agree with that. I apparently just misunderstood your original comment.
That sounds like different test too
If you are curious, we'd appreciate candid feedback from you. Just launched pre-beta on Product Hunt today.
https://www.producthunt.com/posts/neble
Thanks
Yes Save All helps with that in a way
The more important thing is the product which is SaveAI which is using AI to make the spaced repetition process much more efficient and effective. I never got into Anki because it seemed to me to be a tedious process to create decks but this new approach with using AI is much more attractive.
But I guess people like to argue/exchange ideas and this post is getting much more traction compared to the Show HN.
The core thesis here "Learning is intertwined with memory" was indeed hashed out by psychologists in the 1970 (Craik and Lockhart); It was precisely these two who put forth the "Levels/depth of processing" idea, which emphasized the importance of the encoding process. A more "meaningful" encoding enhances memory.
The author not so secretly wants to sell us an app for spaced practice. And yes, spaced practice is indeed important and has been well studied in memory research. But I feel that the tool that they are selling is the antithesis of good learning, especially if you want to check "Quantum Mechanics" off of your list. If I got it right, the main difference of their app to Anki or any other flashcard program is that you do not need to spend so much time drafting your questions because an AI can do it for you. But this is precisely where deep encoding would come into play. You need to decide how to phrase that question and write it down! You need to draft that answer! The classic crib sheet phenomenon.
Regarding computerized support for such human "deep learning" I can recommend "concept mapping" tools (VUE from Tufts or ihmc CmapTools). But a pen and paper is great, too.
This article focuses mostly on the second part, about remembering.
You could recall things but you may not fully understand it, which is going to make it harder to learn.
And of course, you might understand something, but eventually you will forget it (either few days or few years, depending on how often you use related memory). When you forget, it makes it hard to learn.
No, learning is not 'storing pieces of information in long-term memory and recalling them'. It's not the ability to recall information. At the very least, learning is information+behavior change+understanding+values and attitudes associated with the information. It's much more complex than memorization and recall.
To add to this, I've known many folks that can accomplish certain tasks almost automatically and creatively. If you asked them to recall exactly what they did to achieve it they couldn't. And this usually isn't action on concrete information either but on intuition alone.
If humans worked primarily on memory we'd have been toast a long time ago. There's too much variation in the natural world to confront it solely on the basis of memory. I'd say we're more experientially oriented as opposed to memory oriented
I wonder, if learning is remembering, then what is "understanding"??
from my own viewpoint, learning is about something external; for example "what's the word for such and such concept?" ..in english or in spanish?
point being that you need a corpus of consensus about what the specific linguistic-culture calls the learned concept.
but then, what does it mean to understand?
I think the way towards making sense of this (answering it) needs to consider learning of physical (do-able) actions. Because when considering such skills as learned/understood, the distinction between learn/understand seems to vanish.
So then maybe understanding has more to do with having learned something to a proficiency level that allows one to teach (show/explain) to another how to do that action?
finally, to throw a proverbial wrench into my own attempts to make sense, what does it mean to perceive something complicated, such as the meaning out of arbitrary alphabetic glyphs? how is the meaning out of a text understood? what did we have to learn to be able to do it? is it just a matter of knowing most of the contents of a dictionary??
If I tell you a sequence of numbers: 1,2,4,8,16,32,64,128
And you try to remember them, having never seen these numbers before, you have to remember each individually and it will not be so easy.
But if you, before trying to remember them, apply a little computing power to figure out that its a sequence of powers of two, starting from 2^0 going up to 2^7, then you have compressed the information I gave you. You understood (presumely) the source of the information and you will be able to remember the numbers much easier.
One strategy I see people applying to unknown data they want to remember is to try to establish links to already known information or made up stories. For example when given the sequence of numbers above but not knowing about exponentials some people would try the follwing:
* 1: the first number is one (as on the number line)
* 2: the second number is two (same)
* 4: I have four friends
* 8: I ate lunch with my friends
* 16: my sister was also there, she is 16 years old
* 32: the house number of the restaurant was 32
* 64: we ate sushi, my dad also likes sushi, he is 64 years old
* 128: one-two-eight sounds a bit like "want to eat" and yeah I also like to eat
By doing so some people seem to achieve quit good memory of an unknown topic. But from my point of view they are only re-encoding the information to sort it into already existing bins in their memory instead of compressing it. The amount of information is not reduced but increased and it seems harder to reconstruct the original encoding/information. Additional without compressing the numbers to their generating algorithm it is not possible to use the "learned" knowledge for anything but reciting.This all leads to Solomonoff's theory of inductive inference.
– Jordan B. Peterson
I like to think that Spaced Repetition learning pre-empts these errors, so we are apt to recall when we productively need that memory.
Learning basic QM is 90% complex differential equations and 10% physical intuition.
There is a reason why you generally don't get to introductory quantum mechanics until second year after (or while) you're doing calculus, differential equations and linear algebra.
To quote a lecture I once saw: the deepest point of any state is a mine shaft somewhere. You don't find that shaft by gradient descent.
It doesn't matter how much of the wiki page you remember, without understanding a few key pieces you're wasting your time.
There are different learning styles. I find memorization very difficult (poor passive recall), yet my comprehension is superior (aiding deduction.)
I find many with “photographic memory” to be sadly inadequate at comprehending and exploiting interrelationships.
There is something like dexterity which develops in the mind, an impression left which is not exactly remembering, yet definitely stored in the brain.
So, the [learner's paradox](https://fs.blog/the-learning-paradox/) is that students do things that are easy and gratifying but have no lasting impact. Baseball players practicing batting should be practicing a random mix of pitch types but vastly prefer 'massed practice' sessions. I.e. 20 fastballs then 20 curveballs then 20 changeups or whatever. Yes, you can do very well on that 20th pitch, and perfecting it will be gratifying, but you come in tomorrow closer to pitch 1 than the person who mixed it up does.
It's worth pointing out that "Photographic memory" isn't durable (typically), and may in some ways impair a person -- like a guitarist who's so good at listening and replicating a song they never bothered to learn sheet music, they may end up using short term memory as a crutch and commit fewer things to long term memory in a way that impairs them in later life, especially versus someone who had studied other similar networks of concept in the past.
I’m not speaking of trends, I’m speaking of the architecture of our minds.
There are definitely differences in how various minds work, and these inconclusive pseudoscience studies making wild assertions are as junk science as the junk science they feed upon.
Yes, but we still all learn in roughly the same way. The differences aren't big enough.
I am fully in agreement with the conclusions drawn in the article, but the bad news is that even with those techniques it can be a slog. Any Anki user will tell you that maintaining dedication and avoiding burn-out is your Achilles' heel, not the limits of your human ability. Understanding something for the first time (in the Feynman technique sense of being able to explain it well), and doing that multiple times per day, takes up a lot of mental energy even if you are smart and naturally talented.
In conjunction with using memory techniques, we need to add dietary practices where we become much more selective with the information we take in. Places like HN give the illusion of learning (and to a great extent help broaden your mind about certain topics), but the actually utility of all that random knowledge butts up against the opportunity cost. There are already many more worthwhile pursuits than can be fit into your lifespan.
So it's all about remembering, but what differs is how someone approaches it depending on their level and understanding of the topic they are trying to learn.
I'm trying to look at the problem with a wider lens, however. For example, if learning that language is actually something we want to do in opposition to all the things you could be doing. In the context of public education, since this is the theme the author focuses on, we don't just study certain topics, we study a certain spin on some topics that is determined by a range of government officials.
In other words, you have to deal with severely limited energy and interest compared to all that is available in life so cutting chaff is probably even more important than boosting your ability to remember. In fact, selecting what to learn is life, just like a sculptor removes the parts of the marble that aren't in the end result.
It's not just some simple "move from short term memory -> long term memory" to make more room. If it was, we would all optimize for that outcome. People would have written books about learning that glorified this concept. Teachers would be teaching it in schools to have students score better on tests.
Learning is much more a lifelong mindset akin to the famous Socrates quote of "I know that I know nothing". Or even the idea that we change through the books we read / things we learn, but don't remember much of what we did.
So I don't agree it is all about remembering because like GI Joe said, knowing is half the battle.
https://www.techlearning.com/news/busting-the-myth-of-learni...
> People would have written books about learning that glorified this concept.
There are lots of books on it actually. Make It Stick is my favourite book on this, you should try it!
You have a preference of how you learn, no? It's not a myth if there's perennial truth to it.
> There are lots of books on it actually. Make It Stick is my favourite book on this, you should try it!
I've read many titles including this one. Not everything is going to be "learned" with spaced repetition, interweaving, retrieval, and varied practice. These are great modern methods to learn effectively for the short-term, but are not by any means concepts you're going continue practicing past your formal education. (i.e. Anki flashcards for everything you want to learn)
I might have an emotional preference but there's no good evidence that different people learn better in very different ways
It also poses wildly different challenges, where the metrics by which one is to judge the "degree of having attained knowledge" in the broader sense of the word, depends entirely on which of those aspects one value.
Some literature refers to this dichotomy as "instrumental" or "relational" understanding. You see this very clearly in math, where students can recall the facts of equations, but they don't understand it.
It can very well be that the author of this article is aware and appreciates this distinction. But, the phrase and title of "learning is remembering" will certainly evoke suspicion. Just because it is much easier to remember something one understand, does not mean that by remembering, one understands.
For some reason we then give them degrees and call them educated if they remember all those things they don't understand in an exam.
My advice. Organize yourself. Use as much cognitive offloading as possible. Keep a diary, a document, wiki or whatever. Use calendars, reminders, alarms, Kanban boards and on. Make sure to understand concepts and how things really work. Practice how to spot what is important. Take your time on important things. Learn the tools. Use the tools. Learn how to pick the right tools.
Specifically, someone with ADHD (a topic close to my heart), the size of working memory is typically around 3 items. Related, long term memory is also a bit more chaotic for those with ADHD; when you can only have three linked concepts at a time in working memory, it's going to be encoded with fewer overall links data.
That all is to say, if you're building a tool to help people remember things, don't just build it with the median in mind.
Also I wanted it to stand alone as an essay to see what people thought. If i linked to the product within the article it would turn the whole article into an advert rather than an essay
And obviousness is relative; I did not even notice the logo and base domain, read the title and scanned the text for core concepts, spaced repetition again is only mentioned once, even though in my opinion it’s literally both the topic and your solution to the issue; which was not obvious until I read your comments. Think if you were to ask random people who are not aware of the company, what the post is about — then define spaced repetition and the reasoning behind the company’s name, then ask people again what the post is about — answers would be noticeably different; you could even hide the context and ask if concept of “save all” was mentioned on the page and what it means.
>> Well, new technologies (Save All link) leveraging techniques like spaced repetition mean it's much easier to remember what you learn so its time to rethink that. You don't have to forget what you learn anymore.
Might be wrong, but at the point topic is covered and a single solution is presented, it becomes the topic.
https://senrigan.io/blog/chasing-10x-leveraging-a-poor-memor...
https://web.archive.org/web/20220926125538/https://saveall.a...
https://en.wikipedia.org/wiki/Forgetting_curve
See plot with spaced repetition halfway down.
Funny coincidence to the article, it was at the beginning of a lecture about quantum mechanics.
I wish it were a paid product that I can download my cards from.
I don't want to be in a position where I put in lot of effort to input my cards and then you shut it down.
If the founder is here, do you plan to make this a paid service? If so, when? and will you provide the ability to export my cards? If this is not going to be a paid service do you plan to Open Source it?
But I think it glosses over the most important detail; long-term memory comprises many distinct sub-systems. "Remembering" is typically (IME) associated with explicit/conscious long-term memory processes, but I think the most important thing for learning complex domains like Quantum Mechanics is implicit memory, specifically procedural memory.
https://en.wikipedia.org/wiki/Long-term_memory#Implicit_memo...
In order to understand higher-level concepts like the Schrodinger Equation, one must first thoroughly understand lower-level concepts, starting with mathematical theories like calculus, and physics models of energy. It's not possible to simply fill out an Anki card for these lower-level concepts and memorize the wikipedia page; one must practice performing those mathematical operations until they are unconscious like riding a bike.
This is recursive; one can't understand higher-still domains like Quantum Chromodynamics or Quantum Chemistry until one has worked with the Schrodinger Equation (and other QM formulations) enough that it's deeply lodged in your procedural memory.
This is why it takes ten years to train a physicist (and even then one could argue that physicist is at the beginning of their journey); one must spend undergraduate years working out a bunch of problems by hand, gradually layering new concepts on top of old ones. It's not like pushing a software engineer though a dev boot camp, where a dev can produce something that is simple but useful after a few months. There is no way of usefully abstracting away the lower levels of complexity in Physics.
The other side of that observation is useful too; software bootcamps are possible because we successfully abstracted away a lot of complexity. Good abstractions (even when leaky) can be immensely valuable. Imagine having to do a PhD to have enough expertise to build a web application? I think this achievement is perhaps under-rated, particularly in this community that takes joy in peeling back the layers.
I suppose the other observation I'd make is, don't overuse Anki; it's good for memorizing facts, but not necessarily helpful for procedural memory. You still need to practice doing the thing in order to master complex domains. (I'm open to the argument that having facts memorized might make the procedural acquisition faster, but I'm not certain that it's more effective than just spending the memorization time on focused procedural learning practice instead.)