Big Ideas That Don't Work in Education
npr.org
npr.org
She (and the locals) are very negative about South Korea, but very positive about Poland and Finland. And she points out that all three countries use a fraction of the budget that the US does on education, with much better results.
She also points to the fact that outside of the United States, extracurricular activities -- not to mention sports -- are not a part of the school curriculum. If you want to play basketball, then that's great, but don't expect your high school to care about it, because their job is to worry about your education, not sports.
I have a PhD in learning sciences (roughly "technology and education"), live in Israel, and have three children. And the way that the schools here run depresses me more each year. As the book points out, and as we probably already know, the forces in charge of schools (e.g., politicians, teacher unions, and taxpayers) are basically aligned against any real reform. Gimmicks such as technology look great, but are virtually useless -- a form of "education theater," as it were.
Israelis talk nonstop about class sizes, but I think that a much bigger problem is that we pay our teachers nothing, and give them no respect or power -- and are then surprised that the quality of teachers has declined precipitously.
From everything I can tell, we would do well to give teachers massive salary increases, then make it hard to become a teacher and easy to fire bad ones. Then give the teachers huge freedom to do what they want. And yes, this will cost money (which the taxpayers don't want to hear), but on balance it seems to work for most people, most of the time.
https://en.wikipedia.org/wiki/Education_in_Israel#Educationa...
A far bigger problem is indeed the "ultra-Orthodox," or "haredi," school system, in Israel, which is exempt from the core curriculum, or any real oversight by the education ministry. This is a tragedy -- one could say, of biblical proportions. These children are purposely getting an education that will not allow them to get a good job when they grow up. Many young Israelis who go through bad school systems get a second chance at a good job when they join the army, at the age of 18, and learn some practical skills -- but haredi children don't join the army, either.
Meaning that at the age of 18, they get married and start to have (large) families, basically guaranteeing that their families will be poor. And their children then go to such schools, which repeats the cycle.
It's tragic for the students, and tragic for the country. And the fact that the country allows this to happen is ridiculous, in my opinion. But it also reflects the sad fact that haredi (ultra-Orthodox) political parties are often needed to make a coalition in our parliament (the Knesset). Allowing such schools to exist, by removing regulations and giving them additional money, is one of the first demands that the haredi parties make to join the coalition.
I know that this will change at some point, because it must. But for now, it boggles my mind and boils my blood.
It may not be that expensive, if class sizes are not that important you can have fewer teachers. The problem (in the US) is that the teacher's unions are generally against performance based pay, teacher evaluations and firing bad teachers.
For good reason: who gets to make those decisions? Parents? Imagine being a biology or history teacher in the deep South. Children? We already have data that the most effective teachers are liked least. Administration? Are those older teachers really poor are they just expensive? Are those "merit" bonuses going to the best teacher or to the one who volunteered to coach the basketball team?
The last time a teacher evaluation got implemented in Pennsylvania, they dropped it in a hurry because too many teachers couldn't pass it and they were going to have to pay WAY more to import teachers who could.
As has been pointed out previously, firing a genuinely bad teacher is generally straightforward and the procedure is well-documented. However, the administration doesn't want to put in the time or paperwork to do it. And, maybe, just maybe, that administration that's whining about firing and the overbearing paperwork really doesn't have a case and simply wants rid of the teacher for political reasons.
Right now, in both the US and Israel (and perhaps other countries), we're in an extreme and untenable situation, in which bad teachers cannot be fired. In the elementary school that my children attended (and that my son still attends), bad teachers were sent off to teach computers. Or science. And so forth. You can imagine what this tells the children, the parents, and the teachers about how much we value these subjects.
There was a New Yorker story a few years ago that described how bad teachers couldn't be fired... and thus were sent to a building every day, where they checked in and did literally nothing all day. Yes, they received their full salary and benefits in exchange for doing literally nothing.
I'm guessing that a reasonable alternative is to have some sort of weighted system, in which the principal's evaluation, parents' complaints, and student performance all count toward whether a teacher can be fired. The biggest thing should probably be the principal's evaluation, but perhaps if a teacher gets fired, they can get another job, in a different school -- but perhaps the parents' evaluations and the students' performance can be used to determine how many other schools they can go to before being kicked out of the system entirely.
> The last time a teacher evaluation got implemented in Pennsylvania, they dropped it in a hurry because > too many teachers couldn't pass it and they were going to have to pay WAY more to import teachers who > could.
This is perhaps the most important point: Good teachers need to be paid well. They need incentive to become teachers, and to remain teachers. Which means that people will have to pay a fair amount in order to get a good education. In the US, this will mean taxes have to go up, which is a recipe for political suicide. In Israel, this means taking money away from other things in the education ministry (since we already pay, per capita, more for schooling than most European countries).
I think the easiest first step is to spend more on teachers within the current budgets.
I think you underestimate the ability of students & parents to judge teaching ability separately from likability. The users of a product are best suited to know what works & what doesn't.
At my high school we had a mix of good & bad, as you'd expect. Everyone knew which teachers knew their subject, could communicate well, was more dedicated etc. Some of the most engaging teachers were the least liked because they graded harder, but if you had a rubric that included "grades fairly", "not boring" etc, students would be able to correctly assess them.
Of course some would be dishonest, but noise will cancel itself out, by and large.
You significantly overestimate the goodwill of everybody involved.
I had a butch, lesbian English teacher. Most of the community had "issues". Students hated her because she was a ferocious grader. Without tenure, she would have been gone.
However, her results were amazing. If you took her AP English class and got a B or above, you were getting a 5 on the AP exam.
So, what counts? Community? Administration? Parents? Students? How do you square the fact that everybody wanted her gone, but her results were stellar?
She was extremely effective. Her students knew English and English Literature very well after her class. They tended to win writing awards as well as stomp the AP test flat. However, very few students and parents liked her (oddly, I did, but my father was an English teacher so I had already been brainwashed that English wasn't easy and to rewrite, rewrite, rewrite), and, consequently, neither did the administration as they had to deal with complaints.
She's clearly a domain expert and way more competent at teaching English than anybody judging her. Why do you think that the community at large has any competence to judge her as a teacher? Of course, many of her students were were much happier with her once they hit college and found that composition was easy, but, unfortunately, very few of them ever came back to the area.
The high-tech equivalent is allowing an HR person on your engineering interview loop (never do this, by the way). Since they can't judge them on engineering, they will wind up rejecting candidates based upon their handshake, their clothes, or a hundred other things completely irrelevant to being an engineer.
The Finish model seems to be the best. Introduce this competitive element not on the job but on the way to the job. Pay for a teacher's education, right up to a required Masters degree, and attract ambitious bright young minds to the profession. Combine that with paid time in which teachers must consult with each other regarding in need individuals so as to handle disturbances and distractions from learning as best as possible. Toss in a breakfast program while you're at it and lets light up some young minds!
For example, they shut down teacher's colleges, and mandated a university degree for all teachers. This took political guts, but it has paid off.
Two things stuck out to me in this article.
Firstly, Hattie says "Holding students back a grade really does hold students back, with an effect of -0.16." What does this actually mean? Does this mean that at graduation, these students perform 1/6 of a standard deviation below their peers? I'd be more interested if we were also presented with the alternative: how do students who didn't meet whatever minimal standards for grade advancement but were advanced anyway (and thus could have been held back a year, but were not) perform? As an early college math instructor, I'm very familiar with students who are incapable of performing mathematical operations from classes which they've previously passed.
The more I think about it, the more I wonder about what it means to perform at some number of standard deviations above or below others. Is this based on standardized test performance?
The second thing I wonder is related. As an alternative to the common policy of "Achievement Standards", he suggests "The alternative: a focus on growth and progress for each student, no matter where he or she starts." How might one implement this?
For instance, suppose Albert and Beth are entering basic 6th grade math. Beth performs really well and for whatever reason Albert is very distracted and learns almost nothing. The next year rolls around, and Albert and Beth are entering basic 7th grade math. The teacher cannot teach them the exact same, as Albert doesn't understand prerequisite ideas. Is the teacher to instruct normally and then devote additional time to Albert, trying to incrementally increase his understanding? Does Hattie actually advocate Montessori-style schools with self-paced work? Perhaps schools should have a lowest-tier math class which is entirely based on individual students instead of central instruction? Or in this case, should Albert have been kept back a year?
In many other ways, I like and/or understand Hattie's approach and ideas.
From [retention]:
That is, the groups of non-promoted/retained students
scored .15 to .26 standard deviation units lower than
the promoted comparison groups on the various outcome
measures.
So it does sound like the comparison was between two groups of students that didn't meet standards.This does make me wonder how large the opposite effect is... I had the chance as a kid to take higher level math classes at my school, but was so intimidated by the thought of not being with my peers (since Kindergarten.. small school) that I refused.
[retention]: http://intranet.niacc.edu/pres_copy(1)/ILC/The_Retention_Deb...
One alternative I heard of is called "flipped classrooms". Instead of a teacher delivering a lecture and then the students doing homework at home, the students learn the material at home (via video or textbook) and then do their homework in school, where they can have the teacher give personalized instruction and help.
At a college level it's kinda like Oxford and Cambridge's tutor system.
As an observer of my children's learning in the local public high school (I have mostly been a homeschooler, but my second son and third son have recently been enrolled in the local high school), I see that "formative assessment" (testing learners on material they are only beginning to learn does indeed seem to be a very helpful way to prompt learners to learn more. I expect to do a lot of formative assessment for the new students I will have the week after next at a school where I am about to begin classroom teaching of middle school mathematics during the regular school day.
I have read another book by Hattie, co-authored with Richard Fletcher, called Intelligence and Intelligence Testing, which is also quite good. Those of you who find this article intriguing and would like to learn more about ideas that work in education are likely to enjoy reading the longer linked paper by John Hattie, "What Doesn't Work in Education: The Politics of Distraction,"[1] which provides more details on the ideas he thinks work and what other ideas don't work and why.
Just curious, but why the change? (if not due to Life)
Am I missing something? This PDF was very long on political rhetoric and short on actual concrete advice to improve things.
I wouldn't suggest it for grade school, but at least for high school, why not? No grade levels, you have 3 quarters (and use quarters, semesters are just a cost saving measure) per regular year, 4 years.
(FWIW, a quarter of math in a community college is roughly a year in high school.)
Tell students that they have 3 quarters of math to complete at minimum in 4 years. If they fail one quarter, there is lots of time to take it again. Why have the idea of grade levels at all?
Remove 80% of responsibility from teachers for passing or failing, remove all standardized tests, and let's go to a model that we know works.
Edit: To clarify, I am not suggesting we import the ivy league "Make half the students drop out through stress" system. I am proposing a quarterly system of learning where students are free to take the level of course work that is most appropriate to their needs.
For what reasons though?
I am advocating a more community college model, smaller introductory class sizes, with a faster paced, but shorter term curriculums, that don't hurt as much if any one particular course is failed. A more targeted model than "grade level".
Traditional universities have a high attrition rate not just due to course work, there is a huge cultural shift, a complete loss of one's traditional support network, a lack of structure that used to be imposed by parents, and many new opportunities for distraction.
I'm not proposing we add any of that to high school! :)
I'm all for doing what works. What data tend to show that college education works better than secondary education or primary education? (For a demonstration of having received a college education, what data tend to show THE OPPOSITE, which all thinking people have to consider when deciding what policies to support?) I note that you say that your model might not work for grade school. If so, is there something else we can do at the margins to improve primary education by a little or by a lot?
One thing we have done that is completely backwards is mainstreaming class rooms, for both special needs and gifted students.
I remember when I was in 1st grade, students who read a little bit slower where in a different reading group from students who read at normal speed versus students who read above expectation.
Students would get pulled out per curriculum type to different classes.
This continued in middle school, where there were 4 levels of math class (remedial, normal, and two levels of advanced), 2 levels of English and 2 levels of history. (The special needs program was separate, and I am not sure how remedial English or History worked)
This type of system works, but it is more costly and harder to manage if we treat it as a "one off".
Only at the upper tiers of elite universities.
Most large universities also have their intro courses taught in huge lecture halls with 100+ students. Yeah that system fails, so don't do it.
But take the good parts. Small focused targeted quarterly classes that students can retake if they fail.
Having classes that last an entire school year (or even half a school year) is overkill.
I also like that with the quarter system in college, students typically take three 5-credit classes. That is 3 hours of instructional time per day, which at a good pace in class, is about the max an average person can learn.
With 6 hours of class instructional time, teachers have to "burn" some of that time so students don't burn out. I could not imagine sitting through 6 hours of college lectures per day, it'd be insane, because every minute spent in class is productive.
Compare that to High School, where students spend a LOT of time on busy work, or watching films, or reading entire chapters of a book out loud.
Want a recipe for success? Make a class schedule that is the equivalent of 15 college credits per quarter. 3 hours of lecture per day, intersperse lectures with dedicated study time, let students immediately apply what they just learned to solve problems.
Students will get to learn more per class, and have better adherence to homework policies.
This varies by university and department.
In theory you should always have a performance curve if you have a large enough sample size.
This does not mean that 1 standard deviation away has to fail.
It does mean that some students will do better than others. You can set performance targets however you want, if we desire to create an education system that supports students so that -2σ can still perform at a competent level, well you have a system that supports 97.6% of students. (Although I'd actually say that performance target is somewhat unrealistic for a country in which only a mid 80% of students currently graduate high school.)
Universities don't have the resources, time, or motivation, to educate 97% of the population, so they are going to put policies in place such as "more than -1σ and you fail out".
There is no need to employ that en-masse to all education!
So the NPR piece is based on a publication from Pearson, who has a huge financial stake in the US education market.
http://www.politico.com/story/2015/02/pearson-education-1150...
How curious.
If the publication is based on data and the method is open, the source doesn't really matter.
I'm going to assume they have an agenda and keep an eye out for it, but Pearson is not inherently anti-education.
Challenging is an understatement. I suggested that once, and my what blowback I got!
I have no doubt that students would have preferred that professor, but their skills and knowledge would suffer from that choice. Taking the easy road will catch up to you eventually.
At the time, I hated it, until I realized come the final that I'd never been permitted to slack off and so needed to do much less to get myself ready for it.
She's fairly short and she's had some terrible disrespect from students in the past. She had a student who preceded to lecture her on how to set a midterm because they had taught swimming lessons (after they had got their midterm back and done poorly). She's even had death threats from students who were upset with her. None of this would have happened with my PhD supervisor who was about 6'5" and intimidated almost every student.
Not every student chooses the easy road. Some of them want to learn the stuff and not waste their time. At Caltech, some of the toughest classes were the most popular.
I know a math professor who reminds me of your physics prof. He gets the best ratings on ratemyprof, his classes always fill up, and he has the highest average grades in his department. He retired at the end of last semester after only 35 years. The college's administrators loved him as much as the students, even though the students were probably worse at any kind of math after taking his course(s).
Even so, there are lots of reasonable and workable methods of allocating scarce resources.
> Because it pushes people towards making choices based on internal details vs outcomes?
I don't see how it pushes anyone. Parents would make choices based on what is important to them.
We already know that this kind of thing doesn't work from universities. Put a known poor professor into a required class and all the students will simply skip that class that semester and flood the one the next semester and cause your scheduling to be completely screwed up.
I knew a university that once had to answer to an accreditation board for this. Not fun.
Because there is hardly any topic more intricately entangled with politics and emotions.
I think more granularity of data in that statistic would be useful; is this money actually being spent on the child or is it instead being squandered within a bureaucratic structure? Or does some externality that is a cost in one model but not the other left out of view?
The challenging task isn't coming up with solutions that will help, but finding solutions that will both help and not violate certain taboos.
Never in all of history has society ever benefited from lying to itself.
Stop with the Orwellian political correctness and teach kids the level they are capable of. End of story.
Not really. Most of the solutions to contemporary social problems are quite politically correct.
Universal healthcare. Decent minimum wages. Birth control. Sex education. Ending the drug war. Ending the criminalization of victimless crimes.
We have the data on many of these things. We know what works. However, it is politically unpalatable to a significant subsection of the country.
See the recent kerfuffle over thre Colorado teenage pregnancy reduction program (http://rhrealitycheck.org/article/2015/04/30/colorado-republ...)
When a significant chunk of your people are willing to ignore the facts and reject something known to work, it's hard to make progress.
ah, hide the hard one at the end :)
Income equality isn't "hard" if you look at it logically versus emotionally. Raise taxes, ensure a proper social safety net, widen the middle class.
Then again, this is America. We try everything else first before the right way (apologies to Churchill).
Income equality is hard when you start tracing where the income actually comes from. Furthermore, the parent said "broken homes," not merely income inequality. A poor household can still be a stable and positive environment.
And I suppose that trying to impose uniform policies on a not-culturally-uniform group doesn't help either, especially when you add in hypersensitivity and the polarization that comes from everyone not knowing everyone else.
Both select for teachers of above average intelligence but the way those teachers are taught is very different.
The kids in poor broken homes thing is something Finland is having more of, due to recent not-so-sensible immigration. There's very little one can do about it without draconian measures -- handing out money doesn't help.
I do agree with you though, there's things that can be learned from these countries with respect to things like demanding more of teachers (master's degrees) and rewarding teachers more (not just decent, but great salaries which involves seeing teachers like you see doctors). That makes a lot of sense. Our requirements and rewards for doctors are a lot higher, despite the fact every single child is raised and educated for half of every working day's waking hours for more than a decade, teachers have absolutely insane levels of influence on something many of us value to extreme levels (children), in Finland resources are allocated accordingly, in the US not always. So I agree there, but I still think differences between e.g. Finland and the US have much more to do with your last point: making sure kids aren't in poor broken homes, which isn't a direct educational policy theme and requires mostly deep socioeconomic policy changes outside of education.
There's a definition of some of the terms here: http://visible-learning.org/glossary/
Also, circumstances are different everywhere, so you can't just solve everything with an easy answer.