Ofsted inspectors 'make up evidence' about a school's performance when IT fails
theguardian.com
theguardian.com
You might be far removed from the implications of doing a poor job but that doesn’t mean everyone else is.
The fact that software is involved is in some ways a side issue - and while I do agree we as techies do need to consider the responsibility that we have, I'm equally frustrated how the narrative in the Post Office case has been deliberately shifted towards "it was because the software had bugs" as opposed to "multiple people in charge were deliberately deceitful and behaved completely reprehensibly".
This is borne out by the UK government's attempted shift of all the responsibility on to Fujitsu in the Post Office case (who are absolutely not blameless) while trying to push attention away from the Post Office's - and by extension the government's - own considerable culpability.
I'm sure they'll seek to do the same in this Ofsted situation.
https://www.telegraph.co.uk/politics/2024/01/26/sir-geoff-mu...
The whole thing was a shambles and there was no scrutiny from the start.
I do agree with you that Ofsted will likely use the same deflection tactics.
It is a failure of all of the humans involved. Whether it is inadequate acceptance testing, prematurely closed bug reports, optimizing for [unreasonable] timelines, or lack of oversight (and to be clear, I am not advocating for micromanagement).
I feel both of these statements are true: 1) certain people bear more fault than others and 2) developers aren't blameless.
I would like us to reduce our "blame surface area" with a reasonable amount of effort over what we _can_ control.
Firstly, in UK law there is an implicit assumption that computers are "reliable". This means that the burden of proof is on the accused proving the software has bugs, rather than them being presumed innocent until proven guilty.
That means in the Post Office example, people were convicted because they couldn't prove the software had bugs, they were just saying "you have to prove I'm guilty, because I'm not", and the court said "no, we don't, computers are reliable and that proves you are lying and therefore guilty".
In the Ofsted case, given that schools can be put into special measures, teachers and headteachers fired, and in one case a headteacher killed herself because of the data collected and decision made on it, if those systems are not reliable they are not fit for purpose, because it turns the innocent into victims in terms of criminal, and civil employment law.
There have been calls for this assumption to be changed [1], but right now: if you are innocent but a piece of software says you are guilty, in the UK the burden of proof falls to you, regardless of how awful the people, their processes and conduct are on the other side.
Secondly, there's a deeper moral issue here. Engineers are arguably aiding and abetting. It is almost certainly the case that engineers working on Horizon and Ofsted systems did not tell all the truth all the time at the bequest of their managers and other colleagues throughout all this.
"Just doing my job", is the excuse of the scoundrel. I do not buy it. If you're complicit with despicable people, you're complicit. End of.
Yes, UK HMG has answers to give, culpability and responsibility, but let's not pretend that engineers built terrible systems, didn't have to face any consequences, and were enabled by arse covering exercises further up the chain.
We can - and must - do better than this.
[1] https://www.theguardian.com/uk-news/2024/jan/12/update-law-o...
Not sure this is true, people were mainly convicted because they pleaded guilty to avoid going to jail.
There may be instances where you are correct but I'm not aware of any? The general rule of being innocent unless proven guilty does, generally, hold. The issue with these cases is that many people convicted early on had no proper legal representation.
Alan Bates, for instance, refused to accept the charges and was never convicted because no evidence of his guilt was ever presented. He stood his ground and was an outlier case.
I'm also annoyed at how the Guardian is parroting the "made up" term, which is a terrible misrepresentation of "relying on your memory of the events".
Speaking of decision-helping tools, there has been a French law for some years now : for any administrative use of them, the target citizen can request the algorithm to be explained to them in clear language.
(I already have my popcorn ready for the inevitable clash with the fiscal inspection, which not only tends to operate as if laws didn't apply to them, but also I hear started using neural networks, which have basically no way to conform to this requirement.)
There's a world of difference between human fallibility, and knowingly doing evil as part of one's job. I won't call the bricklayer evil if someone builds a 10-story skyscraper [1] atop his humble garden shed foundation, that ends up collapsing and killing everyone inside.
[1] To make the analogy perfectly clear - the skyscraper is not the software, but the persecution based on assuming the software is infallible.
This really is an incredibly stupid law. I could see assuming that computers are correctly operating as _instructed_ (e.g. the cpu doesn’t have bugs), but assuming that software is implemented correctly is just crazy. Everyone knows that software is buggy and updates are released all the time. Declaring that software is infallible is ridiculous.
The first store had been the first to get a new model register. And the new model tended to slurp bills out of the till if you closed it too hard.
So this isn't a new software thing. It's a problem with a management culture that shifts blame rather than get to the root of the problem.
If they'd been like "oh, a bug. We'll fix it" then there would be no issue.
just cause you're an ant here doesn't make you ethically culpable.
this is bad practice by service integrators
Also what does software have to do with that case?
Are you suggesting this is a binary decision, where the only options is choosing "more oversight" or "less oversight"?
Oversight is not a knob that you turn up or down. I speak as someone with experience in this field when I say that education like a lot of other things is complex enough that “overnight”, especially with output suitable for public consumption, is far from trivial to deliver.
Again, I don’t think that you’re arguing in good faith.
The fundamental goal is not to punish teachers and headmasters/headmistreses. The goal is to ensure good quality and safe education for the students.
If the school is inadequate or even close to it that should never be a surprise to the people working in it. The expectations should have been clear enough that anyone can self-asses themselves. There should be no big surprises during the inspection. That is neither “less” nor “more” oversight, but more predictable oversight.
Furthermore the headteacher was in her position for 13 years. If the problems found were indeed so outrageous to rate the whole school inadequate then shouldn’t she have been inspected earlier and more often? During those 13 years multiple cohorts of students entered the school, studied and then graduated from it. The oversight report alleges during the whole time they attended a school with serious safeguarding issues. Isn’t that really bad? How did the oversight system let that happen? This is in fact asking for not less oversight but for more frequent one.
On the other hand the school managed to turn around in a few short months and become rated “good” from “inadequate”. It is alleged the problems actually were not deep and they were rectified within weeks after the inspection. There were some discrepancies with record keeping and a few protocols needed tightening up. The common understanding is that Ruth would have lost her job when the “inadequate” inspection report is published. Is that the best way to achieve our goal of high quality and safe education system? Wouldn’t it be better if the oversight system gave them an advance warning and time to improve? Absolutely no feedback for 13 years and then suddenly feedback with the most severe consequences is not a way to ensure good outcomes.
Presumably this feels even more unfair if the computer eats the inspectors' homework.
Here's what it's saying, literally:
> An Ofsted inspection "contributed" to the death of head teacher Ruth Perry, an inquest has ruled.
> The inspection "lacked fairness, respect and sensitivity" and was at times "rude and intimidating", senior coroner Heidi Connor said.
> Mrs Perry, 53, took her own life in January while waiting for an Ofsted report to be published.
Seems entirely uncontroversial for them to review their practices and nowhere in there is it saying that teachers need less oversight.
They absolutely do. In fact they're going on strike in the UK over intolerable working conditions, and while the MSM report this as ostensibly about "pay" the deeper reason is that they are micro-managed to hell.
Yes yes!
They are crying out for this too. I was involved in an international conference a few weeks ago on attachment theory and education and all the UK and US teachers said that they want more training to become more self-sufficient in IT. They want more autonomy over elements of the curriculum that use tech.
They are also uncomfortable with using Big-Tech products in schools and concerned for the children over privacy.
Unfortunately I can't post the video b/c rights/confidentiality but if I am ever able I will do so.
I mean we all get OKRs, objectives etc but government employees are a special case.
Yes, by teachers and their unions. Parents generally like it and choose schools based on its ratings which are generally credible.
For instance, in the case of that headteacher, I personally know that her school was one of the most highly regarded, with the best results, in town. The headteacher even acted as a consultant to other schools and had been at that school for about 15 years.
Then one day, and one day only, Ofsted comes and decrees that the school is OK but that the "leadership" is poor, with tragic consequences. The outpouring of support from parents was huge and anger towards Ofsted very real.
Edit: to make it more clear, parents may seem to like this ofsted thing at a point when they don't have any other source and they don't know better.
Do carry on putting your politics over your children's future.
Not sure what you mean by politics.
If I were a parent, I would assume Ofsted scores to be useless. Why? Because I know teachers and what they experience about the Ofsted process, which is Kafkaesque and officious.
It is much easier to look at the exam results, visit the school, ask people in an area what the kids are like at the bus stop —- are they well-behaved or are they scary? —- and ask young adults who recently left school what the teachers are like.
But assuming the kids were nice, yet the school was rated "inadequate" - you would choose that over a school rated "outstanding"? I can tell you're not a parent.
Yes. I know of a school locally to me that is rated inadequate that the parents adore, that I would choose over the next nearest independent day school which turns out weird aloof little Stepford children.
As for the snarky intentional bullshit misreading: “recently left school” in the UK means “completed school” as well, as in “recently left school for university” or “recently left school for college”. Engage your brain when I am talking about young adults and it should be clear I was talking about school leavers. They are the right people to ask if a school is good or not, because they are the ones most recently impacted by its actual performance.
By the way, well done for being able to tell I am not a parent. Perhaps you deduced that from the opening sentence where I said “I am not a parent”? That was a tricky one, so clever you :-)
Holy shit, how did THAT happen ?!?
I really wonder what was in that handbook...
Because OFSTED have been hounding critics, compiling blacklists, sabotaging careers and attempting to have conference speakers critical of them deplatformed.
I'll have a dig and see if I can come back with some reference on that.
best I can find for now [0]
EDIT: added link
[0] https://www.theguardian.com/education/2023/sep/30/revealed-u...
Suicide among young people over grades and exams isn't exactly rare[1], but only when a teacher collapses under that same pressure we need to have a talk? About grading the adults?
What a strange world we live in.
[1] https://www.theguardian.com/society/2017/jul/13/suicides-by-...
I wanted to see if they are in any way related to Fujitsu; so I visited their "website". But it's not a proper website; instead, it's a demo page for their gee-whizz designers. The navigation is at best excentric. For no good reason, they've replaced the mouse cursor with a blob and a caret. They've tinkered with the scrollbars. There's no About page, which might have told me who owns them, or who their partners are. It's pure puff, an information-free zone.
If I wanted a useable, practical solution, I'd run a mile from the designers of that website.
Also
> Creative Disruptors.
Really?
[0] https://www.ncbi.nlm.nih.gov/core/lw/2.0/html/tileshop_pmc/t...
I think the point is that if the inspector only finds out by chance that the notes were not committed then they might have to make it up from memory in a day or week, it just isn't reliable.
Why not double account, why not have a separate (software?) dictaphone and write notes? If one is lost, there's the other.
With Google Docs/Office 365 the last time I lost a full document is years ago now.
I am old enough to have stored my laptop in the fridge when writing my PhD thesis, to keep the fault rate down. However, that is when hard drives where still mechanical, and online backups not a common thing.
Until the government gets better at overseeing such large projects, this will keep on happening. However, as governments not spending their own money, but tax payers money instead, there is little incentive.
The reality is that data leakage, incorrect access, etc. are all much more likely with a bespoke in-house product than with google docs, even if they haven’t bothered getting the cert needed.
For that reason I think these bespoke solutions are not going anywhere for the foreseeable.
In regards to the Post Office scandal, that same ballsup could happen in any cloud.
There is also might be functionality that is not part of Google Docs in terms of metadata on notes, who information is searchable etc.
Let me dig out those comments said software bug is OK something like that.
For example the Post Office, both them and Fujitsu knew the bug for 20 years, they did not request it to be fixed, and in court denied the software could have any problem, while prosecuting people and closing branches. Looks more like a feature than a bug
* Collect together a bunch of metrics of each school. Eg. student test scores, parent satisfaction scores, number of police callouts to the school, number of leaks in the school roof. Also include metrics that aren't obviously good/bad: Number of acres of playgrounds, average tenure of staff, etc.
* Gather data of the success of past students, 30-50 years on. For example, employment rate, total earnings, percentage convicted, percentage in good health.
* Build a model to predict success metrics from the school metrics.
* To rate a school, go collect the school metrics, then run through the model to predict future success metrics. That is your rating.
Sure, such an approach has the correlation/causation problem. But this is self-correcting if schools try to optimize their scores as the models are rebuilt each year.
Thats the benefit of this scheme - it isn't statistically sound, but all the statistical shortcomings eliminate themselves as people try to exploit them.
Which is effective. If you’re a parent trying to decide which schools you want your kids in, maps of where the money is and maps of school rankings are damn near interchangeable (mostly not for funding-related reasons, though). You could use either and come to similar conclusions.