NHS data: Can Sir Tim Berners-Lee fix it?
bbc.co.uk
bbc.co.uk
That's not to downplay Berners-Lee's historical importance or the usefulness of the stuff covered here, just that we sometimes - at least on a popular level - look to big name saviours which probably says more about the journalist's constraints than the value of the contemporary contribution.
We call on the great and the good because they usually have no skin in the game, so they're impartial. They have a reputation to uphold so they'll do the right thing.
It cuts through all the local politics and power that caused the problem.
See Feynman and the solid rocket booster o rings in the 80's.
Unfortunately, some problems are solved much better with heavy compromises ("listening to every stakeholder"), other problems can only be solved well by an uncompromising solution. The meta-problem is telling one from the other ahead of time. I don't know if that's even possible.
Part of me is massively envious of a country being able to field TBL for its NHS. That's kind of like getting Banksy to design your birthday invitation cards because he happens to be your neighbor or something like that. Another part of me suspects that he might get seriously lost in overoptimism for some theoretically appealing but highly impractical idea that yields nothing in the end.
Ironically, both those parts of me claim to be the one that majored in semantic web.
(edit: punctuation for readability)
Sure it sounds good, but aside from his big paradigm shifting invention those many years ago he has attempted to do some paradigm shifting things since then that have fallen short. So I think hesitation may be warranted.
I’d also say in a very real way that for reasons beyond his control, the WWW fell short of what Sir Berners-Lee envisioned, giving him the opportunity to start over and make sure it’s on the right course this time.
Many of them have actually been a lot more successful than you'd think, in many very old departments.
Is Tim Berners-Lee actually an exceptional guy with repeatable wisdom or just a cool guy who happened to stumble upon the idea of the web?
For example my bank doesn't need my exact location coordinates so I will only let them have generalised version to 20 miles accuracy.
An age verification service should only get a yes or no.
The police shouldn't get all details of my medical records, just the basics like if I'm diabetic or allergies.
Give the users control over their data
So OK, various organisations could _opt in_ to be respectful to data, at a cost (to them) of additional complexity of using this thing (technical, dealing with 3rd party data instead of owning it, etc.), not to mention licensing costs to TBL.
This does not at all stop FAANGs from monopolising the web. So what that NHS stores the data on a Solid server if I can only access it through a Google-owned HTTP protocol? Or next thing you know, Facebook only works if you voluntarily sign all your data off to them (which in essence it does now)? So what I can store my e-mails there if e-mail dies in favour of some closed-source Slack-esque invention, that definitely has E2E encryption?
The real issue is that internet is a common utility like railways, water mains or EM spectrum, and yet it can be monopolised by the megacorps with impunity. That some small town can put up its own water well and have a local waterworks - that's nice, but it doesn't really help the 95% of the country held in the grips of a monopoly owning wells, pipes, water storage and customer data.
TBL making a framework for this kind of thing is all well and good, but when iSOFT, Accenture, Fujitsu and their friends all ignore it or try to shoehorn it into their current systems it all falls down.
I know nothing about UK's system.
https://en.wikipedia.org/wiki/NHS_Connecting_for_Health
From this article, looks like CFH project brought in consultants around the same time (mid-2000s) CSC sold us (a tiny startup team) to MedPlus (owned by Quest Diagnostics).
I wouldn't trust CSC any further than I could kick them across a football field. I assume all the big consultants are the same.
Even back then it was clear to me that starting small, evaluating and expanding was the way to go. Get a group of actual medical/tech experts to define a standard, build tools and test them in a single hospital and a few GP surgeries, enhance, repeat, expand.
Trying to get it defined, designed and implemented in one go was madness.
At the moment we have behemoths trying to do the spiderweb vendor lockin thing.
However.
Us savvy capable earnest architects don't have enough gumption and swarminess to work three years to close the typical sales account.
Our sales and marketing people were basically a different breed. Completely disconnected from reality. Utterly oblivious to their own ignorance. But wow they were able to close deals.
It was both disgusting and fascinating to witness up close.
It doesn't ensure its owned by you only controlled with trust in the NHS spine but still it could have been a lot better than it has been if the project had continued.
- Move all documents to a simple doc server like idk Alfresco
- Any any all single read requests to this server are authorized after biometric confirmation of any parties involved, which are then added to the users' "file".
- Any one use of this data that can be construed as malicious carries 4 to 8 years of jail for anyone involved in the chain of custody of the specific bits of misused data.
You don't need superstars on the project, you need the right balance of incentives around mucking with it.
Can't wait to have my own private server hosting all my data that I can set access on.
For example, the request that first responders should see non medical personal info like people's favorite bands is matter of getting people to enter that (hard), storing it in a secure database (hard but solved), and displaying it in a text field (easy).
The example mentions humans entering things like that a person talking about music, not automated gathering. Besides how creepy it would be if first responders randomly worked your personal data into conversations, if you really wanted to do that integrations with existing music platforms would take a moderately skilled team a few weeks to achieve what Solid promises at some point in the far future, if everyone adopts it.
"A few years ago the optometrist who first spotted my serious eye condition told me she was unable to send my latest scan to my doctor because their IT systems were incompatible."
This sounds more like something we'd encounter here in the US. Are incompatibility issues like this so common in the UK?
Why: How does a patient grant access (consent) if they are incapacitated? Like during an ER visit?
More: How does a patient manage that consent for all the other care providers? Can a patient ever retract the consent?
Source: Implemented 5 regional healthcare medical records exchanges in the mid-aughts. My teammates handled the web portal for accessing same data. The "break the glass" edge use case, where care providers bypassed the consent, was ~80% of daily usage. Because that's the reality of healthcare.
Mea culpa: Haven't yet found the tech specs for TBL's Solid. Maybe it does something new. Like translucent data store with centralized key authority. (Something we considered; would be practical at the NHS, where patients have GUIDs.) I reserve the right to change my position.
After skimming, PODs sound a bit like IPFS. Intriguing? I'll have to ponder.
It'll take some effort to work thru some use cases, see how PODs could line up. There's so many different types of care, each with its own gestalt (for lack of better term).
Just from memory: Clinic (visit-based, episodic, aka encounter), on going care (chronic conditions, kidneys, cancer), emergency care, ambulances and EMTs, continuity of care stuff (more like a journal or diary), delegation and consults, ad nauseam. This list is only meant to illustrate that interaction patterns for consent (grants & revoke), access, and life spans are many and varied.
But just know ahead of time that I'm not optimistic that Solid & PODs bring anything new or practical to the table.
Bad takeaway. Solid is basically the principle of, "Hey, don't store my data on your servers. Store it on mine."
Then the whole aspect that IT support/system design was all TUPEd (employee's handed over to private companies on the grounds their pension's etc stayed the same) and you have a core system that is so outsourced that to manage that in a way that looked past the 4-5 years contract window and you can see why things just limp along.
To document and look at what the systems should be and how they are is going to be a struggle with all those different hands and time factor as you get with any system. Also many systems connect to bespoke hardware that will be a limiting factor and how many lovely working fine as tools used that are connected to stand alone windows 3.11 systems and data exported via floppy in 90's excels flavours again is not zero.
To control the NHS data you need firm in-house IT staff at at the DOH and due to the splitting off and outsourcing in the 90's, the problems that was before are now far larger.
This is not only a problem with the NHS but so many government bodies that saw IT development/support outsourced and is a product of that as if your paid for a 4-5 year contract, your not going to plan 20 years ahead, indeed planning for 4-5 years and locking yourself in so you get another 4-5 years is what they will want to be doing, and they do as that is what they are contracted and paid for.
No one person can fix this, as the level of change and work involved as greater than doing a whole setup greenfield style and this is not that, legacy costs and support are huge.
How would I tackle it - for a start, in housing and restructuring the whole IT support/development. Then the data flows and identifying the most addressable/impacting area's and working slowly from there.
But a project upon this scale is not your 5 year plan affair, it would be close to a lifetimes work, and to resolve it all would be a huge chunk out of 10-20 years effort. I'd expect documenting and rationalising the existing systems fully to take best part of 5 years, just to see the path forward. Sure there will be some stand out area's that could be paralleled, but the crux is that the data and systems used by the DOH/NHS are more diverse than anything I've ever experienced, or will and having worked on many migration projects of various scale and fields of work both in and out of government. This is if Sir Time took it on, a lifetime job and one in which most people would not want to commit that long too.
I wish him luck but no one person could ever fix this, it would take many years just to define the problems and until that is done, you can not fix poorly defined problems and that may well become the problem itself.
Thanks for sharing.
I like your metaphor of annealing the data. Wish I'd thought of that.
I naively assumed that because NHS issues GUIDs to patients (aka MRN, PID), their problem space would have been more tractable. For contrast, our systems in North America have the addition requirement of linking patient identifiers across heterogenous systems. Not easy.
Alas, from the wiki article, it looks like NHS also fell victim to the parasites (aka consultants). https://en.wikipedia.org/wiki/NHS_Connecting_for_Health#Crit...
All the time since my own misadventures, I still have no clue how to mitigate the outsourcing grift.
I don't think there's been a successful large scale IT project in the NHS/Government in the last 20 years. The intertia to success will be people and existing legacy system. This is a challenging integration project, so I'm not holding my breath tbh.
Perhaps the real problem is too much "nobody ever got sacked for buying IBM" timidity amongst senior managers...
> It depends on the Pod Provider. From a user point of view, how the data is stored is not as important as how it is accessed and controlled. No matter who the Pod Provider is, in order to be Solid compliant, it has to expose data the same way: as resources in folders. However,the implementors of the standard are free to pick the underlying technologies according to their own purposes and constraints. That is why performance may vary from one Pod Provider to another.
> As any standard, Solid only describes the interaction model the system must be compliant with. The Pod Provider only exposes a REST read-write interface to the clients, to which the storage technology is irrelevant, as it is in most Web-based systems. How this interface binds with the storage is specific to each Pod Provider.
https://solidproject.org/faqs#pod
Solid is just the standard. It's up to others (e.g. inrupt) to build the actual thing.
You can't disagree, at least not in an informed way, because your idea/position on the follow-on effects are based on a misunderstanding of what Solid is.
Asking if "is the data in solid encrypted at rest" is like asking if email is encrypted at rest. It can't be answered, because it's the wrong question. The right question is "Does $PROVIDER keep my data encrypted at rest?"
The comparison with email is apt, because no one in their right mind would design email as it is today without E2E encryption baked into the protocol.
Yes. Exactly.
> That is not what I want as a consumer.
Okay. Don't use it then.
> I want [magic beans].
Good for you. I want Heather Graham as my wife.
More seriously, what you want doesn't exist yet. Not in a useful way at least.
Maybe go build it yourself if it's something you really want.
Or maybe accept the fact that security is not an absolute, it inherently comes with tradeoffs.
Like life, really.
> The comparison with email is apt, because no one in their right mind would design email as it is today without E2E encryption baked into the protocol.
Have you ever worked at a company where they were legally required to do audits or handle large financial transactions?
Cos baked in E2E encryption would make detecting malicious employees (defrauding clients etc) really difficult to do, and prosecuting them nigh on impossible.
Like I said, security comes with tradeoffs.
Golden rule of security: it can't be 100% secure and usable.
The one time pad is a classic case of this golden rule.
A group of us are actually building this ourselves. See https://book.peergos.org or https://github.com/peergos/peergos The key phrase relevant to this discussion is "trust-free servers".
I wasn't.
But I was sarcastic and facetious. There's a difference.
> I'm just trying to understand the limitations of the protocol.
It did not read like that in the slightest.
It read like someone who wants to hit everything that looks like a nail with the end to end encryption hammer.
> A group of us are actually building this ourselves. See https://book.peergos.org or https://github.com/peergos/peergos
Great! All the best with that.
> The key phrase relevant to this discussion is "trust-free servers".
Not with the solid standard it isn't. That's a completely different use case/problem that you're talking about.
Solid is attempting to solve the "all of my data is stored, pretty poorly, by thousands of different companies in hundreds of different ways, and I don't have any control over it" problem.
It's about data ownership, not server trust.
Nothing is ever 100% secure.
Ever.
> Is data in my Pod safe? Is the Pod encrypted while it is stored on a provider’s system?
> It depends on the Pod Provider. Pod providers can be Solid compliant without encrypting the data stored on the Pod providers’ system. If this encryption is important to you, use a Pod provider that does encrypt you data. The Solid standard describes rules for controlling access to the data, but encryption is dependant on the storage system, which is controlled by the Pod Provider.
> Is my data safe when I use a Solid application?
> It depends on the app. Your data is always encrypted in transit from Pod to app and vice versa. You should always be conscious about which apps you are using the terms of those apps. Solid allows you to selectively share data with specific applications.
Solid is just a new standard for data reuse. Who knows, maybe solid v2 will be E2EE.
In the mean time, you can choose a pod provider that fits your crypto needs.