How a British Covid-19 vaccine went from pole position to troubled start
reuters.com
reuters.com
It has been! But if my lab experience was any guide, it's not necessarily a good light sensor. Spectrophotometry is great for getting coarse accuracy results out of. True precision... that is, and will remain, difficult.
You not only describe how you measured your drug concentration, but you also test the limits. And those limits should go beyond anything you might encounter in actual manufacturing.
If your aim is to confirm a concentration of 5mg/mL, then you test all the way down to 0mg/mL and then 50mg and 500mg/mL. Then if you have a saline mixture, you test different concentrations of NaCl.
You’re basically trying to break the analysis to show where it doesn’t work.
The fact they did a UV vis and didn’t account for a different emulsifier is a big miss.
"Some experts say the dosing discrepancy raises doubts about the robustness of the study’s findings. And they worry about another acknowledged peculiarity of the study: The half-dose regimen wasn’t tested on anyone over 55 - the group considered at high risk from COVID-19."
Until SOMEONE ELSE completes trials on that missing age 55+ cohort, this vaccine should be accepted ONLY for ages 0 to 54. And given its likely low efficacy (62%), NOT for anyone with co-morbidities.
We are not doing a half initial dose because that hasn't been studied in detail.
43% of the patients going into ICUs in the UK[1] are under 60 years old.
Most of the patients going into ICUs (including the older people) needed no assistance in their day to day lives before going into ICU.
60% efficiency which has been peer reviewed, is still as good as the flu vaccine, it can be stored in a normal fridge so will work better for distribution outside of major cities, and costs significantly less.
There are very few downsides, apart from not generating American news.
The independent regulator was aware at every stage and recommended they continue with trying the half dose trial. [1](https://www.bbc.co.uk/news/health-55308216).
By my understanding, the quoted figure is what percentage of infection occurred in the control group.
60% efficacy is not going to get you to herd immunity, nor even any kind of immunity for the majority of people taking the vaccine.
Does this give more than a couple of weeks grace on lockdown, if the critical limiting factor is ICU beds?
You are more likely to get symptoms with the Oxford vaccine than an mRNA one, but no more likely to die or need hospital care
https://www.thetimes.co.uk/article/covid-vaccine-boost-for-m...
I believe Moderna is currently conducting a new trial to ascertain the transmission question. Until we know for sure, all the talk about herd immunity may be moot.
There is a proper study into this happening now, to see if the improved numbers are a real thing, or just a demonstration of the demographic.
I am absolutely not an expert on this. Just paraphrasing something I read.
i do agree oxford and astrazeneca have not handled this well. it seems quite clearly an error based on a volume of documentation but leadership at both institutions appear to be insisting it was not, which degrades trust at a time when many members of the public do not trust health officials to tell them which way is up.
It's atleast 60% effective with no hospitalizations for the remaining 40% and it's scalable due to requiring refrigerator level storage.
The only concern is 2 adverse events of spinal inflammation and 1 of brain inflammation out of around 20,000 tests.
Maybe another problem is that it won't provide absurd profits to big pharma companies.
Is it simply safe to assume nearly equal "average exposure" over say 90 days randomly, or are all participants encouraged to follow identical lifestyles.
Now that the UK have already over 500k doses of the other vaccine administered we will see new data on the effectiveness and safety of the vaccine (in comparison to CoVid-19, don't forget that!).
Blinding and placebo control helps prevent behavior modification from the intervention itself, but it's possible that people who receive the saline placebos behave differently, since they don't get any side effects. I believe AstraZeneca's trial in the US uses a saline placebo, presumably because an active placebo might accidentally also work against the virus.
Equally anecdotally, I know of several friends who have caught it from young children in school settings or crowded groups.
By the way in the UK at any rate if you donate blood they check it for covid antibodies for free.
I guess there’s no way for them to be certain. But I’ve been wondering if we’ve been too quick to believe that kids are less susceptible to Covid or the virus that causes it.
Imagine that children do contract it as regularly as adults, but are usually asymptomatic. No symptoms = no suspicion = no reason for them to be tested.
Kids not being tested regularly could be the reason why we believe “they don’t get it”. I fear we’ve come to an unsound and dangerous conclusion on this. And I think it’s partly due to the way we confounded the variables when we shut schools in spring. Closed schools probably helped keep kid cases down at first. And from there we leaped to “kids don’t get it”.
Meanwhile, the CDC has published more data on that shows kids do transmit. But their updates seem to have a hard time breaking through the noise. https://www.cdc.gov/mmwr/volumes/69/wr/mm6939e2.htm
Same with their update last week to acknowledge that Covid is mainly airborne. How many are now aware of this? Checking air ventilation? Or still focused on surface wipedowns? https://twitter.com/first10em/status/1341121947682418691?s=2...
I think the ChAdOx study wasn't quite as large. Someone know ?
> In the larger cohort who got the two regular doses, vaccine efficacy was 62% (with a 95% confidence interval of 41% to 75%). There were 27 cases in the 4440 treatment patients, compared to 71 cases out of 4455 patients in the controls. Meanwhile, in the half-dose-first group, efficacy comes out at 90% (with a 95% confidence interval of 67% to 97%). Both of those 95% CIs are a bit of a spread. In this group, 3 out of 1367 patients in the treatment group came down with coronavirus, compared to 30 out of 1374 in the controls. That control-group infection rate is definitely higher than what was seen in the two-full-dose group, which makes you wonder if it’s running randomly high (which would make the half-dose group look better than it really is) or if the larger full-dose group was running randomly low (which would make it look worse than it really is, but remember, with its larger sample size there’s correspondingly somewhat less room to believe that it was that far out of whack). We need to add in to these calculations the news that the half-dose group included no patients older than 55, and to wonder what effect that had on the numbers, too. The paper reports a combined overall efficacy of 70.45 (95% CI between 54.8% and 80.6%), but how much you trust that one comes down to how different you think these two groups are.
[0]https://blogs.sciencemag.org/pipeline/archives/2020/12/09/th...
I’m struggling to understand that. It can’t be random, with so many people in each treatment. So why are their treatment arms unbalanced? And how do they control for that in the analysis?
Would you rather have something that works at best at 75% or something that works at 67%?
Are there any risks in giving a smaller dose to the older cohorts (besides maybe smaller efficiency?)
A rational person would see two conflicting measurements and then stop to figure out why they are different, and then re-run measurements to verify the results until they know why they're different and which one is wrong.
These guys just said "We'll just trust the results from OUR measurements over THEIR measurements", which is the height of arrogance and stupidity. These kinds of mistakes can have dire consequences because you're no longer testing based on how the vaccine will be used in the real world once approved. To say "Well, it worked out in the end so no harm" is also incredibly arrogant and foolish.
In what setting have you _ever_ encountered a rational person?
I've met people who were capable of calmly evaluating a situation rationally -- sometimes even under a decent amount of pressure. But in my undergrad at MIT or in my career as a software engineer, I have never met a rational person.
Everyone understands pressure does funny things to people. That’s why, for example, making mistakes is not considered bad when doing scientific research. However, not revealing those mistakes is considered terrible form, in an incentive to encourage open sharing as opposed to secretive misleading.
Sure. Only one family's livelihood depends on the outcome of an interview. That is little weight on one's shoulders compared to stalling the response to a global pandemic.
> You have time to reflect on your observations and you also have sizeable teams to discuss those observations with, including the wider scientific community.
I would be interested to know what actual social dynamics looked like to the participants in this edge case.
> Everyone understands pressure does funny things to people
In theory, yes -- it is "common sense".
In practice, no. Sadly, people generally scoff at "excuses" and look to place blame rather than understand contributing causes.
Once the outcome disparity was noted, it's unimaginable that BOTH blunders would not be revealed: 1) low concentration in the first dose, and 2) exclusion of age 55+ patients.
More troubling is error #2. That degree of mistake is unforgivable. Heads should roll, and that should include the subsequent apologists who blithely dismissed the gravity of their team's carelessness.
The regulator was aware at every step and recommended Oxford should continue the study with the half dose.
> The Italian manufacturers used a different technique to Oxford to check the concentration of the vaccine - effectively how many viral particles are floating in each dose. When the Oxford scientists used their method, it appeared that the Italian vaccine was double strength. What to do? Calls were made to the medical regulators. It was agreed that volunteers should be given a half measure of the vaccine, on the basis that it was likely to equate to something more like a regular dose. This was partly a safety issue - they preferred to give them too little rather than too much.
> But after a week, the scientists became aware that something unusual was going on. The volunteers were getting none of the usual side-effects - such as sore arms or fever. About 1,300 volunteers had only received a half-dose of the vaccine, rather than a full one. The independent regulators said the trial should continue and that the half-dose group could remain in the study.
https://www.bbc.co.uk/news/health-55308216
The amount of speculation in this thread is appalling.
In this case there are two things that absorb at the same wavelength, the vaccine and the polysorbate. The proper reference measurement would be all components except the vaccine, which you then compare to the full vaccine. It reads a bit like the used water or another buffer as blank here, which is really inexcusable.
You must really feel for AZ at this point, and wonder how much they want to partner with academic scientists at such a critical stage.
Considering this looks like the most promising vaccine candidate for large-scale global rollout and has by far the most orders, I'm sure they are still happy they are working with the world-class Oxford vaccine team.
You wouldn't believe how many software engineers with years and years of experience make amateur mistakes during interviews.
Pressure does weird things to people's performance.
One group mixed the vaccine, and the other tested. The first group added a filler that throws off the UV measurement. They didn’t tell the second group about the additive because they didn’t realize the second group would use UV to measure the concentration.
Neither group could have avoided the problem without access to information they did not have. Both groups under-communicated. This sort of screwup is by far the leading cause of software bugs (most bugs occur at the interfaces between teams).
- a mistake was made on standardising measurements, but a decision was made that erred on the side of caution (diluting the batch that may have had too high a dose). I can appreciate these decisions being decided based on balancing what is needed to measure efficacy vs. the number of additional people who die due to delaying the trials. In hindsight it was wrong and something apparently simple was overlooked but the decision process seemed to have integrity and be based on what was known at the time.
- The accidentally modified dosing trial was just tested on younger people but the improvement was the same even if you only compare it against the same age range on the original dosage. This dosage I guess needs more data which will probably be forthcoming. However the original dose efficacy of ~60% is still useful given the affordability and practicalities of distribution.
- the validity of the pooling of the data was approved with the regulator well before anyone knew how it would affect results
- However a key thing looks to be that the reduced dosing increased the vaccine’s efficacy on Asymptomatic cases from ~4% to 60% - But at this stage more data is needed because to give a confident picture. This is big news as this is the only vaccine so far with an indication of efficacy against asymptomatic.
Please correct if I’m wrong in the above?
The paper in the lancet: https://www.thelancet.com/journals/lancet/article/PIIS0140-6...
https://www.theguardian.com/world/2020/dec/11/oxford-covid-v...
Some people, when facing the choice of having a shot at a vaccine sometime in the future and have a reliable vaccine right now, would gladly pay 10x to speed it up.
It's still possible that regulators will decide that 1) a sufficient number and range of ages and co-morbidies have in fact been assessed and that 2) the differential outcomes of the two groups is big enough to show the necessary level of efficacy and safety. But the 90% efficacy group clearly does NOT yet satisfy constraint #1, so until more 55+ year old subjects are added to the 90% efficacy part of the study, I suspect authorization will have to be based only on the 62% efficacy portion of the study.
Approving a vaccine goes way beyond running numbers and in the end a process that's pretty much opaque to us is full of gotchas and thorny details
The Italian manufacturer’s analysis was correct. Oxford’s was wrong. They decided to stick with it and got the regulator to approve it.
The fact that the more sensitive and selective PCR test result was ignored isn’t a good sign.
Someone should have followed up to confirm which test was correct.
Could you explain what 'auto' means in this context? I can't establish whether it's a typo or not.
The naming change is likely due to who is leading the charge. The vaccine was developed at Oxford, so at the first news, there was no AZ involvement. As we move towards approval and production, the vast majority of work is being done by the team at AZ. The resources and experiences for manufacturing and distribution are the reason Oxford partnered with a pharma company.
https://www.nytimes.com/interactive/2020/science/coronavirus...
I fear that the approval and quality control process have been politicized and is prone to errors of both the white and the black swan type.
We do not have a similar level of understanding for the mRNA type. And yet we are pushing it out at a never seen before scale and speed.
It's my understanding that the Pfizer/BioNTech vaccine is the first vaccine that is demonstrably reliable, safe, and able to be mass produced.
Mankind may have a track record with another kind of technology, but until someone is able to come up with a vaccine that is reliable, safe, and able to be mass produced, they will remain in the hypothetical territory.
It's better to have a vaccine in the hand than two in the theoretical textbooks.
“Why would you take a vaccine technology that is new, unproven, maybe quick to manufacture, but expensive to manufacture - and has never been scaled up and has never been shown to protect against anything in humans, and prioritize that in a global emergency?” he asked. “It’s very odd.”
Leaked prices from the EU:
-Oxford/AstraZeneca: €1.78
-Johnson & Johnson: $8.50
-Sanofi/GSK: €7.56
-BioNTech/Pfizer: €12
-CureVac: €10
-Moderna: $18
https://www.businesstoday.in/current/corporate/serum-institu...
Also, it would be interesting to understand the global pricing. Due to market segmentation, there could be inconsistent local pricing among the manufacturers.
USD 0.82 -> €1.00
Oxford/AstraZeneca: €1.78
-Johnson & Johnson: US$8.50 €6.97
-Sanofi/GSK: €7.56
-CureVac: €10
-BioNTech/Pfizer: €12
-Moderna: US$18 €14.76
Not only is there reduced logistical challenge which is easily >$10, but the others are only listed at half the effective price since they have to be given twice 3-4 weeks apart!
(Do you get an 'immunity passport' with only one shot? Which vaccines do countries recognize? The Russian and Chinese ones with NO clinical trial data?)
Once a location has a low local positivity rate, testing and contact tracing are effective again.
This should start occurring naturally once essential workers are vaccinated; then any partial lockdown or additional vaccination should destroy community spread.
I'd also expect it would become expensive to get travel insurance without immunisation.
Given the current data, of course I'd personally prefer of the mRNA vaccines. But that's unlikely to be something I have any agency over. It's either nothing for an indefinite amount of time, or accept whatever they have even if it is one of the less effective options.
You wouldn’t. Poorer people in poorer countries will get the less effective vaccines. Richer people in richer countries will get the better ones. There is a difference therein. But nothing compared to the vaccinated-unvaccinated gulf.
Agreed. But more AZ will go to e.g. Rochester over Manhattan.
I don't see why it would (or at least should!) be any different in America - but aware there are way more corporate interests at play.
When AZ arrives in bulk it will be used in Manhattan's hospitals unless some politics about IPR intrude, which is not impossible but it has nothing to to with real efficacy or scientific reasoning. It's politics and lobbying.
Despite the efficacy being lower the Oxford vaccine is extremely effective, not a single vaccinated recipient was hospitalised once 21 days had passed from the first dose.
As I understand the state of things I'd be more comfortable getting the AZ/oxford vaccine than the Pfizer/BioNTech vaccine because the underlying technology is less novel, and therefore there is less potential for unknown long term side effects (of the unknown unknowns variety).
Currently if I had the choice I'd go for the Pfizer vaccine hands down, given the superior efficacy in testing. (That said, beggars can't be choosers, so I'd take any approved vaccine I could get...)
HIV original vaccine: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2585831/
As relates to Covid: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7571904/
As of currently there is a huge production backlog for Moderna and Pfizer, but not the simpler AZ and Sputnik vector vaccines. Mass vaccinations need to happen last month, not in May to be effective. In May/June when our batches will be ready, the wave would already be over and you would be protected for the next 6 months with almost no risk. The next useful vaccination period would be fall 2021.
With the two simpler vector vaccines you could start now for everybody, as did Russia, Hungary and Argentina weeks ago. Well, with Sputnik not the elderly.
This is completely mysterious, in the opposite direction of every other vaccine candidate, and should we be following normal safeguards, there is zero chance this vaccine would be approved.
It also raises concerns of rushedness/negligence. When you get two conflicting measurements of the dosages, the correct response is to test it a third time, not assume the second is correct. This failure mechanism was the same in Boeing.
Not that we need to be: we already have Pfizer and Moderna, that did their trials properly and showed proper results.
They have already begun testing the half-full dose as another trial, so if that works better than full-full we may see the approval modified down the line.
> we already have Pfizer and Moderna
Unfortunately production constraints are going to mean that it will take a long time for those two vaccines to be produced in enough quantity to vaccinate most of the rich world. The cost for them and temperature requirements mean that they'd be impractical for most countries even in a few years.
We don't know that. As with the Pfizer and Moderna trials, the endpoint was incidence of disease, and only people with disease symptoms were tested. 60% fewer people experienced symptoms in the treatment group than the control group, but some of those may well still have "gotten it." There were very likely asymptomatic infected people in both groups, and we have no idea how many there were, or how the numbers different between groups. For all we know, just as many people in the treatment group were infected as in the control group, they were capable of spreading infection the whole time, and all the vaccine did was suppress their symptoms. (Again: possibly true of any of the vaccine candidates.)
[0]https://jamanetwork.com/journals/jamanetworkopen/fullarticle...
Edit: Nature mentions they did: https://www.nature.com/articles/d41586-020-03504-w
Which dosing regime should be recommended in this case?
https://www.nature.com/articles/d41586-020-03326-w
- Statistical effects, which might decrease the difference as the trial progresses. - A bigger dose causing an over-effective suppression of the carrier adenovirus, suppressing it's ability to make the COVID spike protein, and hence the production of COVID targetting T cells.
There is also a huge flaw in the testing of the Pfizer and Moderna vaccines: they didn't test everyone. Only people with symptoms (whatever that means) were tested (PCR). Whereas with the Oxford AZ vax all participants were tested, so we can actually get an idea of asymptomatic infection.
Wow, do you have a source for this? That's quite a stunning difference and really should put the ~~Pfizer~~ BioNTech and Moderna vaccines in doubt if the aim is herd immunity.
They seem to have preliminary results for asymptomatic testing: 14/14314 asymptomatic individuals were found in the vaccine group v/s 38/14073 in the control group. At least from the preliminary data, the Moderna vaccine nowhere near as effective in stopping asymptomatic infections.
https://theconversation.com/covid-19-vaccine-faq-6-things-to...
You'd have to look at the registered study details for the full protocol. See this BMJ article for references:
BMJ 2020;371:m4058 | doi: 10.1136/bmj.m4058
It doesn't prevent herd immunity if it only prevents the disease (i.e illness) but it makes it very difficult to achieve strong suppression if there is vaccine hesitancy (a polite grab bag term for science denialism, people who watch Fox, loopy muffin brain people, etc) above 20%. Which there will be in many parts of the US and Europe because of years of uncontested bullshit. (Thanks Facebook.)
It's a remarkable f*ck up for a clinical trial. These decisions should have been made with data from gold standard analytical methods.
I'm also pretty convinced if a "mishap" like that came to light about the Russian Sputnik, or one of the Chinese vaccines, then the combative and critical tone would go straight to "How Putin/Xi personally wanted to kill millions of people!" with news outlets all over the planet constantly regurgitating headlines along that line and Hanlon's Razor given zero consideration.
While this article ends on the notion of how this is just some kind of "oddity" and yet somehow at the same time allegedly a universal problem of "reporting having slightly nationalistic tone".
The article is so muddled up, and long-winded, the result of which is that it barely gains any traction in the online sphere, can't a find a single submission about this on Reddit with more than a dozen upvotes. The few there are the top-comments are very ad-hominemy "Good thing journalists never make mistakes!", which is a reminder that stuff like this [0] is a very real thing.
And of course the method itself is suspect, as the main benefit is that it is cheap and quick, not accurate. And then taking the wrongly performed measurement with the worse method over the qPCR by the manufacturer (who likely has much more robust QC than someone in academia) is just insane.
It’s unclear at what level herd immunity will be reached with Covid, more recent estimates are trending towards the 80-90% of the population range. If that’s the case then the AZ vaccine may not be good enough to eradicate the disease, even with full vaccination of the population.
There is an increasing likelihood several vaccines will be used by every country, almost continuously for the next decade.
I’m not saying that AZ’s stocks of vaccine are going to be thrown out by any measure.
There's massive competition in fluvax. We don't all use a single source, never have. Since the days of penicillin there was a standard to measure against for efficacy and you can source it as you see fit.
Also a few weeks shouldn’t change anything. We are talking about a 6-12 months vaccination campaign.
I suspect the 80% number you mention is to eradicate the virus. I think at this stage it is a bit unrealistic. Between poorer countries that will not be able to vaccinate everyone and animals which can carry this disease, I would imagine the virus is here to stay. I think the primary objective is for it to cease to be a major public health issue. That it keeps contaminating people at low intensity in the background shouldn’t be a major concern.
Speculation about this is irresponsible, at the very least. Moreover, we have eradicated exactly one human disease in all of history, and it took a couple hundred years of effort. Eradication is not the goal.
Immunize the most vulnerable people in the population (those over 65 and/or with certain co-morbidities), and the death rate for this virus will be dramatically reduced long before any herd immunity threshold is achieved.
People very definitely have ideas:
https://www.bmj.com/content/371/bmj.m4944 ::
Is the new variant more infectious?
Yes, according to a review of the current evidence by the UK’s New and Emerging Respiratory Virus Threats Advisory Group (NERVTAG). Its 18 December report said that the rate of transmission of the variant, known as B.1.1.7 or VUI 202012/01 (variant under investigation, year 2020, month 12, variant 01), was 71% (95% confidence interval 67% to 75%), higher than for other variants, and that it may also have a higher viral load.1 While previous variants have emerged without clear evidence of having a selective advantage, the report noted, the “emergence and subsequent dominance” of this new variant in a period of relatively high prevalence indicated that it does have a “selective advantage over other variants.”
https://khub.net/documents/135939561/338928724/New+SARS-COV-...
This slide deck puts it in perspective: there’s a specific mutation that is increasing in prevalence in a certain surveillance network, there’s a hypothesis about why it might lead to increased spread, and it requires more investigation. That’s it. Any claim of knowledge about impact on Rt is simply wild exaggeration of the data.
This is a case where if you don’t understand the field, you have no ability to judge the quality of the claim being made. People are irresponsibly reading second-hand sources, and quoting numbers out of context. Other people quote those sources, and before long, the snake is eating its own tail.
I would wager that the author of that BMJ piece never even read the presentation I quoted above (even though it’s the cited source by NERVTAG for the “genetic evidence” claim in the brief whitepaper that the authors do cite).
This stuff is almost 100% speculation.
It is deeply, deeply ironic that other users on this thread are eager to downvote and dismiss me, based on nothing other than their opinions, when I give citations backing up nearly everything I write. Consider their biases.
Even 60% is better than nothing. Add the percentage that already passed the virus and you get a decent % that no longer get sick or transmit. Not a bad thing, for now.
Giving people multiple vaccines using different vectors is common and tend to help in reaching immunity. Tests are currently under way for dual inoculation of the Oxford and Russian vaccines.
A multi-vaccines protocol is unlikely to include any of the RNA based one however. They are just too expensive and too difficult to store. But a combination of the more traditional is likely.
To recap, you need a way to know the vaccine concentration so that you can draw the correct amount from the vial when dosing patients. Oxford was using a technique called UV spectroscopy. Place a sample of liquid in a UV light beam with a source on one end and a detector on the other. The relationship between absorbance and concentration is linear. BUT: you have no idea what's absorbing the light - only that it's happening. If other materials that absorb at the same UV wavelengths are present, you'll think the concentration of what you're measuring was higher than it actually was.
According to the article, Polysorbate 80 (an "emulsifier" used to stabilize the vaccine) and the virus absorb at the same wavelength being used to quantitate the virus.
Someone, somewhere forgot to do take the absorbance of UV light by Polysorbate 80 into account. This led to overestimation of the concentration of virus present in the batch received from the manufacturer by 2x. This 2x too high concentration was then mistakenly used in the study to determine the volume of vaccine to administer to patients. The patents only got half of the dose they should have.
This is a fundamental error that no experienced chemist would ever make. If all of this is correct, I would immediately start thinking about other fundamental errors that may have occurred in the study.