9,735 karma · joined January 17, 2011
Co-Founder at Empirical Health (https://empirical.health). Don't die of heart disease.
Before: Co-Founder @ Cardiogram (ML for heart health)
CTO at Sift Science (YC S11, machine learning to fight fraud)
Data Science @ UCSF Cardiology
HealthCare.gov rescue team
Google (Android speech recognition, search ads ML)
twitter.com/bballingerbrandonb.cc
If you're looking to learn about JEPA, LeCun's vision document "A Path Towards Autonomous Machine Intelligence" is long but sketches out a very comprehensive vision of AI research: https://openreview.net/pdf?id=BZ5a1r-kVsf
Training JEPA models within reach, even for startups. For example, we're a 3-person startup who trained a health timeseries JEPA. There are JEPA models for computer vision and (even) for LLMs.
You don't need a $1B seed round to do interesting things here. We need more interesting, orthogonal ideas in AI. So I think it's good we're going to have a heavyweight lab in Europe alongside the US and China.
Not only does fiber reduce cardiovascular mortality by 26% (by cutting cholesterol), surprisingly enough, fiber even reduces your risk of cancer by 22%: https://www.empirical.health/blog/dietary-fiber-reduces-all-...
(Oatmeal is high in fiber, among other things, which I think is part of what's going on here.)
A YC company, Athelas, started by developing an at-home blood test analyzer (they've since pivoted).
The most surprising thing I learned that coconut milk is a lot less healthy than I would have guessed (high in lauric acid).
I had always heard that dark chocolate was heart healthy, in spite of being high in saturated fat. In addition to the effect of antioxidants, the stearic acid in dark chocolate quickly converted by your liver into oleic acid (a monounsaturated fat).
* ARPA-H ADVOCATE: autonomous AI cardiologist.
* CMS ACCESS: pays for outcomes, not visits, with reimbursement set that you have to use AI to scale.
* FDA TEMPO: lets AI devices deploy before full clearance
* Utah: AI can prescribe medication (refills at first).
I've been working on AI in medicine for 10 years. I'm honestly surprised at how fast the regulations are evolving.
> HDHP status was associated with worse OS (hazard ratio [HR], 1.46; 95% CI, 1.19-1.79) and CSS (HR, 1.34; 95% CI, 1.01-1.77) among cancer survivors.
"OS" is overall survival and "CSS" is cancer-specific survival.
Right now, the title and preview text on mobile probably look like "Quick scheduling question" / "Hi [name], I've followed [company] for...". This looks like a lot of other emails in my inbox that are requesting a meeting time. So I think a lot of people who quickly scan their inbox would pass this by and not even open the full email.
I'd also drop the "re: " part unless it's genuinely a reply. It breaks trust.
In retrospect, this result was the first step toward the LLMs that are now the dominant approach in AI.
In 2017, this was a very modest result and probably didn't seem very promising. It took real courage and tenacity on OpenAI's part to keep at it for the next 5 years.
One advantage is that this type of safety guardrail can't be undone by an adversary in post-training, so it's a good fit for open source models.
The experiments are all done in preventing models from acquiring medical capabilities, while preserving related capabilities like e.g., biology.
IMO that’s part of what’s interesting about this study design — they tested vitamin D blood levels and adjusted the supplement dose based on that. This seems like a much better approach than taking a high dose blindly.
I think the headline is accurate. The 52% number is from the experiment arm (participants who received a vitamin D supplement, with the quantity guided by blood testing). While it’s technically possible for the supplement dosage to be calculated as zero, 85% of participants were deficient at baseline, so this isn’t the main effect.
The study was presented at the AHA scientific sessions; full manuscript isn't out yet. It's in the caveats section in the article.
I've been working in heart health in 10 years and I was surprised at the magnitude of the effect here.
I hope it holds up as they move toward the final publication. Vitamin D supplementation is cheap and this could have a huge benefit.
Behind the scenes, it's using a pretty cool algorithm that combines deep learning with physiological ODEs: https://www.empirical.health/blog/how-apple-watch-cardio-fit...
The basic idea was to adapt JEPA (Yann LeCun's Joint-Embedding Predictive Architecture) to multivariate time series, in order to learn a latent space of human health from purely unlabeled data. Then, we tested the model using supervised fine tuning and evaluation on on a bunch of downstream tasks, such as predicting a diagnosis of hypertension (~87% accuracy). In theory, this model could be also aligned to the latent space of an LLM--similar to how CLIP aligns a vision model to an LLM.
IMO, this shows that accuracy in consumer health will require specialized models alongside standard LLMs.