Ask HN: Anyone working in traditional ML/stats research instead of LLMs? | Hacker News Reader

Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

21 pointsitsmekali32111 comments

I am curious about those who are working in the machine learning or statistics domain but are focusing on traditional ML research rather than large language models (LLMs).

What specific areas or projects are you currently working on?

Thank You!

View on HN

I work on alternative data in the hedge fund industry. We're not quants -- we don't try to predict the stock market... instead, we try to forecast how individual companies are performing using aggregated clickstream, point-of-sale, and payments data. It's a data cleaning, timeseries, and modeling problem with a lot of domain knowledge necessary.

LLMs can be helpful (Ie. for example, entity resolution for data cleaning) but the core models you have to use to actually make the predictions (this looks a lot more like "old" tabular data approaches).

If i may ask, who are your clients? The investors or the companies themselves?

This seems like a fun(i mean enjoyable) domain.

Also, again, if i may ask, what is your field of study? Is it related to finance or statistics?

I work on differentially private query answering and synthetic data generation for tabular data. This is an active area with some cool advances in the last few years.

Here's a nice summary of some of these ideas: https://differentialprivacy.org/synth-data-1/.

Statistical modelling is largely unrelated to machine learning in its ideology. If you're a professional Statistician then you're most likely working as part of some function heavily utilising randomised experiment design, or less frequently, observational designs. This would include hard sciences, actuarial sciences, finance (risk), manufacturing, poll/census research.

The main commercial opensource language for serious Statisticians is R. You can Google for the sorts of jobs requiring R as a marker, if you're interested in applications of Statistics unrelated to LLMs.

To answer your own question about classical ML, you can Google for jobs requiring the specific classical ML technologies in which you are interested as a marker.

There’s still a lot of active research in traditional ML areas that LLMs haven’t solved. Causal inference, robustness to distribution shifts, and adversarial resilience remain open challenges. Continual and online learning, where models adapt without forgetting, are crucial for real-world deployment. Multi-modal learning beyond text, especially fusing vision, time series, and structured data, is another tough frontier. Interpretability, especially in high-stakes domains, still requires far more than attention maps. LLMs are impressive, but they haven’t made most of classical ML research obsolete.

I work on machine learning applied to sensor data, for understanding physical phenomena. Both time-series models etc for condition monitoring of technical machinery (specifically HVAC in buildings) at https://soundsensing.no And also running ML inference directly on microcontroller-based sensors, via the open-source project emlearn - https://github.com/emlearn/emlearn

This is such a cool project!

I'm building a tool to make ml on tabular data (forecasting, imputation, etc) easier and more accessible. The goal is to go from zero to a basic working model in minutes, even if the initial model is not perfect, and then iteratively improve the model step by step, while continuously evaluating each step with metrics and comparisons to the previous model. So it's less ml foundation research, and more trying to package it in a user friendly way with a nice workflow, but if that's interesting feel free to reach out (email in profile).

I'm trying to create an AI that would be able to repair some subset of physical machinery... It's like code but 3d and with things breaking.

Yes, (ergodic.ai) working on causal inference applied to process mining and event logs. Basically: something happened, why did it happen and how can I avoid it/get more of it?

Check out quant trading.

Reply on news.ycombinator.com