Hacker News Reader

This isn't for tabular data though? Time series transformers have been around for a few years now, see Transformers in Time Series: A Survey https://arxiv.org/abs/2202.07125 and Are Transformers Effective for Time Series Forecasting? https://arxiv.org/abs/2205.13504

Yea, and from this paper it looks like the tree model (Catboost supervised) is still beating their (zero-shot) performance and they don't show their supervised version yet, but they write at the end that they plan to do it in a future work. Will be interesting to see.

Catboost and XGBoost do not need to be replaced