How long have you been running it live, and how far back does your backtest data run? How closely are you seeing real returns match backtest? After running live for over 2 years, I've seen up to 6 month periods where the model outperformed the backtest, but overall the models have underperformed to varying degrees as expected. Though I have spent hundreds of hours dedicated to removing noise and overfit bias, I've come to the conclusion it isn't possible to 100% remove it, which combined with expected market regime changes where legitimate patterns become unprofitable means that in the long run every model is essentially guaranteed to underperform its backtest, the question becomes simply to what degree. However, with a strong enough model, even underperforming the backtest can lead to substantial alpha which is what I and our members have experienced so far this year.