HNHacker News
TopNewBestAskShowJobs

madchops1

208 karma · joined August 19, 2014

submissionscomments
madchops1··on Show HN: Sketching during meetings led me to create this book
It will be back. Hopefully soon.
madchops1··on Ask HN: Anyone making money through algorithmic trading?
I've been experimenting with this a lot. My code is all public still because I haven't made any giant gains or anything. But I have seen some success here and there. I've even got this one bot that learns from its past trades via ML and uses what it has learned to decide wether to make future trades or not. https://github.com/madchops1/Dutchess.ai
madchops1··on Show HN: Use crypto to feed the hungry
Why can't people just donate their money directly. Why do they have to send you crypto so that you can donate their money?
madchops1··on My personal site is a terminal
Thanks!
madchops1··on Machine learning predictions for QM eMini Crude Oil
I apologize. I can do that. I'm going to generate that backtest you described.

Right now I have residual data from the AWS machine learning data that tells me weather there is any structure to the times it does guess wrong. And a value below baseline is a better than 50/50 guess according to what I have learned about how AWS does its ML. Knowing that I use this personally as a supporting indicator to my trade decisions. Since its so new and I really don't want people to think I'm scamming or something. I'm just releasing my results free for now, not trying to be a douche ;)

AWS defines the baseline as follows

Baseline RMSE Amazon ML provides a baseline metric for regression models. It is the RMSE for a hypothetical regression model that would always predict the mean of the target as the answer. For example, if you were predicting the age of a house buyer and the mean age for the observations in your training data was 35, the baseline model would always predict the answer as 35. You would compare your ML model against this baseline to validate if your ML model is better than a ML model that predicts this constant answer.

madchops1··on Machine learning predictions for QM eMini Crude Oil
Also doing random not sequential training and evaluation. The proper way to eval time-series models.
madchops1··on Machine learning predictions for QM eMini Crude Oil
Updated White Paper. Generated more evaluations and back tests. https://s3.amazonaws.com/karlcdn/Dutchess.ai+White+Paper.pdf
madchops1··on Machine learning predictions for QM eMini Crude Oil
I did another back test with a randomly selected 70%/30% training to evaluation ratio for evaluating time-series models. Adding results to whitepaper. The results are still under baseline.
madchops1··on Machine learning predictions for QM eMini Crude Oil
ya it contains the evaluation results of the model and 5 days of result data.
madchops1··on Machine learning predictions for QM eMini Crude Oil
Basically I have a dataset and I train my model with 70% and then evaluate its guesses against the remaining 30%. Hence a baseline is created and I can see if my model performs better.

It took some doing to get this model to perform well. I did this by adding features that help recognize patterns in the time series data.

The features I created are not specific to QM as they are technical (eg. numbers, not news), and time-series related. So the models should work with any historical dataset with the same fields.

My goal is to add another future at some point.

madchops1··on Machine learning predictions for QM eMini Crude Oil
Thats also what the evaluation of an ML model is for.
madchops1··on Machine learning predictions for QM eMini Crude Oil
Thats true. I'm going to keep going.
madchops1··on Machine learning predictions for QM eMini Crude Oil
I am not trading purely on these numbers. They are indicators they help me make my trading decisions and I think they may help others too.

My models evaluations are performing better than baseline when trained with 70% of the data and evaluated against the remaining 30% so I take that as value. As someone else put it a potentially "favorable guess". At this point I'm using the predictions regularly. And I guess I'll know more the longer I keep track of daily results.

madchops1··on Machine learning predictions for QM eMini Crude Oil
I experimented with the features until I got good results in my evaluations. If I am getting favorable guesses, how does that point to bad features. Favorable guesses is what I was going for in order to assist in trading decisions.

I use a 70/30 split of training/eval

madchops1··on Machine learning predictions for QM eMini Crude Oil
I am doing my training/evaluation with a data split of 70/30. Doesn't that qualify as a proper backtest?
madchops1··on Machine learning predictions for QM eMini Crude Oil
I published the evaluation results in the whitepaper. I am doing my training/evaluation with a data split of 70/30. Doesn't that qualify as a proper backtest?
madchops1··on Machine learning predictions for QM eMini Crude Oil
I am doing my training/evaluation with a data split of 70/30. Doesn't that qualify as a proper backtest?
madchops1··on Machine learning predictions for QM eMini Crude Oil
Also you should always place a stop and limit order. So you don't get completely wiped out. Its very common.
madchops1··on Machine learning predictions for QM eMini Crude Oil
Your are correct about no hedge agains outlying macro events. But I'm not suggesting using this without any other variables in your trading decision. It may help make a trading decision.
madchops1··on Machine learning predictions for QM eMini Crude Oil
I love xkcd.
madchops1··on Machine learning predictions for QM eMini Crude Oil
I know a lot of you hate this but the model has correctly predicted the correct direction of movement at end of day 9 out of 11 days since my model was under baseline and I began publishing my results. I know I've said this a few times but its not a crystal ball, its a value that can assist in trading decisions.
madchops1··on Machine learning predictions for QM eMini Crude Oil
Also my models beat baseline in evaluations so I'm stoked on that. It took some doing to produce results with time-series data.
madchops1··on Machine learning predictions for QM eMini Crude Oil
It may be a bit naive. going to keep working on this and I have found my indicators to greatly increase my own trading results and making the models evaluation numbers improve is very exciting and interesting to me and maybe others.

Thanks for the one compliment :)

madchops1··on Machine learning predictions for QM eMini Crude Oil
I will do this thank you for your feedback. I didn't release my results until my models were better than baseline in evaluation. Hence better than flipping a coin. I published the results of my evaluations so you can see that. Its not a crystal ball. Its an indicator to help in trading decisions.
madchops1··on Machine learning predictions for QM eMini Crude Oil
I reacted that way because dude said he read the white-paper and somehow took this as a historical analysis of volume. Which it is not.

I use historical open, high, change, last, settle, prev. day open interest, plus several other fields I use to help recognize patterns and properly weight time-series data.

madchops1··on Machine learning predictions for QM eMini Crude Oil
It was changed. I said "your just jelly". Sorry. I changed it.
madchops1··on Machine learning predictions for QM eMini Crude Oil
The nice thing about QM is that 1 tick is a 12.50 dollar move. So its easy to cover fees. Today those were $50 profits. 2 shares moved 2 ticks. I use stops and limits of course. So my risk was about $100. Its not the same as options.
madchops1··on Machine learning predictions for QM eMini Crude Oil
Thanks HockeyPlayer spot on.
madchops1··on Machine learning predictions for QM eMini Crude Oil
I don't really have a strategy to copy. I just provide indicators that may affect how you decide to make a trade or not.

Also the point of this project is to get machine models that evaluate below baseline by improving the analysis of time-series data. I spent a lot of time improving the quality until they became better than baseline. Like I said I do not have a crystal ball or strategy for sale. Just insights from pattern recognition of historical time-series data that has helped me trade so I'm putting it out there.

madchops1··on Machine learning predictions for QM eMini Crude Oil
I will. Thank you for the advice.
Page 1 of 2Next →