Guy trading at home caused the flash crash of 2010
bloombergview.com
bloombergview.com
> We investigate the trading of one hundred Nasdaq-listed stocks on INET, a limit order book. In contrast to the usual view, we find that over one-third of nonmarketable limit orders are cancelled within two seconds [0]
When so many participants and breaking the law and the law seems to be applied somewhat subjectively, then it is ripe for corruption and political targetting. Kind of like how political dissidents get arrested for 'tax evasion' in Russia
To be fair, this study was performed in 2007 and spoofing became explicitly illegal under Dodd Frank passed in 2010.
I mentioned this in a comment in an earlier reply, but I think some skepticism around market participants is healthy. If market participants assume that there is no fraud or that fraud will be prosecuted by central authorities, they will be more easily defrauded.
Edit: Looks like the number of unfilled orders is over 90%
> New data from the US Securities and Exchange Commission (SEC) show that only 3.2% of the orders placed in the stock market in the second quarter of 2013 actually went through. [1]
[0] http://papers.ssrn.com/sol3/papers.cfm?abstract_id=994369 [1] http://qz.com/133695/96-8-of-trades-placed-in-the-us-stock-m...
In symbols where they are a registered market-maker, market-makers are supposed to be obligated to make a market in the symbol. In exchange they get several regulatory benefits, like being able to naked short a stock (sell it without even locating/borrowing the shares).
In practice most automated market-makers used to just put out bogus quotes they never expected to fill at $0.1/$1000000.0 bid/ask. The SEC tried to regulate this and say you had to really be making a market and put your quotes within X% of the current bid/ask. Market-makers started automatically cancelling and replacing at exactly X% away, but that was too much for them. So they had Nasdaq create an order type that automatically cancels itself and replaces it X% away from the bid/ask anytime the NBBO changes.
What they are doing in that example is completely wrong, but not analogous to what the guy in this article was allegedly doing (this guy put his quotes near the money to make fake interest, market-makers put theirs as far away from the money as possible to be fake market-makers and get regulatory benefits like naked shorting in exchange, their orders don't appear like real buy/sell interest in the same way this guy's allegedly did).
---
The author of the article tries to distance algorithmic-HFT from this guy operated, to cleanse its name, but come one:
Sarao may have been a spoofer, but he doesn't seem to
have been doing the sort of high-speed algorithmic
trading that usually qualifies as "HFT." He himself
claimed to be "'an old school point and click prop
trader' who had 'always been good with reflexes and
doing things quick,'" and the "Layering Algorithm"
that he used was a customized version of "a program
that allowed non-programmers to engage in automated
trading using spreadsheet commands and functions." He
was also the sole owner and employee of his trading
firm, which he "operated from his residence." In style
and substance he is not all that different from other
spoofers we have known and loved, who did their high
speed trading by just punching keys really fast.
In style and point-and-click background maybe he wasn't a goliath HFT operation, but in substance, spreadsheet automated trading at faster than human speeds, he definitely was.--
If the charges hold up, they will have been able to convict this guy because of evidence of intentionality (the emails to his FCM). But with trading strategies now starting to delve into modern deep-learning techniques, we're probably going to start seeing algorithms learn to spoof from a blank slate. The only way to tell if one of these algorithms is really intending to buy or sell or is spoofing would be to reverse engineer something rather inscrutable... And is it the author's intentionality or the algorithm's we're really concerned with? Likely we'll end up holding things to some gamable metrics that will do about as good a job as the market-maker quoting requirements do in assuring market-maker algorithms are providing liquidity.
It seems very wrong to me to make an activity feasible, and allow it to be profitable, but then arbitrarily drop the hammer of criminal penalties when a trader crosses some murky line.
Why are people so fixated on the order book? The real information is the spot price and how fresh is that information (and the volume), the order book is a fantasy anyhow. There are people willing to buy stuff at pennies always, and sell at thousands. How does that help you? What if they cancel? It shouldn't matter if someone does it closer to the spot price, or closer to the best bid-offer.
If you want to buy, look at the price, decide how much you think it's worth, put in a limit order at that price. Go to bed. If you want to sell, basically do the same. If you want to live on trading, then smarten up.
That's not true, the order could execute if someone slams the market with a massive buy / sell order. It auto adjusts to stay away from the active market. The idea behind the order type is that you don't want to be at the current 'market price' but rather just outside to handle big fish. You might argue this sucks, but the the big fish don't mind as it gives them more liquidity that wouldn't otherwise exist. The trade also lightens load as you don't have to constantly send cancels.
Maybe you aren't being pedantic: are arguing the intent of the regulation was to have market-makers make markets only as a bulwark against single whale-orders that will probably be thrown out as clearly erroneous?
That is a real role-redefinition. A quoting obligation that falls apart if the big-order trader on the other side randomly decided to break his order two (or N) near-simultaneous orders?
Ideally, the order will never execute as the regular market will handle the volume. Things are in bad shape when you have to dig into the Market Maker's pockets.
order type description: https://www.nasdaqtrader.com/content/productsservices/tradin...
Yep, the order type is only for market-makers. That's pedantic too; I only ever talked about it in the context of market-makers, as an example of place-cancel not being the same as spoofing. I'm not sure if you are pointing this out to say I am conflating them. Maybe I should have picked a more noble non-spoofing example?
You maybe have equated HFT and ultra-low-latency trading in your mind? The latter is almost always high-frequency because it is hard, on a few pennies per trade, to make any money without the F in HFT, frequency. But all areas of HFT aren't necessarily so latency sensitive as areas like index-underlyings arbitrage where you have to be colocated at the exchange to be competitive and 4,000 miles away sounds like a ridiculous punchline.
At a heavily automated market-maker I worked at, we, not so long ago, had all our servers almost a thousand miles from new york, even farther from Chicago, and still did about 8 or 9% of all US equities volume. It sure as fuck didn't run on Visual Basic, but you would be surprised how much algorithmic trading does out there.
The "2.5 billion in orders" is just a number; in fact, the unreality of that number is the problem.
I think we might be a bit biased on this site because a lot of the HFT recruiting targeted at techies in other industries is going to be in cutting-edge areas of ultra-low-latency or generically-dealing-with-massive-data where experience in a different industry can directly cross over.
For the most part, I think HFT is innocuous.
For the most part, HN does not think HFT is innocuous.
All I'm suggesting here is, if an Excel plug-in talking to Globex from London is "HFT", that shoots a hole in one of the primary arguments used against HFT here.
Really, what we're running up against here is the silliness of the term "HFT". By the definition we're contemplating here, virtually every ATS in the world is an HFT.
Which one specifically? That the big players have an unfair advantage over the little guy?
> Really, what we're running up against here is the silliness of the term "HFT". By the definition we're contemplating here, virtually every ATS in the world is an HFT.
Not really, if it doesn't deal with market micro-structure, it probably isn't HFT. There are lots of ATSes that do routine things like rebalancing portfolios, or more sophisticated things like automated hedging of human traders, that is still happening at a human pace.
I haven't seen a detailed article yet that covers how many order modifications he made, and how far outside the money his spoof orders were (really far and it is something he could have managed by hand and I wouldn't call it HFT, pennies-close and his London Excel setup couldn't have handled it, but I think there is definitely a big HFT Goldilocks zone in there).
Look, spoofing is already illegal, and is already a problem in manual trading. Whether the guy did HFT spoofing or not isn't really damning to HFT at all. It really just shifts attention away from how fast all the illusionary HFT liquidity (tightening spreads and providing valuable liquidity is how pro-HFT arguments normally counter anti-HFT arguments about it a zero-sum game) evaporated during the flash crash.
My original comment can shed some light on that. Part of the regulators' approach, post flash-crash, to getting more liquidity in events like that was to add more stringent quoting obligations on market makers. The regulation was already ineffective and poorly thought out, but to get an idea of how much the industry really values liquidity don't look at the bullshit they sell in congressional hearings (we pay the market in liquidity!), but instead look at the product they demand as customers of Nasdaq (a new, explicitly anti-liquidity order type).
(edit: ok a bit overblown on that last part, I don't think the flash-crash was that big of a deal. The HFT industry just really oversells liquidity and it is kind of a farce, the market literally shuts down for two days each week and takes ten days of holiday each year.. literally a near universal zero liquidity for 30% of the year or more if you consider market hours)
If a program uses AI to come up with strategies, how do you make sure it doesn't learn to spoof? Coming up with the goal-formulation of "don't spoof" seems like it would require the program to introspect about its own intent. Dunno, I would like to hear what kind of metrics one would use to make the learning algorithm reject spoofing strategies. I guess it would be something similar to whatever heuristics the SEC uses to flag potential spoofing, but they get a lot of false positives and almost never convict someone on metrics.
Even if they admit to spoofing as a general activity, they're just talking about the common case. They're not placing orders with unconditional intention to cancel.
Well that doesn't lead to a very helpful law...
In this particular case, the trader in question would have been financially ruined if his spoofed orders had been executed, so it's pretty clear he didn't intend for them to be.
Caveat: In my opinion, this isn't a distinction well suited to the criminal justice system. I'd rather that exchanges identify probable spoofers and ban them from trading (after some warnings), with the burden of proof (in arbitration) on the accused to show that the suspicious orders were part of a legitimate strategy.
Are you sure? If he bought the stocks at the heightened price he could just resell them right away. I'd have expected it would take a much more permanent shift to ruin him.
Or if I put it another way: It seems to me that there is a solid method for making money that's 95% the same as spoofing and 5% actually being happy when your "fake" orders execute. So the intent is still to manipulate the market but only through truthful orders. Then you can no longer look at this pattern of behavior and say that it's overwhelmingly likely to be spoofing. Now what do you do? Do any laws stop this?
It's traditional to praise the big finance houses when they pull this stuff, but for individuals it's a crime, because they found a way to 'cheat' the big boys.
Here's another example - http://www.computerworlduk.com/news/security/3244186/norwegi...
[1] http://www.ft.com/intl/cms/s/0/e2f6d1cc-9447-11e1-bb47-00144...
I.e., if the nbbo for SYMB is $10.00/10.10, an HFT might place an order at $10.01, then a bunch more pile on. Then the market moves down and the HFT cancels the $10.01 order and puts in another one at $9.95, in the hope that SYMB will move down to meet him. The goal is to get a fill from an uninformed (i.e. small) trader.
In contrast, this guy was deliberately avoiding fills, and more importantly, sent an email proving this was his goal. (That latter part is very important when the illegality of a specific action varies depending on what your goal is.)
You have to start somewhere / make an example of someone. Lone wolves trading from their houses have fewest friends and are easiest targets. Hopefully they go after bigger fish as well.
One law for some, another for everyone else.
If you try to think about it, it's hard to get your head around how MMs can provide this service. Ensure a counterparty to buy from, or sell to? The market is constantly moving. From where do they get the superpower of always having stuff to sell, or always being able to buy? How are they not taking a bath doing this?
One reason MMs can exist is because they charge a premium and pay a discounted rate for the securities they charge. The premium you pay an MM when you buy a security offsets the risk that they're getting the fuzzy end of the lollipop, which, if it happened over and over again, would force the MM out of business.
But: it's tricky to charge a premium (or pay a discount) against an estimated fair market value that is constantly changing. Also: the size of the premium/discount (the spread) depends on factors that also constantly change.
For me, knowing these things makes it intuitively obvious why MMs need to constantly submit and cancel new orders. It's like the edits in a simple diff algorithm; cancellations are the "-" lines, order entries are "+" lines, and a "change" in an order requires both.
EDIT: http://www.urbandictionary.com/define.php?term=fuzzy+end+of+...
This feels like a whole lot of sour grapes by the big boys. They're pissed because someone figured out their weakness.
lists which exact laws he's accused of breaking on the first page.
See also http://www.law360.com/articles/622358/feds-say-spoofing-law-...
Generally its hard to prove intent. You can place an order and cancel it after new information becomes made available or your needs change.
Try that at a poker table - yes, you'll "outsmart" the other players by being able to see their reaction. You'll also instantly break the integrity of the game, because you're not outsmarting them, you're breaking the rules that allow the game/market to actually function.
For a market to function properly that integrity that an order on the books is in good faith is vital. Of course, it's up to the SEC to enforce that.
I could certainly believe that if it was one of the large HFTs doing this, they would have had the necessary wheel-grease to not get in trouble...
Spoofing is pulling them out in a coordinated fashion before they can be put at risk with no intention of them ever trading.
The problem is that an api that prevented that would also prevent legitimate cancels that would have side effects that could be bad (ie making it riskier to make markets and therefore increase the bid/ask spread).
Spoofing is about intention. Intention cannot be determined by algorithm (yet).
Also to your point about a big HFT not being subject to this. Allston trading is a large HFT market maker that is currently in arbitration over spoofing.
Right? Right?
Don't tell me one can withdraw an order after it has been established that someone else is trying to buy it? That would be way too easy to abuse. "Oh, someone actually wants my stuff? Sorry, I just happened to change my mind."
Spoofing is really nuanced and analogies make it difficult. Usually spoofers will put orders in the back of the order book where they feel they can cancel them before anyone can realistically get to them. But they are in the order book, so they are "technically" at risk of being fulfilled.
Thats why intent is so important.
What is wrong in tricking stupid bots in the market? Lets not forget, it was a flash crash, meaning that if only emotional, slow humans would have been trading this thing, it would probably have never happened (at least not in these proportions).
Pretty far fetched to make one small guy responsible for a conceptual problem in the system.
If you have a Level II stock data feed, you can view the order book for particular stocks, and similar data is available for futures from CME group.
As an example, a friend of mine day trades Tesla stock (& options) and basically a swing trade, has figured out if the stock cycles down by a few cents, and they put a relatively large order at a certain price. The market sees the trade with a higher price and the stock increases. This has resulted in some large profits for swing trades, somewhat due to believing in Tesla's fundamentals and in Elon Musk. Some institutional investors don't share my friends views, and trade Tesla stock down. It is legal because the trade was made in good faith, and not trying to "deceive" the market using bogus trades.
In traditional HFT, the legal justification for fast trades that in some cases were never intended to be filled, is murky at best. As long as the market stays reasonably stable and the big boys profit, the complaints are somewhat muted.
A friend in the same group, who also trades Tesla, was on the console during the flash crash. It was "obvious" that these automated trade bots were unloading, and there was not major news (eg. GM bankruptcy) to justify the sudden price drop in specific stocks. Her console showed "black swan" type data, and she switched to an option trade as stocks caught up in the flash event wouldn't stay down for long. The options that were "out of the money" (almost worthless) became valuable when the stocks rebounded.
What caused the actual flash crash (triggered by futures trades or not) was a phenomenon called "exponential backoff" with a large automated trading bot closing out its trades, triggered by stocks below a certain price, causing downward pressure on the stocks, and the market. Another automated trade bot sees this, and also closes out its position. This automated close out then occurs exponentially, and the market goes into a "death spiral" crash.
Note: I do not own stock in Tesla. I'm not a stock broker and this is not investment advice.
It's 343! That's zero to a good approximation.
So this guy found a low-volume market that he could game with large sell orders above the current price that he would cancel (automatically, eventually) so he had a low (but crucially: non-zero) risk of actually having to sell at that price. Others would see the large sell volume and sell themselves, driving the price down. He would buy at the lower price, stop placing sell orders and watch the price bounce back up, absent his manipulation.
This is likely illegal in the letter of the law as written in 2010, and fair enough. Illiquid markets are easily subject to this kind of thing and if you want people to invest in them maybe you need to police them against it. Whatever.
But to call this "the cause" of the flash crash is like saying my neighbour's love of fireworks is "the cause" of my house burning down after I deliberately poured gasoline all over it. Sure, maybe my neighbour should have been more careful, but they had a reasonable expectation that my house would be ordinarily fire-proof, and behaved accordingly.
And of course this guy dominated the market when it was falling rapidly: his algorithm would have a field day in such an event, placing and cancelling multiple sell orders as fast as it could all the way down. So to cite that as some kind of evidence is to put effect before cause.
The only way this could have "caused" the flash crash is if a whole lot of large trading algorithms were using E-mini S&P futures as a a major input, and doing that--using such an illiquid, easily-manipulated market to drive large orders--that is criminal. Or should be.
Flash crashes are scary for lots of reasons.
I pray that the former is the more likely scenario as the latter is simply too awful to contemplate.
With respect to the idea that this guy is the culprit, that's literally laugh-out-loud funny. It's possible he was spoofing, etc., even with decent size. But the clearing firm (Hi, MF!) controls the throttles on those pipes. But there is what is called "sponsored direct access" in these markets, and that basically means the clearer wants your business enough you can just hook up directly so you can go really fast, and they (the clearer) will just pretend that they're looking at your stuff.
investors saw nearly $1 trillion of value erased from U.S. stocks in just minutes.
No. They did not. A stock's value is not "what some other dude is payed for it yesterday"; its value is whatever money you get when you sell it (plus, God forbid, whatever dividends it pays -- quaint idea, I know).
It's long been the case that the SEC, or in this case the CFTC, will fine and temporarily/permanently ban you from trading for this kind of behavior, look at http://www.cftc.gov/LawRegulation/Enforcement/EnforcementAct...
This is why it's dangerous to have algos run on the full book, especially without some logic to remove outliers.
[0] http://angrybearblog.com/2012/01/where-has-all-money-gone-pa... [1] http://en.wikipedia.org/wiki/Financial_transaction_tax#Unite...