The Coach Who Never Punts
grantland.com
grantland.com
In high school some teams will always go for a 2 point conversion after a touchdown. Not because they will make it a large percentage of the time but because they will be lucky if their kicker will make the extra point 20 percent of the time.
In high school and college it makes sense to go for it on fourth down more often because most teams don't have punters that can consistently kick the ball 50 yards or down it inside the 10.
Professional kickers can consistently make a field goal from 40 yards, some have really good percentages from 50. An onside kick that fails almost gives the other team 3 free points in the pros. An if the receiving team is expecting it the percentage of the time it works be small. In high school, where you almost have to be at extra point distance to even think of trying a field goal, I could see it being useful.
Main point: The coaches at each level are, for the most part, acting rationally. The occasional deviation from the typical strategy is like a bluff in cards. You need to do it occasionally so that they can't gang up on your typical strategy.
Brian Burke of Advanced NFL Stats has a great 4-part write up on it: http://www.advancednflstats.com/2009/09/4th-down-study-part-...
By the end of it, he has a model that demonstrates when teams should punt, when they should kick a field goal, and when they should go for it. Spoiler: They should go for it a lot more often.
For example, if you have 4th & 4 (or less) and are anywhere from the 5 yard line to the 50, you should go for it.
He even has a calculator so you can now add incorrect statistical decision making to your list of reasons to scream at the TV on Sundays: http://wp.advancednflstats.com/4thdncalc1.php
If the facts truly support it, I expect we will soon see NFL coaches adopt it.
The only way it happens is if the directive or permission comes down from the owner[1]: "I will allow you to never punt for two seasons or until we have an adequate sample size to judge this method."
[1] Thinking about all the fun things I could do with billions of dollars, like buy an NFL team and run experiments like this, make me question the sanity of people who turn down $3 billion to continue working on their photo sharing app.
I used only data from the 1st and 3rd quarters to exclude situations hurried by an expiring clock and by desperate teams or teams with large leads playing differently late in games.
So, by this logic the 4th down data is similarly non-standard, no? It would clearly be a situation different than normal 1-3 downs in 1-3 quarters.
His methodology is suspect. The entire premise (there have been similar reductionist statistical studies that holistically look at it as pure positional numbers) is founded on the notion of the weighted point value of each 1st down position. But as others have mentioned, on-fire offenses against miserable-defenses (e.g. New Orleans taking on Dallas) are going to absolutely dominate such a ranking, because they're of course going to dominate first downs (the survivorship bias -- the ones who suck go three and out), and they're more likely to be scoring points, completely throwing off such a weighting.
If you're dominating a game but have a couple of missed passes, coaches often will go for fourth downs. If you're having little success, on the other hand, why give up good field position, and instead try to just push them back and hold them off until you can regroup. If Minnesota is 3rd and 4 at their own 35, they quite rightly -- and with full statistical backing -- aren't going to go for it if it isn't a desperate last minute drive.
We of course have actual stats on the probability of making a fourth down-
http://espn.go.com/nfl/statistics/team/_/stat/downs/sort/fou...
And the probability of blocking such an attempt-
http://espn.go.com/nfl/statistics/team/_/stat/downs/sort/fou...
Teams have a less than 50% chance of making it on average, though of course specific teams and specific opponents will completely throw off that count, and such is what weighs on the minds of coaches making these decisions, having to do so outside of "if we were an entirely average team against an entirely average team..."
Ultimately, that's not what matters. Expected value is what matters.
Take the example from the video of a team on its own 5 yard line with 7 yards to go:
If they go for it and don't make it, they leave the other team with the ball on the 5 yard line, which they will convert into a touchdown 92% of the time, an expected value of -6.44 points. If they punt, the TD conversion goes down to 77%, an expected value of -5.39 points. Therefore, the break even is about 16% 4th down conversion rate. If a team can make it more than 1 in 6 times, they should go for it instead of punting. Since most NFL teams are in the 40-50% range, they should be going for it more often.
> If they go for it and don't make it, they leave the other team with the ball on the 5 yard line
Actually, if they go for it and don't make it, they either leave the other team with the ball somewhere between the goal line and just short of the 12, or they end up giving up a safety (which has both score and possession effects.)
Failing to convert on fourth down doesn't mean that you hand the ball over where you were before fourth down in the general case (only in the cases of an incomplete pass or zero-yard run, which aren't the only cases of failing to make a first down.)
Four zero yard plays + Four five yard plays + two 25 yard plays = 7 yards per attempt, but a 20% success rate.
The Chargers took a chance with Aussie Darren Bennett and the drop punt "Aussie kick" is now in everyone's playbook.
It's probably worth someone recruiting an ex-Union fly-half and see what tricks he can teach a quarter-back.
But ultimately, the stop-and-go nature of American football makes possession so important that there isn't much to be gained by all the laterals.
AFAIK the main reason NFL coaches don't try stuff that's too unusual is that although it makes a good trick a time or two, this is... well, professional football. Defenses will adjust.
Right now I'd suspect a lot of the success of going for it on 4th down, or going for two-point conversions, comes from the fact that opposing defenses aren't expecting it. But the minute you become known as "the coach who always goes for it", well, they're going to defend it (and in fact they'll have an easier time defending it since they know you're not going to try anything else).
It is an unusual deviation from the normal sequence of play-calling, and the advantage is that much of the time opposing defenses aren't prepared for it. They have plays set up for when they need to make a stop -- particularly at the goal line -- but they're not used to using them in this situation and it is, I suspect, almost entirely the novelty of being forced to run the "must stop this one play" defense that makes it a successful tactic.
Which in turn implies that if people start doing it all the time, defenses will simply adjust, become accustomed to making a dozen or so fourth-down stops per game, and that will be the end of this "Opposing Defensive Coordinators HATE him -- learn this one weird trick" story.
I'm skeptical of that last point. There are many, many variables that underlie football outcomes. Unlike baseball, where the most critical two players by far in any situation (the pitcher and the batter) are known in advance by both teams, a football play has the potential to be affected dramatically by any combination of players on the field. I am sympathetic to the idea that more teams should play aggressively on offense more often (and indeed I believe there are signs of this in today's NFL), but by no means should every team be expected to act according to the punt/FG/go-for-it chart in most situations.
I think you're absolutely right to emphasize variance tradeoffs. When coaches try to reduce variance they are often criticized as "risk-averse", but that's often a winning strategy, even in games that are close enough score-wise to be considered "typical".
I think the reason why these stories are so popular is that, from a fan's perspective, coaches rarely challenge orthodoxy head-on. Instead new schemes develop incrementally over time and are composed with other changes to systems and variables such as play calling, clock management, team speed and so on. When you are a coach that has 10-16 times a year to test your theories with your current team configuration, it makes a lot of sense not to rock the boat too hard.
So these stories kind of poke at the armchair-coach in all of us that are fans of the game. We've seen the Air Raid work since Leach and Tech, so why not the the NFL? It's fun to think about.
That said, Chip Kelly might be on to something in Philly.
Of course this depends on the strength of your defense and the strength of your opposing offense. Most punts will only gain you 10-30 yards from there (touchback to the 20). If your opponent has a high producing offense those 10-30 yards are not worth very much in comparison to the chance at 3 or 7 points.
Indeed, when my son played football in Jr. High the kick was worth 2 points because so few kids could actually do it, and the run or pass play conversion was only worth 1 extra point.
As coaches go, Coach Kelley was smart, far smarter than any coach I had at Plano West, one of the premier school districts for football in Texas. He pushed us hard, had a great sense of humor, and was out to win. PA was also the best school I have ever attended (I also grew up in Rancho Santa Margarita in Orange County, CA).
I guess what I'm trying to say is that while this is completely bizarre to find it on a Silicon Valley tech site like Hacker News, I honestly can't say I'm all that shocked. Sometimes when you meet people, you just understand and know that there's something different about them, a potential for greatness, that they are a mold breaker. Their current circumstances may be unexceptional, but you have confidence they will go on to do great things. I think this is of course what we (HN) share culturally with a football coach from Little Rock, AR: a desire to think outside the box, to break the mold, and achieve what little greatness we believe we are capable of achieving.
I owe a great deal of my professional success to Coach Kelley and Pulaski Academy, so seeing them realize this level of success by being different, smarter, fills me with pride and warms my heart.
Thinking about it further, though, their style of play broke the other teams' game plans. In general, if a defense can hold the other team to 3 yards or less they win. (Because 3 yards times 3 downs equals 9 yards and a new set of downs is 10 yards.) By calling a play on 4th down, they lowered their standard of success to 2.5 yards per play. In startup terms, they extended their runway by 33%.
Of course, they'd have to go deeper now and again just to keep the offense on its toes, but apart from that 2.5 is the goal. Everything else is a bonus.
If successful, they would also control the clock and keep the other team's defense on the field.
That being said, if you recruited for that it would be an interesting strategy.
Actually, now that I think of it, maybe the playbook wouldn't have to change too dramatically. You may run the ball a bit more, but you'd still run pass plays that spread the field out. If the defense just gives you the deep play, you take it. But, you're content to go with the first play that nets you 2.5, so you make that the goal and always have a couple of short options. The QB then prioritizes those in his progression.
But, that may be the reason it could work.
Consider ice hockey. Most coaches, if down by a goal, will pull the goalie for an extra attacker with about 90 seconds left in the game. It turns out that pulling the goalie significantly earlier, with about 3 minutes left in the game, would be more likely to result in a win:
http://people.stat.sfu.ca/~tim/papers/goalie.pdf
However, coaches are understandably reluctant to pull the goalie so early. When they're down by a goal near the end of the game, they're probably going to lose regardless. The public accepts that. However, if they lose anyway after employing an unorthodox strategy, the critics will be vicious, much as described in the football article.
What often happens is that people reject the ideas until they start winning or showing an obvious competitive advantage, then they embrace the ideas and they become the new standard way of doing things and people will parrot that as the one true way to do things as if it were always so.
I guess that is what progress looks like.
The 15 players stay on the field for the whole game, although 5 (about) can be subbed out (and can't come back).
There are four ways to restart: kick-off, Scrum (big men push), line out (thrown in from the side), penalty, (kick for goal, kick for touch or chase or tap and go), and free kick (same as penalty but no shot for goal).
The players run a lot - it's an aerobic and power game combined, which also means there is a role for players of all shapes and sizes.
The cost of playing is a ball - no pads required. It's also a lot safer as there are a lot less head injuries, as the protective gear in American Football just makes players feel safe, while increasing the impacts to the head..
The coach does not dictate plays - the players decide what to do when on the ground. It's a lot more fluid.
You can see the players' faces and bodies as they play, rather than just the coach.
It's played between countries at the top level. We have a world cup that's a genuine world cup.
It's now an Olympic sport at the 7s level.
and so on
> It's also a lot safer as there are a lot less head injuries...
There's a bit of debate about that point, there isn't enough data on concussions in rugby as the professional era of massive rugby players isn't as established as the NFL. Great article: http://www.bbc.co.uk/sport/0/rugby-union/24765650
Tongue in cheek article on why rugby is better than American football: http://bleacherreport.com/articles/589351-seven-reasons-why-...
---- Where to begin as a rugby newbie? ----
For newcomers interested in rugby union, there's a fantastic subreddit of dedicated fans, really friendly to newcomers too: http://www.reddit.com/r/rugbyunion
Check out the sidebar in that subreddit, it's excellent.
Rugby to Watch
Highlights of the Rugby Championship between South africa v All Blacks (one of the best games in recent memory - it's got power, speed, skill and massive hits in abundance) - http://www.youtube.com/watch?v=f2B0EviQDB0
At the moment there's friendlies between top Northern and Southern Hemisphere teams. Fixtures - http://www.ultimaterugby.com/november-internationals-2013
6 Nations (Top european nations duke it out). Fixtures - http://www.ultimaterugby.com/6-nation-2014
The above competitions are national teams, that doesn't even cover club sides, but that's enough to start with!
Watch rugby online - http://www.viponlinesports.eu/sports/rugby.html
Many of the things that are bemoaned about gridiron football are what most of us have come to love. The play stoppage, the start/stop nature, specialization of players etc. are what make gridiron football the most strategic of ball games. Continuous play games like rugby and soccer are much more tactical less strategic. Neither is better or worse, but I enjoy the strategy of gridiron & enjoy the tactics of rugby (& aussie rules for that matter).
Getting rid of those elements of gridiron football would be a bit like letting football (soccer) players use their hands. Sure it might make for an interesting new game, but it would destroy what we love about the old.
Except the commercials. God the NFL has to get a handle on that.
DVR. Start watching one hour after the game starts. If you want a 'no-huddle' mode, start two hours behind.
You could also try fantasy sports, but they don't teach you much about the game - they just encourage the sort of singleminded obsession that makes learning any subject easier.
http://sports.espn.go.com/espn/page2/story?page=easterbrook/...
"A year ago at the Hall of Fame reception in Canton, Ohio I found myself sitting between Bill Walsh and Don Shula. I posed this question: In a day when the Bears line up five-wide and Texas Tech passes 60 times a game, are there any fundamental innovations that have not been tried? Walsh supposed someone might try using trick formations for an entire game. Shula twinkled his eyes and said: 'Someday there will be a coach who doesn't punt.'"
http://espn.go.com/espn/playbook/story/_/id/8333797/annual-t...
http://sports.espn.go.com/espn/page2/story?page=easterbrook/...
The berkeley paper completely writes this off without evidence or reason, even with his assumption that offenses will not become more conservative with play calling, and its obvious a defense and crowd would act differently on 3rd and 3 than 4th and 3:
"Since it seems unlikely that the defense has substantially more scope than the offense to affect the distribution of outcomes"
Primarily, the goal on defense is to get off the field, so other than special situations like goal-line or the edge of field goal range, its ok to give up 3 yards and even 4 is fine. You really just need one great play out of 3 - a blocked or missed pass, tackle for loss, etc. and they're 3-and-out.
The paper admits the entire basis and math would be wrong if his assumption was misplaced:
"Thus using third downs to gauge what would happen on fourth downs would lead to overestimates of the value of going for it."
On 4th down and 1-3 yards, everything changes. You try to play every play as hard as possible, but you bring something special when its 'us or them, right here, right now'. Thats partially why (the other reason is there is less room to pass) that you see teams march down the field and can't get the last yard 4 tries in a row. I know the offense also steps up, but in a short running play against relatively even teams, defensive players are usually shorter (leverage) and have an extra player (unless the offense does wildcat with a mobile quarterback).
The other missing piece is they didn't seem to look at time left in the half and timeouts left. Punting in the first quarter is not the same as punting with 37 seconds and the other team is out of timeouts.
That being said, I'd be interested to see various modern machine learning and statistical techniques applied to football (as they have become applied to baseball).
In high-end college basketball, or the NBA, full-time full court press can become a recipe for easy fast break points. Inbounding teams can pass faster than defenders can run, and smart, disciplined players can memorize and run dozens of full-court plays.
At minimum you need a deep bench to consider it, because it is exhausting. So it's perfect for a kids team, where getting all the kids into the game is a virtue in itself.
Edit: the story I recalled is the one already posted in another comment, https://news.ycombinator.com/item?id=6729372
I think that is a very valuable lesson for us to take into startups, because so often we just want to "disrupt" things, but we don't have solid reasons for why disrupting something will lead us to being successful.
This last Sunday, both Detroit and Chicago went for it on 4th down back to back drives. It was like one coach was challenging the other and I thought that was pretty cool. Ultimately if you look at these punters today though, most of them can put the ball on a dime with special spin to make it go where they want. Field position is tested strategy that works.
http://www.advancednflstats.com/2009/09/4th-down-study-part-...
Practice advantage means that very rarely do teams practice their onside kick coverage or their 4th down defense on the opponents 12 yard line, because it just never happens. So the week before you play this team, your coaches will over index on the amount you practice onside kicks and 4th down coverage, meaning there will be a lot less time to practice for their actual offense and defense.
http://fifthdown.blogs.nytimes.com/2009/11/16/defending-beli...
If you're up by 2 touchdowns and you go for it on 4th, I can't think of a single announcer in the NFL who wouldn't make it seem like you were rubbing dirt in your opponent's face by doing so.
http://elsa.berkeley.edu/~dromer/papers/JPE_April06.pdf
"Teams’ actual choices are dramatically more conservative than those recommended by the dynamic-programming analysis. On the 1,604 fourth downs in the sample for which the analysis implies that teams are on average better off kicking, they went for it only nine times. But on the 1,068 fourth downs for which the analysis implies that teams are on average better off going for it, they kicked 959 times."
The following is possible: the surprise element of a fake punt makes going for it on 4th down more advantageous than it otherwise would be. It could make P(good outcome | going for it on 4th down) > P(good outcome | punting) if and only if the defense expects a punt, which they no longer would if a team adopts the strategy of routinely going for it on 4th down.
I say take it away for everyone and make 'em play all four downs!
Always going for the 2-point conversion is the real secret.
It's worth noting that this isn't about "going for it" on the 4th down, but instead about trying onside kicks. I mention that because one of the academic papers linked (by David Romner) is specifically about going for it on 4th down, and it doesn't say not to punt, but rather that on the average there are are many situations where teams punt when odds favor going for it on the 4th down (e.g. 4th and inches at your own 30 yard line. Aside from the last minutes of the 4th quarter down 6 points, the vast majority of teams would punt it).