Nov 20, 2008

Week 12 Game Probabilities

Win probabilities for week 12 NFL games are listed below. The probabilities are based on an efficiency win model explained here and here with some modifications. The model considers offensive and defensive efficiency stats including running, passing, sacks, turnover rates, and penalty rates. Team stats are adjusted for previous opponent strength.






















PwinGAMEPwin
0.09 CIN at PIT 0.91
0.40 CAR at ATL 0.60
0.64 BUF at KC 0.36
0.87 CHI at STL 0.13
0.25 NYJ at TEN 0.75
0.21 NE at MIA 0.79
0.54 MIN at JAX 0.46
0.70 PHI at BAL 0.30
0.51 HOU at CLE 0.49
0.87 TB at DET 0.13
0.17 SF at DAL 0.83
0.17 OAK at DEN 0.83
0.44 NYG at ARI 0.56
0.83 WAS at SEA 0.17
0.29 IND at SD 0.71
0.37 GB at NO 0.63


Nov 18, 2008

Week 11 Efficiency Rankings

The Dolphins are ranked #3 this week. Really? Why is Philly ranked so high but they keep losing, or at least not winning? Chicago's embarrassment at the hands of Green Bay drop them out of the top 10. Buffalo's free-fall continues. Pittsburgh's defense is still carrying a woeful offense toward a possible first-round bye. The Giants inch up after rolling over Baltimore, as does Tennessee after their comeback over the Jaguars.

As I discussed in my recent analysis of both the Dolphins and the Jets, Miami is a very solid team across the board. Despite apparently squeaking by the horrid Raiders 17-15 last Sunday, they actually played quite well. The Dolphins converted 20 first downs compared to only 11 for Oakland. They ran for 6.3 yards per rush and threw for a more modest but above average 6.4 yards per pass attempt. They also held the Raiders to only 3.9 yards per rush and 4.1 yards per pass attempt. Results like these go to show just how deceiving a final score can be (or just how meaningless stats can be, depending on your point of view).

The Eagles are frustrating. By all measures they should be carving up the league. Despite their ability to move the ball and stop opposing offenses, they aren't converting all those yards into wins. Their special teams aren't terribly good--average to slightly below average in most categories (although punt stats are very deceiving because good offenses tend to have less room to punt). Game day coaching tactics might share some blame too. They're also slightly unlucky, with an average defensive interception rate and fumble recovery rate.

But by far, the biggest reason for the Eagles disconnect between efficiency and wins is "bunching." Philadelphia's wins have mostly been blow-outs, and their losses have been squeakers. Their average winning margin has been 18 points while their average losing margin has been less than 5. I can't say conclusively that this bodes well for the Eagles, but I'd definitely rather be a 5-4-1 team with great internal stats than one with very poor ones.






































RANKTEAMLAST WKGWPOpp GWPO RANKD RANK
1 PHI10.760.5086
2 WAS20.750.5277
3 MIA80.700.48420
4 SD30.700.52321
5 ATL40.700.51122
6 NYG70.700.46511
7 CAR50.690.51183
8 PIT90.690.53241
9 TEN100.690.44152
10 ARI110.670.52219
11 CHI60.640.54129
12 TB130.620.54175
13 NO120.620.53623
14 DAL150.600.55194
15 GB160.590.52118
16 IND140.580.53918
17 DEN210.540.501025
18 NYJ190.510.442513
19 MIN170.500.562212
20 NE220.480.472024
21 BAL180.480.502110
22 BUF200.460.452814
23 HOU240.440.501329
24 JAX230.370.481427
25 CLE260.340.531628
26 SEA270.320.483017
27 SF250.290.532626
28 OAK280.270.563215
29 KC290.250.562330
30 CIN300.240.563116
31 STL310.160.552732
32 DET320.150.562931



To-date efficiency stats below. As always, click on the headers to sort.





































TEAMOPASSORUNOINTRATEOFUMRATEDPASSDRUNDINTRATEPENRATE
ARI7.63.40.0180.0226.33.80.0320.44
ATL7.04.40.0210.0086.24.90.0260.33
BAL5.84.00.0320.0235.83.40.0490.47
BUF6.53.80.0380.0296.13.90.0160.29
CAR6.44.40.0320.0175.24.00.0270.38
CHI5.93.80.0180.0165.93.40.0320.36
CIN4.23.50.0290.0316.14.20.0240.34
CLE5.54.10.0220.0217.14.70.0440.33
DAL6.74.40.0400.0345.34.20.0120.49
DEN7.34.50.0290.0236.84.90.0120.36
DET5.43.80.0360.0327.85.10.0070.37
GB6.54.00.0190.0265.14.90.0480.56
HOU6.94.50.0430.0287.14.50.0220.25
IND6.43.50.0240.0066.14.30.0340.38
JAX5.74.10.0190.0146.84.30.0310.42
KC4.94.50.0260.0247.55.10.0320.29
MIA7.14.20.0160.0166.53.70.0220.31
MIN5.74.50.0390.0256.33.10.0180.41
NE5.94.20.0210.0166.84.00.0350.25
NO7.93.70.0280.0276.54.30.0200.43
NYG6.35.30.0230.0215.24.00.0460.48
NYJ6.24.40.0400.0236.13.40.0250.28
OAK4.54.30.0220.0386.24.80.0380.44
PHI6.64.00.0230.0165.33.60.0270.32
PIT5.93.60.0360.0244.43.00.0290.44
SD7.83.80.0340.0166.44.10.0150.33
SF6.14.40.0430.0416.43.70.0280.47
SEA4.64.20.0340.0147.04.00.0140.26
STL5.14.10.0320.0297.84.70.0220.41
TB6.14.10.0240.0195.63.80.0390.47
TEN6.14.00.0200.0164.93.80.0420.36
WAS5.94.60.0100.0135.63.70.0240.35
Avg6.14.10.0280.0226.24.10.0280.38


Nov 17, 2008

Game of the Week

With 6:46 to go in the 4th quarter against hated rival Dallas, the Redskins faced a 4th down and 4 from the Cowboys' 37 yard line. First-year head coach Jim Zorn made the fateful decision to go for the first down. Jason Campbell forced an incomplete pass, handing the ball over to Dallas. The Cowboys went on to seal the victory by running for four straight first downs. Washington never saw the ball again. Was Zorn's decision a good one?

Punting the ball would have given Dallas the ball at about their own 10 yard line. With 6 and a half minutes remaining, Washington would have a 0.22 win probability (WP). Attempting a 54 field goal might have been pointless. Even if it were a successful kick, Dallas would have kept a one-point lead and possession, giving the Redskins a 0.37 WP. A missed kick would have handed Dallas the ball at their own 42 giving Washington a 0.19 WP. A 54-yd field goal is only good about 55% of the time. All in all, a field goal attempt would have net Washington a 0.29 WP.

Going for the 1st down with 4 yards to go is successful 52% of the time. Getting the first down would have given the Redskins a 0.51 WP. An unsuccessful conversion attempt would leave Dallas with the ball on (or near) their own 37, giving Washington a 0.20 WP. Going for it on 4th down gave the Redskins a WP of:

(0.52 * 0.51) + ((1-0.52) * 0.20) = 0.36

So it's pretty clear, even adjusting for the particulars of the game such as environment or the specific match-ups on the line of scrimmage, that going for the first down was the call to make.






















































































































Titans 16-0? Lions 0-16?

Battling back from 11 points down at halftime Sunday, the Titans went on to win and improve their record to 10-0. With six games remaining, how likely is it Tennessee can finish 16-0?

On the other side of the coin is Detroit, who at one point led the heavily favored Panthers 10-0 on Sunday only to go on to lose 31-22. How likely is it they will go on to lose their next six games and become the first winless team in a generation and the only 0-16 team ever?

The Titans’ remaining opponents and estimated probability of winning each game are listed below. In fairness, my prediction system may be underrating the Titans a little, mostly because they haven’t faced very many good teams so far. My personal instinct is that this estimate is on the low end. In other words, their chances of going 16-0 are at least this good.














WeekGameWin Prob.
12NYJ0.72
13at DET0.84
14CLE0.84
15at HOU0.64
16PIT0.59
17at IND0.48
Undefeated0.09



Mathematically, we can calculate the Titans’ probability of going undefeated by simple multiplication (0.74 * 0.86 * … etc.). In total, their chance of finishing 16-0 is 9%. Despite already having 10 wins, it’s quite unlikely they’ll do it.

Even if they were as dominant as a team can be, with a 90% chance of beating every opponent, their chances of winning all six remaining games would only be 53% (0.906). I bet that surprises most people. In general, our brains are very poor at intuitively estimating compound probabilities.

The Lions task of winning at least one game is much easier. We can calculate it the same way we did for the Titans, but from the perspective of their opponents. Detroit’s remaining opponents and estimated probability of winning each game are listed below.













WeekGameWin Prob.
12TB0.20
13TEN0.16
14MIN0.24
15at IND0.10
16NO0.19
17at GB0.13
Winless0.33


In total, their chance of going winless is 33% ((1-0.20) * (1-0.16) * … etc.). Even with an average probability of winning each individual game of 0.17, the Lions still have a 2 in 3 chance of winning at least one game. And like the Titans, even if Detroit were so horrible they only had a 10% chance of winning any one individual game, they’d still have a 47% (1 - 0.106) chance of pulling at least one upset.

Hat tip--Wages Of Wins.


Nov 16, 2008

Just for Kicks

Not everything I research gets posted here. 90% of it seems meaningless to me, so it's probably double meaningless to the rest of the world. But I thought I'd remove the filter, and just throw up some of the things I've used as building blocks in developing my win probability model. One of the important ingredients in any full model of football is kicking. So here are a couple of graphs you won't find interesting. No earth-shaking revelations about play calling, no bold counter-intuitive predictions, just data.

Punts average about 36 yards in the NFL. But where the punt takes place makes a big difference. Obviously, the closer to the end zone, the shorter a punt can be and the more likely a touchback is. The graph below plots the average net yards from punts at each position on the field. By field position, I mean line of scrimmage, not where the punter actually stood when he kicked.


(I know what you're wondering. Who the hell kicked a punt from inside the 25 yard line? Nov 12th, 2000, the Bengals trailed the Cowboys by 14 points with 13 minutes remaining in the 4th quarter. On 4th and 14 from the Dallas 24, Cincinnati lined up for a field goal. The Bengals "faked" the field goal attempt and made a "quick kick" according to the entry in the gamebook. From what I can tell, this was the intentional play and not an aborted play. The result was a touchback. Net gain: 4 yds. Dallas went on to kick a field goal and won the game. Whatever. Heck, throw a pass! An interception at the 5 probably leaves you better off.)

The other graph I'll show is field goal percentage by field position. Again, I'm referring to the line of scrimmage, not the silly "field goal distance" you get by adding 10 yards for the end zone and 7 yards for the snap.


I'll make one observation about modeling field goal kicks. Out to the 10 yard line, it seems like bad snaps or holds would be the biggest factor in missed kicks. From the 10 out to the 36 yard line, accuracy is the determining factor. Then outside the 36, range is the limiting consideration. I'm sure different kickers have different ranges, and environmental factors are very important, but you can see a slight inflection at the 36.


Nov 14, 2008

Playoff Probabilities Week 10

Courtesy of Chris at NFL-Forecast.com, here are the latest playoff probabilities for each team. The tables below include results from the Thursday night Jets-Patriots game.

These playoff probabilities are calculated using the NFL-Forecast software mini-app that runs thousands of simulated seasons. The outcomes are based on game-by-game probabilities with every crazy tie-breaking scenario factored in. Chris has (wisely?) used the probabilities from Advanced NFL Stats as his default game probabilities for the past two seasons.

But if you don't like my numbers you can easily change them. Or you can play what-if scenarios. What if the Cowboys beat the Redskins this weekend? How would that change their chances for the playoffs? In fact, to account for last night's game, I simply slid the slider to 100% for the Jets to give them the win. Pretty cool.

Last year, I linked to the NFL-Forecast page each week, but this year Chris has agreed to allow me to duplicate his tables here. Don't forget to try out his NFL forecast software.

There are two tables below. The first lists the probability that each team will finish in each place in their division. The second table lists the overall playoff probabilities, broken down by seed.





















































AFC EAST
Team 1st 2nd 3rd 4th
Miami 4833145
NY Jets 4036186
Buffalo9193439
New England 4133450
AFC NORTH
Team 1st 2nd 3rd 4th
Pittsburgh 821800
Baltimore 188200
Cleveland 00937
Cincinnati 00793
AFC SOUTH
Team 1st 2nd 3rd 4th
Tennessee 99100
Indianapolis 187111
Jacksonville 0106525
Houston 022573
AFC WEST
Team 1st 2nd 3rd 4th
San Diego 683110
Denver 326620
Oakland 037423
Kansas City 002377
NFC EAST
Team 1st 2nd 3rd 4th
NY Giants 5930101
Washington 3445183
Philadelphia 6225418
Dallas 041878
NFC NORTH
Team 1st 2nd 3rd 4th
Chicago 761680
Minnesota 1452340
Green Bay 1032580
Detroit 000100
NFC SOUTH
Team 1st 2nd 3rd 4th
Carolina 5229163
Atlanta 2634319
Tampa Bay 20303514
New Orleans 271873
NFC WEST
Team 1st 2nd 3rd 4th
Arizona 99000
Seattle 1414316
San Francisco 0443819
St Louis 0161965












































AFC Percent Probability Playoff Seeding
Team 1st 2nd 3rd 4th 5th 6th Total
Tennessee9072010100
Pittsburgh64026114490
NY Jets214195131668
Miami122242121576
Baltimore0773131848
Indianapolis1000421963
San Diego0414511272
Buffalo044081330
New England02114815
Denver013271234
Jacksonville0000122
Cleveland0000000
Oakland0000000
Kansas City0000000
Houston0000001
Cincinnati0000000
NFC Percent Probability Playoff Seeding
Team 1st 2nd 3rd 4th 5th 6th Total
Arizona 613374300100
NY Giants 381551211090
Washington 22920351382
Chicago 2631370177
Carolina 202561121376
Atlanta 5146181650
Tampa Bay 4114181745
Philadelphia 2310142141
Minnesota 11571318
Green Bay 00280010
Dallas 0000247
New Orleans 0110035
Seattle 0000000
San Francisco 0000000
St Louis 0000000
Detroit 0000000


Nov 13, 2008

Jets' and Dolphins' Resurgence in 2008

Why are the New York Jets and Miami Dolphins doing so much better this year compared to last? Their new quarterbacks are immediately credited, but are they the real reason? What about the defense and the running game? And how does Favre's passing numbers compare to the Jets of last year? Are they really any better than those of the Chad Pennington/Kellen Clemens duo from 2007? I'll break down each facet of the game and tell you where each team's improvements have really come from.

The first consideration is strength of schedule. Last season both the Jets and Dolphins faced a tougher than average schedule. With division bully New England finishing the regular season 17-0, each team's opponent average win probability was 0.55. In other words, their opponents averaged a 55% expected winning percentage. That puts both teams in the top 5 in terms of schedule difficulty for 2007.

This year is quite different. The Dolphins opponent average win probability is 0.50, perfectly neutral, meaning their opponents have been league-average in terms of difficulty. The Jets, however, have faced a relatively easier schedule. Their opponents average 0.43 in expected win probability. So both teams can thank an easier schedule so far this year, the Jets more than the Dolphins.

But opponent strength only tells part of the story. Both the Jets and Dolphins have fundamentally improved, most prominently in their offensive passing games. Most analysts will point to total yards or touchdowns scored, but we know those stats can be very misleading. Let's look at efficiency stats for the real story.

The tables below list each team's efficiency stats for all of 2007 and 2008 through week 10. The year-to-year difference in each stat is also listed. Each facet of the game is not equally important, so the bottom row of each table lists the estimated number of wins a team can expect to improve or decline based on the change in each stat. For example, the improvement in Miami's offensive passing efficiency of +2.2 net yards per attempt would normally result in a gain of 3.3 wins over the course of a full season. These estimates are based on a regression model detailed in this article.









TEAMOPASSORUNOINTRATEOFUMRATEDPASSDRUNDINTRATEPENRATE
MIA '075.04.10.0310.0276.64.60.0340.34
MIA '087.13.90.0170.0156.73.70.0240.29
Difference+2.2+0.2-0.014-0.0120.1-0.8-0.011-0.05
Wins +/-+3.1-0.2+0.7+0.6-0.1+0.5-0.9-0.1


Miami's passing game is clearly the biggest difference. Between passing efficiency and interception rate, the passing game alone is responsible for a whopping +3.8 gain in wins. Despite all the attention garnered by the Wildcat offense, the Dolphins' running attack is actually slightly worse this year than in 2007. All together, the Miami offense is responsible for an improvement of +4.2 wins.

Overall, their defense is actually slightly worse this year. Although they are stopping the run better, run defense doesn't translate into many wins. They've also been unlucky in the defensive interception department. All together, the Dolphin defense can be credited with half a loss (-0.5 wins).

Now let's look at the Jets.










TEAMOPASSORUNOINTRATEOFUMRATEDPASSDRUNDINTRATEPENRATE
NYJ '075.43.70.0390.0206.64.20.0350.24
NYJ '086.24.60.0450.0246.03.20.0300.30
Difference0.80.80.0060.004-0.6-1.0-0.0060.06
Wins +/-+1.2+0.8-0.3-0.2+1.0+0.6-0.5+0.2


The Jets' numbers tell a different story. Their improvement this year has come from both the offense and defense. Favre has helped improve the passing game, but he's throwing interceptions at an even higher rate. The Jets' passing attack is responsible for only +0.9 additional wins over last year. The running game has improved just as much, going from a solidly below average 3.7 yards per rush to a solidly above average 4.6 yards per rush. All together the Jets offense can take credit for an improvement of +1.5 wins.

Their defense is also pulling its fair share of the load. Significant improvements in both running and passing efficiency combine for an improvement of +1.5 estimated wins. Their defensive interception rate has declined slightly from 2007, giving back half a win on average. In total, the Jets' improvements have been across the board in contrast to the Dolphins' offensive passing resurgence.

It's hard to compare Favre and Pennington directly. But the one observation I will make is that a 0.045 interception rate is extremely high. That means about 1 in 20 of Favre's passes are intercepted. Favre, with better receivers and arguably better protection, is achieving 6.2 net yards per attempt--essentially league-average--with that very high interception rate. It's hard to see how a team can continue to win giving up that many interceptions.

Pennington, on the other hand, has faced slightly tougher defenses so far and is getting 7.1 net yards per attempt. And he's doing it with a very low 0.017 interception rate. That's about 1 in 60 passes. Plus, his team's running game isn't nearly as threatening as the Jets'. But wins are the bottom line, and right now New York has the edge.