Article

Eckert: QB Stats Study 2.0 Using Advanced EPA, CPOE Metrics 2016-2020

Ben Roethlisberger

Last week I released my first article in my “Quarterback Study Series”.  Here is a link to that post, I would recommend it if you dive deep into this post (for full context of this study): https://steelersdepot.com/2021/05/eckert-qb-stats-study-1-0-using-advanced-epa-cpoe-metrics/

In the first study, we looked at quarterback success in the 2020 regular season based on two stat points: EPA/Play = (expected points added) expected points after play – expected points before, and CPOE= (completion percentage over expectation) probability for a complete pass compared to similar situations.

Today, I wanted to dive into a larger view than a single season.  We will be looking at the last 5 seasons (2016-2020), and I figured that since I got some good feedback on the data points I used in the first study overall, I kept them the same so we could get a larger sample size. As we learn about the players, I would urge you to remember this study was not what the quarterback can do, but what did they do with the attributes that every quarterback requires (ex. not every quarterback is a rushing threat, but everyone is expected to add points for your team to win, and complete passes).  With that in mind, let’s see what 2016-2020 looked like:

I hope you are excited to see how we can layer this information to get more value out of it, perhaps learn something about how we’ve previously thought about players, and hopefully get an opinion on if we can use this model somehow to predict future success.  For now, let’s rank them by stats similarly to last week, but with the 5 year sample size, and adding some new value: Dropback leaders will give us value from a usage/durability/career longevity standpoint, EPA and CPOE ranks for quality of that usage, and Study 1.0 Rk for recency value.

Dropback Leaders (2016-2020) EPA Rk CPOE Rk Study 1.0 Rk (Top 2020 EPA/CPOE)
1. Matt Ryan 8 6 9
2. Russell Wilson 13 1 7
3. Tom Brady 3 11 4
4. Philip Rivers 9 13 14
5. Kirk Cousins 16 5 5
6. Derek Carr 20 9 10
7. Aaron Rodgers 5 8 1
8. Matthew Stafford 14 27 16
9. Carson Wentz 26 26
10. Jared Goff 23 31 15
11. Dak Prescott 12 15
12. Ben Roethlisberger 10 18 17
13. Drew Brees 2 2
14. Andy Dalton 29 30
15. Jameis Winston 19 10
16. Cam Newton 32 36
17. Joe Flacco 36 32
18. Deshaun Watson 7 3 3
19. Eli Manning 37 34
20. Patrick Mahomes 1 7 6
21. Case Keenum 33 28
22. Mitchell Trubisky 28 33
23. Ryan Fitzpatrick 18 25
24. Alex Smith 25 14
25. Blake Bortles 31 39
26. Baker Mayfield 21 24 18
27. Marcus Mariota 24 16
28. Ryan Tannehill 17 4 8
29. Josh Allen 15 20 2
30. Sam Darnold 39 35
31. Andrew Luck 11 17
32. Kyler Murray 22 22 11
33. Tyrod Taylor 30 21
34. Jacoby Brissett 34 38
35. Lamar Jackson 6 19
36. Daniel Jones 38 37
37. Jimmy Garoppolo 4 12
38. Trevor Siemian 35 29
39. Carson Palmer 27 23

Lots of cool stuff, but I really like the layers we added here. I really liked how this took away recency bias a bit, while also not reaching too far back in history to make comparisons irrelevant.  Hopefully this provides context into my point from the first study on the Steelers, focusing on quality over quantity in regard to Roethlisberger.  Let’s compare Ben to Ryan Tannehill for example, if the Steelers and Ben commit to the run game/offensive players they have invested in, and a more balanced offense, it could take some of the weight off of Ben compared to last season. He could focus on bringing his pass attempts down and completion percentage up (which I view as plausible, along with the run game and wide receivers cutting their drops down), and they could potentially have similar success to how the Titans run their offense with a more efficient Ben (with less play action most likely *insert sad face).

Now for another fun ending outlook. Without any personal opinion, I am going to rank them based on the information from Study 1 (2020 EPA/CPOE) and Study 2 (2016-2020 EPA/CPOE), then by dropbacks (descending) to keep the usage/durability/career longevity value:

Top 5 in both EPA/CPOE

  1. Drew Brees

Top 10 in both EPA/CPOE

  1. Matt Ryan
  2. Aaron Rodgers
  3. Deshaun Watson
  4. Patrick Mahomes

Top 15 in both EPA/CPOE

  1. Russell Wilson
  2. Tom Brady
  3. Philip Rivers
  4. Dak Prescott
  5. Jimmy Garoppolo

Top 20 in both EPA/CPOE

  1. Kirk Cousins
  2. Derek Carr
  3. Ben Roethlisberger
  4. Jameis Winston
  5. Ryan Tannehill
  6. Josh Allen
  7. Andrew Luck
  8. Lamar Jackson

Top 25 in both EPA/CPOE

  1. Ryan Fitzpatrick
  2. Alex Smith
  3. Baker Mayfield
  4. Marcus Mariota
  5. Kyler Murray

Top 30 in both EPA/CPOE

  1. Matthew Stafford
  2. Carson Wentz
  3. Andy Dalton
  4. Tyrod Taylor
  5. Carson Palmer

NOTE: Teddy Bridgewater, Justin Herbert, and Jared Goff made the 2020 Study rankings but fell off the list in this study.

Right off the bat I was surprised Drew Brees was the only quarterback to be Top 5 over the last 5 years! I really enjoyed this in regard to viewing players performance first for possible player comps, as opposed to physical/athletic player comps (nothing against those, just another viewpoint).  For example, Matt Ryan and Aaron Rodgers headline the tier 2 quarterbacks, and both have had long careers, but I didn’t think they would be this comparable in terms of my study.  Ryan also had the most dropbacks of any quarterback in the last 5 years.  Obviously, they are different from an athletic, and style of play standpoint, but the results in the key quarterback traits, (scoring points and completing passes) it is a good “quarterback result player comp” over the last 5 seasons in my opinion.

I feel like I could keep going but let me open it up to you! Please share in the comments your favorite parts of the study, favorite “quarterback result player comps”, or things you would like me to study in the future!

To Top