According to the Data: Comparing Expert Rankings to ADP

According to the Data: Comparing Expert Rankings to ADP

This article is part of our According to the Data series.

Comparing Expert Rankings to ADP

We recently released our Top 200 Overall Composite Rankings. I think there's a ton of value in aggregate rankings because they factor out individual biases. Generally, such an approach — "wisdom of the crowds"— will beat individual rankings. Each of the guys put in lots of work to generate their individual rankings, yet chances are the average of their rankings will outperform most of them on an individual basis. That's not a knock on the RotoWire experts at all - they're some of the best in the business - but it's just a likelihood given that aggregates typically beat out individuals.

Let's look at the rankings of Drew Brees, for example. Two of the experts - Mark Stopa and Kevin Payne - have Brees ranked 21st overall, while Luke Hoover has him all the way up at No. 13 and Chris Liss has him down at No. 31. Luke and Chris could certainly be correct in their rankings - perhaps they know something the others don't - but it's more likely Brees will fall between the spots where Luke and Chris have him ranked. Brees actually checks in at No. 21 overall - right where Mark and Kevin ranked him. Since the rankings were formulated independently of one another, Brees is most likely to check in close to that mean.

To see just how the RotoWire expert rankings compare to public opinion, I charted the composite rankings against current ADP. I noted the

Comparing Expert Rankings to ADP

We recently released our Top 200 Overall Composite Rankings. I think there's a ton of value in aggregate rankings because they factor out individual biases. Generally, such an approach — "wisdom of the crowds"— will beat individual rankings. Each of the guys put in lots of work to generate their individual rankings, yet chances are the average of their rankings will outperform most of them on an individual basis. That's not a knock on the RotoWire experts at all - they're some of the best in the business - but it's just a likelihood given that aggregates typically beat out individuals.

Let's look at the rankings of Drew Brees, for example. Two of the experts - Mark Stopa and Kevin Payne - have Brees ranked 21st overall, while Luke Hoover has him all the way up at No. 13 and Chris Liss has him down at No. 31. Luke and Chris could certainly be correct in their rankings - perhaps they know something the others don't - but it's more likely Brees will fall between the spots where Luke and Chris have him ranked. Brees actually checks in at No. 21 overall - right where Mark and Kevin ranked him. Since the rankings were formulated independently of one another, Brees is most likely to check in close to that mean.

To see just how the RotoWire expert rankings compare to public opinion, I charted the composite rankings against current ADP. I noted the difference in the rankings in terms of overall draft spots and the percentage change.

RankOverallADPDifference% Change
4C.J. Spiller7342.9
26Lamar Miller431739.5
15Jimmy Graham23834.8
17Demaryius Thomas24729.2
32Victor Cruz39717.9
5Jamaal Charles6116.7
30Cam Newton36616.7
27David Wilson32515.6
34Montee Ball40615
18Chris Johnson21314.3
36Reggie Bush42614.3
22Larry Fitzgerald25312
39Jordy Nelson44511.4
10LeSean McCoy1119.1
13Dez Bryant1417.1
14Brandon Marshall1516.7
28Roddy White3026.7
1Adrian Peterson100
2Arian Foster200
3Doug Martin300
8Ray Rice800
9Trent Richardson900
12A.J. Green1200
19Julio Jones1900
35Vincent Jackson3500
29Andre Johnson28-1-3.5
40Darren McFadden37-3-8.1
37DeMarco Murray34-3-8.8
24Maurice Jones-Drew22-2-9.1
11Alfred Morris10-1-10
20Steven Jackson17-3-17.6
31Peyton Manning26-5-19.2
33Frank Gore27-6-22.2
16Aaron Rodgers13-3-23.1
25Stevan Ridley20-5-25
23Matt Forte18-5-27.8
38Rob Gronkowski29-9-31
21Drew Brees16-5-31.3
7Calvin Johnson5-2-40
6Marshawn Lynch4-2-50

The players at the top of the list are those who are ranked higher in the composite rankings than where they're getting drafted by the public. There's a good chance you can acquire value on those names because 1) the experts are high on them and 2) the public hasn't caught on, so you can get them at a good price.

You can see that running back C.J. Spiller is the biggest value in terms of percentages, ranked fourth overall by the RotoWire experts but getting drafted three spots later, on average. In terms of overall movement, no one touches Lamar Miller. The guys have him ranked 17 spots higher than his ADP. I'm also quite high on Miller, so there's a really high probability that you can acquire value on him this fall.

At the other end of the spectrum, we see Marshawn Lynch and Calvin Johnson as the worst values in terms of the percentage change, although that's primarily due to their high ADP. The biggest overall mover in terms of draft spots is Rob Gronkowski, whom the guys have rated nine spots lower than his ADP.

Again, I'm on the side of the staff. Gronkowski is currently getting drafted as if there's absolutely nothing wrong with his health; even though he's scarce, he never should have been in the first or even second-round conversation simply because the opportunity cost of drafting a tight end in that range is so massive. He's just now getting drafted where he should have been if healthy.

None of this is to say that you should blindly accept aggregate rankings. You can and should alter rankings as you see fit. That's part of the fun. But if you have a player ranked drastically higher or lower than everyone else, you need to take a step back and examine the situation. You could very well be right, but we don't want to approach our projections and rankings as if our decision-making is flawless. By comparing our rankings to composite rankings from other experts, we're basically admitting that we're prone to error.

The first step - and probably the most important - in creating your fantasy football rankings this year is understanding your own biases and potential errors. By admitting you're susceptible to error, and that there's a whole lot you don't know, you can paradoxically enhance the accuracy of your predictions.

Jonathan Bales is the author of the Fantasy Football for Smart People book series. He also runs the "Running the Numbers" blog at DallasCowboys.com and writes for the New York Times.

Want to Read More?
Subscribe to RotoWire to see the full article.

We reserve some of our best content for our paid subscribers. Plus, if you choose to subscribe you can discuss this article with the author and the rest of the RotoWire community.

Get Instant Access To This Article Get Access To This Article
RotoWire Community
Join Our Subscriber-Only NFL Chat
Chat with our writers and other RotoWire NFL fans for all the pre-game info and in-game banter.
Join The Discussion
ABOUT THE AUTHOR
Jonathan Bales
Jonathan Bales is the author of the Fantasy Football for Smart People book series. In addition to RotoWire, Jonathan also provides content to the New York Times, Dallas Morning News, DallasCowboys.com, and NBC.
Ryan Grubb and the History of College Coaches Headed to the NFL
Ryan Grubb and the History of College Coaches Headed to the NFL
10 Sneaky Tricks For Your Upcoming Rookie Draft (Video)
10 Sneaky Tricks For Your Upcoming Rookie Draft (Video)
NFL Draft Decisions: Navigating Make-or-Break Moments
NFL Draft Decisions: Navigating Make-or-Break Moments
Dynasty Startup Draft LIVE! Superflex; ROOKIES Included! (Video)
Dynasty Startup Draft LIVE! Superflex; ROOKIES Included! (Video)