Tuesday, May 26, 2015

How I Trashed the Wells Report from a Swan Boat

Does anyone else find it odd that every football fan with a computer has been weighing in on “Deflategate” (a name I will not be using again) since there was still snow on the ground in Boston, yet no one actually seems to understand the details?

I knew I had to do something about a week ago, when someone posted a reply on a message board saying that 11 of 12 of the Patriots’ footballs from the AFC Championship Game were 2 PSI under the limit. This story came from an anonymous leak on ESPN four months ago, and has been completely debunked by the NFL’s own report.

People don’t get it. Perhaps they need a summary of the Wells Report, written in English. They also need to take a deep breath, relax, and learn the facts. Luckily, speaking English and breathing are my specialties!

I understand “The Patriots Cheating” is a story that no one can resist, and the American attention span is about as long as a sneeze, so the temptation is to read the headlines, form a conclusion, and run with it. But this case is complex. If we want to get it right, we have to put in some time. I’ll do my best to make this exciting for you!

This post is divided into three parts: A review of the evidence, a resolution of the logo / non-logo debate, and an explanation of the differences in pressure lost between the two teams’ balls. Feel free to skip around as needed. And please, contact me right away with any questions or concerns!

Part I: The Evidence: Balls, Pressure, and Basic Math



As we all know by now, referee Walt Anderson’s best recollection is that he used his “logo gauge” (the gauge with the Wilson logo on it) for the pre-game measurements, though he acknowledged that he could be wrong. The Wells Report concludes that Anderson must have been mistaken and that he probably used the non-logo gauge. This is a matter of some importance, because Anderson’s two gauges were not calibrated to one another, or to anything else. The logo gauge consistently read higher than the non-logo gauge, by an average of 0.38 PSI. This means that, if the logo gauge measures a football at 12.50 PSI, the non-logo gauge would read about 12.12 for the same ball. And, if the non-logo gauge measures a football at 12.50 PSI, the logo gauge would read 12.88. Think of it as having two bathroom scales, one of which reads three pounds heavier than the other. These discrepancies would have an effect on any calculations based on measurements from those gauges.

As part of its analysis, the Wells Report calculates how much pressure was lost from the Patriots’ footballs between pre-game and halftime, and compares those decreases to the amounts that were lost from the Colts’ footballs, as well as the losses that were predicted by the Ideal Gas Law.

Their method for calculating the decreases was simple:

Starting Pressure (PSI) – Halftime Pressure (PSI) = Pressure Lost

So, if a Patriot football measured 12.5 before the game, and 11.5 at halftime, the formula would look like this:

12.50 PSI – 11.50 PSI = 1.00 PSI lost

Below are the halftime measurements of the two teams’ footballs. The PSIs were measured by two officials, Clete Blakeman and Dyrol Prioleau, whose names appear on the column headers. Because Prioleau’s readings were consistently higher than Blakeman’s by about the same 0.38 PSI difference discussed earlier, the Wells Report assumed that Blakeman had the non-logo gauge, and Prioleau had the logo gauge. For each pair of readings, the larger number is highlighted in blue for ease of reference.

The Wells Report also assumed that, after the Patriots’ balls were gauged, the two officials switched gauges, because for the Colts’ balls, Blakeman’s readings are consistently higher than Prioleau’s, again by about this same 0.38 amount. All these assumptions might make you nervous, but the differences between the two gauges are very consistent throughout all measurements, no matter whose is higher, so the assumption seems logical.

NOTE: After testing 11 of the Patriots’ footballs, the officials only had time to test four of the Colts’ balls before they needed to get back out to the field for the second half.


Halftime PSI Readings by Official
(Higher readings highlighted in blue and are presumed to be from the logo gauge)

Wait a minute. Something is wrong with the measurements of the Colts’ balls, isn’t it? If we assume that the two officials switched gauges before measuring the Colts’ footballs, we would expect Blakeman’s number to be higher for all four. Instead, we see that Prioleau’s number is higher for Colts ball #3.

The Wells report concluded that this “flip” was due to a transcription error; that is, someone simply wrote the numbers in the wrong columns for that particular ball. It seems pretty clear that this is what happened, since the bigger number (12.95) is 0.45 larger than the smaller one, which is right around the average discrepancy between the gauges. But, just to be safe, the Wells Report threw out the two measurements for Colts ball #3. I’ll remove it from my calculations too, to make sure that my calculations match Wells’, but I don’t agree that we need to do so. There are plenty of footballs with a logo gauge reading that is 0.45 more than the non-logo reading. It’s a reasonable assumption that the numbers were switched, so I’ll post two versions of my tables here: With Colts ball #3, and without. I’ll place all the with tables at the end of this section.
Here are the updated halftime results:


Halftime PSI Readings by Gauge Used



Notice, not only did we remove the readings for Colts ball #3, but we also placed all the logo gauge readings in the same column, and updated both column headers accordingly. Now, finally, we have a full set of halftime readings from both gauges, for both teams’ balls.

Next, let’s calculate the amount of pressure each football lost during the first half. Referee Anderson did not write down the starting PSI measurements for any of the footballs, but the Patriots staff reported that they set their footballs to 12.50 PSI prior to the game, using a gauge belonging to the Patriots, and the Colts staff reported that they set their balls to 13.00 PSI using a gauge belonging to them. Indeed, when Anderson tested the balls before the game using one of his gauges (though he is not certain which one; more on this in a moment), he recalls that the Patriots’ balls were at or around 12.50 PSI, and the Colts’ balls were at or around 13.00. We will therefore use these values as the starting point for our calculations.


Calculation of First Half Pressure Losses by Team and Gauge




For comparison purposes, let’s look at how the Wells Report calculated those same numbers (from Appendix I, page 9):



Bingo! Our numbers match the Wells Report exactly! That must mean we were both 100% correct. Right?

Wrong.

Take a closer look at the starting PSIs:



Are you seeing it yet?

Think back to my analogy about the bathroom scales. The logo and non-logo gauges are not calibrated to one another, remember? A 12.50 PSI football on the logo gauge would only read 12.12 on the non-logo gauge, and a 12.50 football on the non-logo gauge would be 12.88 on the logo gauge. The two gauges never produce the same reading on the same football. There is no possible way that Anderson’s two gauges could both show 12.50 for the same ball. Our table is wrong.

Now, we have a small issue. We know that Anderson’s best recollection is that the Patriots’ and Colts’ balls were 12.50 and 13.00 PSI, respectively, but he does not recall for sure which gauge he used to determine this. His best guess was that he used the logo gauge, so let’s start there.



Calculation of First Half Pressure Losses by Team and Gauge
Scenario 1: Logo gauge used for pre-game measurements




See what happened? The numbers for the logo gauge remained the same, naturally, since we assumed that the logo gauge was used for the pre-game measurements, and we therefore did not adjust the starting PSI for that gauge. But once we corrected the starting PSIs for the non-logo gauge, the differences went down by an average of—you guessed it—0.38 PSI, the difference between the two gauges.

In hindsight, this makes sense. Yes, the logo gauge reads higher than the non-logo gauge, but after we correct for that discrepancy, the amounts lost should be the same. Going back to our scale example, if one scale says you are 153, and the other says 150, and then you lose three pounds, you would fully expect your new readings to be 150 and 147, respectively. No one would ever expect them to be the same, if they weren’t the same to begin with. They also would not take the starting weight from scale 1 (153), subtract out the ending weight from scale 2 (147) and claim to have lost six pounds. That would be silly. Yet that is exactly what the table on page 9 of the Wells Report does.

Incidentally, there is a minute difference (.02 PSI) in the amounts lost between the logo and non-logo gauges for the Colts’ balls, which is due to rounding error. We’ll use the larger value (0.35) going forward, but such a small difference wouldn’t have any impact on our calculations either way.

The table above teaches us an important lesson. Never assume something is correct just because it’s in a book or (even worse) because it came from a lawyer. Question things. Double check.

Next, let’s see what the numbers would look like if the non-logo gauge was used pre-game:

Calculation of First Half PSI Losses
Scenario 2: Non-logo gauge used for pre-game measurements





Similar to scenario 1, this table shows a consistent amount of pressure loss for each teams’ balls, whichever gauge was used, with a very small rounding error for the Colts’ balls.

To put it another way, the logo and non-logo gauges both show a loss of 1.01 PSI for the Patriots footballs (if the logo gauge was used pre-game) and they both show a loss of 1.39 (if the non-logo gauge was used pre-game). The gauges will always agree with one another, no matter which one was used pre-game.

Based on the above, the chart from Appendix I, page 9, should have looked like this:

Summary of Halftime PSI Readings



Remember, the whole purpose of this project is to determine whether a Patriots employee secretly let air out of his team’s footballs. Since no one has confessed or been caught red-handed doing so, we have to take a close look at the PSI losses and determine if they can be explained by natural causes.

If we’re talking about the price of a pack of gum, there’s not a lot of difference between 1.01 and 1.39. But when we’re talking million-dollar fines and four-game suspensions, the difference becomes massive. Don’t look now, but Logo vs. Non-Logo just jumped ahead of Mary Ann vs. Ginger in the annals of all-time debates.

If Anderson used the non-logo gauge to measure the balls before the game, then the Patriots have 1.39 of PSI losses to explain. If he used the logo gauge, that number drops 27%, to just 1.01.

I will admit that it took me more than a few readings to find the error mentioned above, and it would be pretty impressive if I figured it out and this multi-million-dollar research firm didn’t. But somehow, I just can’t quite believe that it was an accident on their part. Call me cynical.

We’ll find out in just a minute what Exponent’s (the scientific research firm retained by Ted Wells) error means in the all-important calculation of unexplained PSI loss, but whether the effect is big or small, whether it was intentional or unintentional, it should concern us. A player’s legacy and a world championship are being openly questioned. If you are going to use scientific experiments to condemn a player, and a team, your logic better be airtight, and your report better be immaculate. Instead, we find a major error on page 9. A B+ isn’t good enough. Consider my confidence shaken.

So, how much of a pressure loss do we have to explain? 1.39 PSI, or 1.01? Of course, the only way to find out is to determine which gauge Anderson used.  We already know that Anderson said it was the logo gauge, which would mean we only have to explain a loss of 1.01 PSI. But the Wells report says Anderson was mistaken. Why?

Read on to see the charts from Part I revised to include the third Colts football, or feel free to jump right to the resolution of the logo / non-logo debate.

Part I B: Tables Recalculated to Include Colts’ Third Ball


As promised, here are the relevant tables from Part I recalculated to include the Colts’ third ball (am I the only one who finds that phrase disturbing?). Again, I really don’t see a valid reason to throw out the measurements from that ball, and I can’t help but wonder what the Exponent folks could have been thinking. At any rate, here are the charts. Enjoy!

Halftime PSI Readings by Gauge Used







Calculation of First Half Pressure Losses by Team and Gauge
Scenario 1: Logo gauge used for pre-game measurements





  
Calculation of First Half PSI Losses
Scenario 2: Non-logo gauge used for pre-game measurements



Summary of Halftime PSI Readings



PART II: Swan Boat Inspiration Strikes: A Resolution to the Logo / Non-Logo Debate


From the Wells Report, Appendix I, page 44:
According to information provided by Paul, Weiss, personnel from both the Patriots and the Colts recall gauging the footballs for their teams to pressures at or near 12.5 psig and 13.0 psig,respectively, prior to providing the balls to Walt Anderson. Each team used its own gauge to adjust the final pressures before presenting the balls to the referee, who used a gauge different from either used by the two teams to measure the pressure in the footballs. Walt Anderson recalled that according to the gauge he used (which is either the Logo or Non-Logo Gauge), all of the Patriots and Colts footballs measured at or near 12.5 psig and 13.0 psig, respectively, when he first tested them (with two Patriots balls slightly below 12.5 psig). This means that the gauges used by the Patriots and the Colts each read similarly to the gauge used by Walt Anderson during his pregame inspection.

It has been shown that the Logo Gauge consistently reads higher than all other gauges analyzed in this investigation. As a result, it is very unlikely that the Logo Gauge would have read similarly to the gauges used by each team. Therefore, it is most likely that the gauge used by Walt Anderson prior to the game was the Non-Logo Gauge, which read similarly to the Master Gauge and other gauges tested during the investigation.

Did you get all that? Don’t worry—most people don’t.

Let me break it down for you:

  1. When the Patriots prepared their footballs for the game, they set them to 12.50 PSI. This pressure was measured using a gauge that belonged to the Patriots. The Patriots did not use either of Anderson’s gauges.
  2. When Anderson tested the Patriots’ balls before the game using one of his gauges, he recalls that they were at or near 12.50 PSI, just where the Patriots set them.
  3. Based on the above, we can conclude that Anderson’s gauge (whichever one of the two he used) read similarly to the Patriots’ gauge.
  4. Exponent tested many sample gauges during this project. Anderson’s logo gauge read consistently higher than all of them, and his non-logo gauge read similarly to most of the sample gauges.
  5. Since the logo gauge read higher than so many sample gauges, it’s likely that it also read higher than the Patriots’ gauge. Also, since the non-logo gauge read similarly to the sample gauges, it probably also read similarly to the Patriots’ gauge.
(NOTE: All of the above applies to the Colts’ gauge as well, which was used to set their footballs to 13.00 PSI before the game.)

Whoa.

Are you as concerned about #5 as I am?

Basically, Exponent is assuming that their group of sample gauges is an accurate representation of the Patriots’ gauge. But how can they be so sure? An assumption is dangerous in any case—and it’s about to get worse.

A few questions come to mind right away:

How does Exponent know that the Patriots’ gauge reads the same as the sample gauges?

What type of gauge did the Patriots use?

What types of sample gauges were in this sample?

The Wells Report is 243 pages long. Surely I’d have no problem finding some answers! I eagerly dug around, and found this on page 13 of Appendix I:

Exemplar Gauge
A gauge that is thought to be nearly identical to the Non-Logo Gauge. Specifically, Model CJ-01 with the description “Electronic Ball Pressure Gauge.” Exponent obtained multiple
dozens of Exemplar Gauges from both Wilson Sporting Goods (via Paul, Weiss) and other sports equipment retailers.


Excuse me while I retrieve my jaw from the floor.

Exponent wanted to get some sample gauges. So what did they do? Did they obtain a variety of different brands and styles, to represent the variability of store-bought pressure gauges? Did they at least buy two different brands or styles?

Nope. “Multiple dozens” of the Exact. Same. Thing. Identical brand and model number.

Let’s say you drive a Nissan Maxima, and you want to know whether your car is faster than mine, but you have no idea what kind of car I drive. So you go out and buy several dozen Nissan Maximas and test them against yours. Surprise, surprise—the Maximas all perform at about the same speed! Based on these findings, you conclude that because your Maxima is so similar to all your test cars, it must also be similar to mine—even though you still don’t have any clue what kind of car I drive. Oh, and you also conclude that since your other car, a Toyota Celica, is faster than the Maxima, then it must also be faster than mine. Everybody okay with that?

I am sure Exponent had reasons for conducting their experiments the way they did, but that doesn’t change the facts. Essentially, all they did was compare Anderson’s non-logo gauge to dozens of other non-logo gauges. They all read similarly. So what? What does that prove about the Patriots’ gauge? Or the Colts’ gauge, for that matter?

One other thing. Anderson had two different gauges, logo and non-logo. If Exponent saw fit to go out and buy a huge pile of non-logo gauges, surely they did the same for the logo gauge, right?

Wrong.

Neither Exponent nor Paul, Weiss was able to procure exemplar gauges identical to the Logo Gauge. (Appendix I, page 14)

So they couldn’t find any. Another head-shaker. Apparently they don’t have access to eBay or Amazon! Look, I’m sure there’s an innocent explanation of why they couldn’t find any logo gauges. I just wish they would have shared it with us, instead of just a parenthetical comment. Again, you are accusing a four-time world champion of cheating. Your credibility must be beyond question—especially when you are relying on such shaky logic with the non-logo gauges.

Of course, all of this sample gauge stuff would be unnecessary if we could simply get our hands on the gauge that the Patriots used on the day of the game. If we had that, we could just get a few footballs, measure them with the Patriots’ gauge, then measure the same balls with the logo and non-logo gauges, and determine which one most closely matches the Patriots’ gauge (the same thing would work if we could obtain the Colts’ gauge). The actual game-day gauges used by the two teams are far more useful than a boatload of non-logo gauges with no connection to the game.

I’m no dummy, but I’m sure I am not the only one who sees the importance of the teams’ game-day gauges. Surely Ted Wells and friends put a lot of effort into finding them. Right?

I did an exhaustive search of the entire Wells Report, checking every mention of the word “gauge” (yep, I was there for a while). I found exactly one reference to the Patriots’ game-day gauge, on page 65, footnote 36:

We believe that [NFL Director of Game Operations James] Daniel located and used the pressure gauge supplied by the Patriots [to measure the football intercepted by D’Qwell Jackson]. We further believe that this is the gauge that [Patriots Equipment Manager]John Jastremski considers his normal gauge. It has not been located since the day of the AFC Championship Game. It should be noted that we have not relied upon the air pressure measurements of the intercepted ball in any respect in reaching any conclusions set forth in this Report.

So James Daniel finds the Patriots’ game-day gauge, uses it to measure the D’Qwell Jackson football, and then what? Did he leave it somewhere? Where? Did he give it to someone? Who? And why the oddly-worded “It has not been located since the day of the AFC Championship Game”? Has not been located by whom?

I searched the report again for any record of Ted Wells and his team attempting to locate the Patriots’ gauge. Nothing.

This gauge is a huge piece of evidence, crucial to anyone wanting to find out the truth—the actual truth, not a convoluted theory that guesses at it.  If the Wells team was searching for the Patriots’ gauge as earnestly as they should have been, if they were turning over every rock and seatcushion in Foxborough looking for it, they would have said so in the report—whether they ultimately found it or not. Instead, they only mention it once, and even then only in a footnote. Guess I shouldn’t complain, though—the Colts’ gauge isn’t mentioned at all.

I was disappointed, to say the least. The Patriots’ (or Colts’) gauge could have provided important insight, proof, maybe, of which gauge Anderson used before the game. In turn, we would have known exactly how much PSI was lost from the Patriots’ footballs, which would have brought us a lot closer to knowing whether or not the balls were tampered with. But no such luck. If only there was a documented measurement taken with the Patriots’ gauge that day…

At long last, I decided to put away my Wells Report hat for a while and take my family to Boston for the day. We were all contentedly gliding along in a swan boat, my mind focused only on the glorious sunshine streaming through the towering trees, the clear water, my beautiful wife and kids. And out of nowhere, it hit me.

There was a measurement taken with the Patriots’ gauge! Several, actually!

Look again at the footnote from page 65. The ball from the D’Qwell Jackson interception was tested by a gauge that Wells believes was the Patriots’ regular gauge. If we could find the readings from that test, we’d have an idea of how the Patriots’ gauge compares to the logo and non-logo gauges!

When I got home, I searched the Wells Report again. Paydirt!

From page 70:

The pressure of the Patriots ball that had been intercepted by the Colts was separately tested three times and the measurements—11.45, 11.35 and 11.75 psi, respectively-- were written on athletic tape that had been placed on the ball for identification.

With trembling fingers, I calculated the average of the three readings.

11.52.

It's almost exactly the same as the Patriots' halftime logo gauge average of 11.49! The non-logo gauge average is only 11.11, significantly lower than even the lowest of the three readings of the Jackson ball. True, it’s only one football—far from an ideal sample size—but at least the ball was measured three separate times. And I’ll take three measurements with the Patriots' actual game-day gauge over Exponent’s sporting-goods-store-shopping-spree method any day.

At any rate, I don’t know what kind of gauge the Pats were using, but it sure as hell didn’t read like a non-logo gauge.

The measurements on the Jackson ball are amazingly high; seven of the 11 Patriot footballs actually measured lower than Jackson’s at halftime, even when using the logo gauge numbers. Nine Patriot footballs measured lower than Jackson’s when using the non-logo gauge figures. And I think you see where I’m going with this.

Based on the Wells Report’s own figures, and their own conclusions, the Patriots’ gauge was used to measure the Jackson football, and those measurements were, by far, more similar to the logo gauge than the non-logo gauge. Wells has the same information we do, and came to the opposite conclusion, based on logic that a middle-school student would reject. I’ve seen enough. I’m ready to call this one.

The only conclusion I, or any reasonable person, can draw is that Walt Anderson used the logo gauge for the pre-game measurements. This is based on four factors:


  1. Anderson’s own recollection is that he used the logo gauge. Yes, he agrees that he could be mistaken, but Anderson recalled many details from the period before the game, including specific measurements of certain footballs. Wells accepted all of Anderson’s recollections as accurate, except the one about which gauge he used.
    I don’t buy the story that Anderson remembered all the other major details about the pre-game gauging of the balls, but forgot what gauge he used, especially since the gauges look so different (one has a long, crooked needle and a Wilson logo; the other has neither of these features). If we’re using the “more probable than not” criteria that the Wells Report made famous, then clearly we should conclude that Anderson recalled correctly.
  2.  Measurements taken with the Patriots’ game-day gauge closely match the logo gauge. As stated above, the D’Qwell Jackson football was measured three times with the Patriots’ gauge shortly before halftime, and the average of the measurements was 11.52 PSI. The average of the other 11 Patriot footballs measured at halftime was 11.49 on the logo gauge, and 11.11 on the non-logo gauge. You don’t need a degree in math to see that the Patriots’ gauge read almost identically to the logo gauge, and not nearly as closely to the non-logo gauge. Given this similarity, if the Patriots’ pre-game measurement was 12.50 PSI, and Anderson was using the non-logo gauge to measure them, he would have found that the balls were far below 12.50. Instead, he reported that they were exactly at or near 12.50. The only way he could have gotten this result was if he was using the logo gauge.
  3. The Wells Report’s reluctance to discuss the teams’ game-day gauges. Wells goes into painstaking detail in certain parts of the report. For example (p.66):

    Blakeman sat on a chair placed against the back wall of the dressing area next to the ball bags (facing into the dressing room with the bags to his right), and Prioleau sat on a second chair to Blakeman’s left (facing the same way).
    Thanks, guys, for imparting this critical data on who was sitting next to whom, and what side the bags were on! What, aren’t you going to tell us what color shoes they had on?

    And yet, when it comes to the truly important evidence, like the gauges that each team used to prepare the footballs before the game, the report is inexcusably lacking. Had the teams’ gauges been tested as thoroughly as they should have been, we’d have ironclad insight as to what gauge Anderson used pre-game. This report was carefully written by a team of scientific experts, who work for a multi-million-dollar firm. I refuse to believe that they forgot this huge detail.

    Whether the gauges were found or not, whether they were available for testing or not, this report is grossly incomplete without a thorough discussion of them. The only motive Exponent could have for leaving the teams’ gauges out of the report is that the gauges didn’t support their theory.

    The Wells Report concluded that Anderson used the non-logo gauge. If the measurements from the teams’ gauges supported that idea, Wells and friends would have included this evidence prominently. Instead, they avoided the topic almost completely.
  4. Exponent’s logic does not support their theory. The experiments cited by Wells only prove that Anderson’s non-logo gauge is similar to other non-logo gauges. He does not prove, or even claim, that the Patriots’ gauge is a non-logo gauge. Therefore, these experiments are irrelevant.

Conclusion: Anderson used the logo gauge for the pre-game measurements. We need to explain a PSI loss of 1.01 for the Patriots’ footballs.

There is one matter left to discuss here: The Colts’ game-day gauge. I’m adding it after the conclusion, in case you want to skip directly to Part III. Read on if you’re interested.


Part II B: The Colts’ Game-Day Gauge

First and foremost, there are effectively no mentions of the Colts’ game-day gauge in the entire 243-page report. Nothing in the footnotes, nothing in the Exponent report.

In a sense, the Colts’ game-day gauge is just as important as the Patriots’ in trying to determine which gauge Anderson used for the pre-game measurements. This is because we know that the gauge Anderson used matched both teams’ gauges very closely. Take a look at this chart:


“The Similarity Effect”: Pre-Game PSI Readings from Referee Anderson and Both Teams



A 13.00 on the Colts’ gauge is a 13.00 on Anderson’s gauge. A 12.50 on the Patriots’ gauge is a 12.50 on Anderson’s gauge. In other words, both teams’ gauges read similar to Anderson’s.  And if both teams’ gauges are similar to the same thing, then they must also be similar to each other. Not to traumatize you with seventh-grade math, but:

If A = B, and B = C, then A = C.

Basically, using the above, we can conclude that the Patriots’ and Colts’ game-day gauges read similarly to each other.

Bottom line: if the Colts’ gauge matches the logo gauge, then the Patriots’ gauge matches it too. In the section above, we made a convincing case that the Patriots’ gauge matches the logo gauge, using actual measurements that were taken with each one. But look at this, from page 63:

The [Colts] intern used a digital pressure gauge similar to the gauge used by the Colts to set their footballs before the game, and reported that the pressure [of the D’Qwell Jackson football] measured approximately 11 psi.

Remember, the Patriots’ gauge was used to measure the Jackson ball just before halftime, and the three readings averaged 11.52 PSI. If the Colts’ gauge was used to measure the same ball, and only measured it at 11.00 PSI, we have a discrepancy—and a possible argument that Anderson used the non-logo gauge. After all, the average of the Patriots’ other 11 footballs at halftime was only 11.11 PSI on the non-logo gauge, and the 11.00 figure is much closer to the non-logo average than to the logo average.

I reject this argument for three reasons:


  1. The passage specifically states that the intern’s gauge was “Similar to the gauge used by the Colts”, not that it was the actual Colts’ game-day gauge. If we want to get to the truth of what happened, we need the actual gauges each team used. Not “similar” ones. 
    Yes, I am aware that the “multiple dozens” of non-logo gauges read similarly to one another, according to the Wells Report. But the chart in Appendix I, page 20 (reprinted below) shows that, while
    on average the sample gauges read similarly, individual ones varied as much as 0.65 PSI from one another. Specifically, a “master gauge” was set to 13.00 PSI and was read by 50 of the sample non-logo gauges. The individual gauge readings ranged from 12.55 to 13.20 PSI. In other words, there is no guarantee that two of the exact same gauges will read closely to one another. Besides, we don’t even know that they are exactly the same, just that they are “similar”. There are no further details in the report as to what that means in this context.



  2. The intern said that the measurement was “approximately” 11 PSI. He didn’t provide an exact measurement. “Approximately 11” could mean 10.90, or 11.10, or 11.39. Apparently this intern was not interviewed by the Wells team to provide more specifics, or if he was, it wasn’t discussed in the report. And if he was asked now, I’d be wary about his recollections. We’re more than four months removed from the incident.
  3. Three precise measurements were made on the Jackson football using the Patriots’ gauge. The readings were immediately written down on a piece of tape on the football. We are not relying on approximations, guesswork or memory for these measurements, and these measurements clearly indicate a similarity between the Patriots’ gauge and the logo gauge. I see no justification in throwing this conclusion away because of an estimate taken from a “similar” gauge that wasn’t even used for the preparation of the Colts’ footballs that day.





PART III: Is There a Legitimate Explanation for the PSI Losses in the Patriots’ Footballs?


Here we are, at the dramatic conclusion of our Wells Report odyssey. So far, we’ve determined the following:


  1. Walt Anderson used the logo gauge to measure the Patriots’ footballs before the game;
  2.  The Patriots’ footballs lost an average of 1.01 PSI between pre-game and halftime, as measured by the logo gauge.

Our goal now is to review any legitimate (non-tampering) explanations for a loss of internal pressure in a football, and to determine if those explanations are enough to justify an average loss of 1.01 PSI per football.

Let’s begin by reviewing the readings from the logo gauge, which, as we’ve already established, was (all together now) more likely than not used for the pre-game measurements. Notice that I’ve sorted the pressure readings from lowest to highest:




Again, many of us are not coming to this debate with an open mind and a desire to learn the facts. Many (most?)  of us know what we want or believe the truth to be, and ignore anything that does not confirm our pre-existing point of view. No one is neutral when it comes to the New England Patriots. In a league designed for parity, they’ve been on top for far too long. For better or for worse, they’re under a microscope. I get it. But please, as I introduce a theory or explanation, do your best not to reject it out of hand just because it’s against what you initially believed. Hear me out. Okay?

A case in point is the Ideal Gas Law. Prior to the release of the Wells Report, most of us had never heard of the Ideal Gas Law. Those of us who had heard of it knew that changes in temperature and moisture could easily cause a football to lose pressure when brought from a warm, dry environment (e.g., a locker room) to a cold, wet one (e.g., a football field where it’s raining heavily). It may seem like ancient history now, but getting people to believe this was an uphill battle. There was a lot of skepticism about this law. Many people simply covered their ears and said “La-la-laaaaaa” when confronted with the idea that anything other than a fat guy with a needle could cause a football to lose pressure. Now that it’s been put in writing in the Wells Report and agreed upon by all sides, we’ve apparently cleared that hurdle. Nonetheless, it’s a useful lesson. Keep your mind open, please!

From the Wells Report, Appendix I, pages 39-40:

…using the Ideal Gas Law, or variations thereof, different calculations can be generated on the basis of different assumptions about the starting pressure, and starting and ending temperatures of a football. For example, using the most likely pressure and temperature values for the Patriots game balls on the day of the AFC Championship Game (i.e., a starting pressure of 12.5 psig, a starting temperature of between 67 and 71°F and a final temperature of 48°F prior to the balls being taken back into the Officials Locker Room), these equations predict that the Patriots balls should have measured between 11.52 and 11.32 psig at the end of the first half, just before they were brought back into the Officials Locker Room.

Ah, so now we have our target. Given what we know about the locker room and field temperatures on game day, as well as the starting PSI, the Patriots’ footballs should have measured between 11.32 and 11.52 PSI at halftime. The report goes on to say (Appendix I, p. 40):

Once the game day measurements are converted into their corresponding Master Gauge pressures (in order to provide for a direct comparison with the results predicted by the calculations), the measurements for all but three of the footballs, as measured by both gauges, were lower than the range predicted by the Ideal Gas Law.

What’s a Master Gauge, you ask? Well, according to the Wells Report, it’s simply “A calibrated pressure gauge”. Going back to our bathroom scale example, imagine the Master Gauge as a super-accurate scientific scale which can tell you exactly how much you weigh, as opposed to your regular bathroom scale, which might be off by 3/10 of a pound or so.

The Wells Report was even kind enough to provide a formula to convert logo and non-logo readings to a Master Gauge pressure. I won’t torture you by reprinting it here, but if you’d like to take a look at it, it’s on page 28 of Appendix I.

Let’s take a look at the Logo and Non-Logo (non-converted) halftime readings from both the logo and non-logo gauges, to see how many fall into the expected range predicted by the Ideal Gas Law:


Halftime PSI Readings Compared to Expected Ranges
Green = within / above expected range, Red = below expected range



How interesting is this? Using the Wells’ Reports own calculations, only three of the Patriots’ footballs are below the minimum PSI level expected by the Ideal Gas Law on the logo gauge! What’s more, the three that are below this level are only short by 0.12, 0.32, and 0.42, respectively. Are we now saying that Jim McNally only tampered with three footballs, and even then only took tiny amounts of air out of each?

We’ll get back to this in a moment, but for now, I’m getting a bit ahead of myself. If we look at the non-logo side, it is true that all but three of the balls are below the range expected per the Ideal Gas Law. However, this is really just a case of Exponent’s previous mistake coming back to haunt them.

Exponent calculated the expected PSI levels using a beginning pressure of 12.50. But, as we’ve established at length, a 12.50 on the logo gauge is not a 12.50 on the non-logo gauge; it’s only a 12.12. With this corrected value in hand, let’s go to our handy-dandy Ideal Gas Law calculator and plug in the relevant figures. Once we do this, we find an expected PSI value of 11.05. There is a margin of error of +-.10 on this calculation, which means that our actual expected range is 10.95 – 11.15. Let’s take another look at the pressure levels using this range:


Halftime PSI Readings Compared to Expected Ranges
Green = within / above expected range, Red = below expected range, Yellow = less than 0.075 below expected range



Well, well, well. What do you know? Once we correct for Exponent’s logo / non-logo error, things look a lot more consistent! Yes, there are still four balls below the expected range on the non-logo side, but the four are only off by 0.05, 0.10, 0.25, and 0.45 respectively.

I couldn’t bring myself to use red for Patriots’ ball #11. Seriously, guys, if you want to use 5/100th of a pound of air as proof of cheating, you’ve lost me. The figures that went into these calculations were estimates based on best guesses of the conditions that day. They weren’t exact, and we shouldn’t assume that these target ranges are, either.

Another thing you may have missed: The logo and non-logo gauge readings always end in multiples of .05. Look again at the chart above. Every gauge reading ends in 5 or 0. I’m not talking about the averages now, just the readings. Clearly the gauges are rounding to the nearest .05—so for all we know, Patriots ball #11 might only be off by .03 or .04 instead of .05. At any rate, anyone looking for proof of football tampering will need to look elsewhere from ball #11.

Next, let's convert the halftime PSIs to the Master Gauge values, so we can check Wells’ conclusion that all but three footballs were below range on both gauges when using Master Gauge figures. This will be especially useful since, believe it or not, Exponent did not provide a table for these calculations in their report.


Halftime PSI Readings, Converted to Master Gauge Values
Green = within expected range, Red = below expected range




Well, I’ll be dipped in doo-doo and rolled in sprinkles! It’s just like the Wells Report said! Once we convert to the Master Gauge figures, all but three Patriot footballs are below the expected range per the Ideal Gas Law! On both gauges, no less!

Everybody say it with me now: CHEATERS! CHEATERS! BELICHEAT! CHEATRIOTS!

Let’s go round up a couple hundred friends, light some torches, smoke Tom Brady out of that fancy mansion of his, and teach him what the integrity of the game is all about!

…Actually, guys, you might want to slow your lynch-mob roll for a minute. Put your nooses down and take a deep breath.

I’m afraid Exponent has screwed up again.

Look back at the quote from Appendix I, pages 39-40 of the Wells report copied above. Exponent took a starting PSI of 12.50, plugged it into the Ideal Gas Law calculator (along with the other required information), and found a target PSI range of 11.32 – 11.52. They then compared that range to the figures shown above, and found that most of the Patriots’ balls were lower than they should have been. There’s just one teensy problem with this.

A starting PSI of 12.50 is not a 12.50 on the Master Gauge. It’s 12.17, per the Wells Report’s own formula. And if we plug that number into the Ideal Gas Law calculator, we get an expected range of 11.00 – 11.20.

Of course, if Exponent made this mistake on the logo side, they must have made it on the non-logo side as well. As we know, a 12.50 on the logo gauge is only a 12.12 on the non-logo gauge. And if we convert 12.12 to the Master Gauge, we get 12.08. Plug that into the Ideal Gas Law calculator, and we’re looking for a range of 10.92 – 11.12.

Now, let’s take another look at the table, this time using the correct figures for expected PSI. I also added the converted Master Gauge figures for you, since Exponent apparently forgot to do so.

Halftime PSI Readings, Converted to Master Gauge Values
Green = within expected range, Red = below expected range, Yellow = 0.075 or less below expected range

(click for enlarged view)

How do you like them apples? Once we correct Exponent’s starting PSI errors, the Master Gauge numbers agree almost exactly with the logo / non-logo numbers!

As a matter of fact, the Master Gauge is actually a bit more favorable to the Patriots than the logo / non-logo gauges are. The three footballs that are below expected limits are only off by 0.06, 0.25, and 0.35 PSI, respectively, on the logo gauge side. Remember, the non-logo gauge really isn’t too relevant, except for comparison purposes, since we now know that Anderson used the logo gauge.

So far, all we’ve had to do is fix the mistakes in the Wells Report, and there are only two Patriot footballs left that fall more than 0.075 PSI below the expected limits per the Ideal Gas Law. But we’re not done yet: We still have to explain why, on average, the Patriots’ balls lost more pressure than the Colts’ balls did.

Recall from our PSI loss table that the Patriots’ footballs lost an average of 1.01, while the Colts’ balls lost 0.35. Subtract one from the other, and we have 0.66 in unexplained pressure loss for the Patriots’ footballs. How could it possibly be that one team’s balls lost so much more than the other team’s, assuming that all other factors are equal?

Ah, but there is the problem… assuming that all other factors are equal. According to wellsreportcontext.com:
The Patriots had the football on offense for the last 4:54 of the first half (except for the last 9 seconds when Andrew Luck took a knee) — i.e., just before the footballs came in for halftime measurements, the Patriots footballs were being used while the Colts footballs were being held in trash bags. The Patriots ball boys did not use bags, thereby exposing the footballs more to the rain. 
This one simple statement, if true (and I’ve heard no one dispute it), blows the Wells Report’s assumptions out of the water. The Wells report decided that the Colts’ footballs could be used as a “control group”, meaning that they were exactly like the Patriots’ footballs in every way. Merely being in the same stadium and on the same field does not mean that every single condition is exactly the same for all the footballs. If one team’s balls are in a bag, dry and protected from the elements, and the rain is pouring down on the other team’s footballs, then obviously, the conditions aren’t the same, and we shouldn’t assume otherwise. Lower temperatures and added moisture cause additional PSI losses, and if the other team’s footballs are not exposed to those same conditions, then yes, one team’s balls will lose more pressure than the other’s.

This is not a zero-sum game. We don’t have to find one single factor to account for the whole discrepancy. My guess is, it was a collection of small things, including, for example, the timing of the measurement of the footballs at halftime.

As we all know by now, the officials brought all the balls to the locker room at halftime, developed a procedure to measure and document each football’s PSI with both of Anderson’s gauges, tested each ball individually, then refilled any that were below 13.00 and retested them. While all this was going on, the Colts’ footballs were steadily acclimating to the higher temperature in the locker room—and gaining PSI by the minute.

Per the Wells Report, the footballs were inside the locker room for a total of about 13.5 minutes during halftime. Also per the Wells Report (p.71), the measuring, refilling and retesting of the Patriots’ balls took between eight and 14 minutes (the latter of course is not possible, since the balls were not in the locker room for that long). This estimate breaks down as follows:

2-4 minutes to develop testing procedure
4-5 minutes to test pressure on 11 Patriot footballs
2-5 minutes to inflate Patriot footballs and recheck

Since, according to the Wells Report (Appendix II) it requires a maximum of 71 seconds for a man to take 13 footballs out of a bag, deflate them with a needle, then put them back into the bag, I’d say it’s more than plausible that two officials could check the pressure on four Colts footballs in one minute. This being the case, measurement of the four Colts footballs didn’t start until about 12 minutes into halftime.

This means that, as soon as two minutes after the start of halftime, Patriots balls were being measured—a full 10 minutes before anyone even looked at the Colts’ footballs. Certainly, both teams’ footballs were gaining pressure throughout their time in the locker room. And certainly, the Colts’ footballs gained more pressure than the Patriots’ did, simply because the Colts’ balls stayed in the locker room for far longer before being measured. This is not up for debate. The Wells Report agrees, but says, (p.43):

…the timing of the measurements taken during halftime of the AFC Championship Game does not on its own completely account for the difference in the observed average pressure drops between the two teams.

“On its own”, it does not “completely account for the difference”. So this means that it does account for part of the difference! But how much? We only need to explain a difference of 0.66 PSI here, remember, and if the timing issue accounted for, say, 0.50 of that, then no, it would not technically account for the whole difference. But it would account for most of it. How interested would anyone be in dishing out major punishments over a PSI discrepancy of 0.16?

The passage above really makes me think. Here we have a clearly-identified issue which undisputedly would cause a differential in PSI losses between the two teams’ balls—the exact kind of discrepancy we are looking for—and the Wells Report effectively says, “Well, yeah, but that doesn’t explain all of the difference!” Okay, fine—so how much of the difference does it explain? No matter how hard I look, I find no answer to this question in the Wells Report. Surprised?

Now that I think of it, I also can’t find a final tally in the Wells Report which shows exactly how much pressure was lost due to all known factors, and exactly how much pressure loss is left unexplained. As we’ve come to learn, when something obvious is missing from the Wells Report, there always seems to be a reason for it. In this case, I’m thinking that, once we deduct this timing differential, once we have a complete, honest final calculation, there won’t be enough of a discrepancy to justify any punishment. So Exponent left it out.

Having said all this, I still would really like to know exactly how much of a PSI loss discrepancy there was between the teams due to the timing issue. Let’s tackle that together—but before we do, there’s a bit of a problem with the way this entire issue is framed.

When the footballs were out in the cold and the rain, they were both losing pressure. When they were brought back inside, they were both gaining pressure. Because the Colts’ footballs sat for as much as 10 minutes longer than the Patriots’ did before being measured, they gained more pressure. Why are we all so sure the differences are due to somebody reducing the pressure in the footballs manually? Couldn’t the differences be attributed to one set of footballs gaining more than another due to natural causes?

With that in mind, here’s a little exercise I devised to find out how much pressure each team’s balls gained after being brought in to the locker room during halftime.
I started with what I know:

  • The footballs were on the field, where it was approximately 48 degrees, just before halftime;
  • They were then brought to a locker room, where it was between 72 and 74 degrees;
  • The footballs warmed gradually after being brought in;
  • If I know a starting (conclusion of first half) temperature, an ending (halftime measurement) pressure, and an ending PSI, I can use the Ideal Gas Law to determine the starting pressure of a football;
  • If I know the starting and ending pressure of a football, I can find out how much pressure each football gained after being brought in for halftime.
According to Appendix I, page 44, Figure 22, Exponent determined that the Patriots' footballs would have returned to their pre-game state of 12.50 PSI by the end of the 13.5 minute halftime period. Since the balls were checked in the shower area of the officials' locker room, which was 67-71 degrees, we can split the difference and assume that the balls were at 69 degrees after 13.5 minutes, for a warming rate of 1.56 degrees per minute.

As you can see in the table below, I assumed a starting temperature of 52.68 degrees for the first Patriot football, which was calculated based on the Wells Report's finding that measurements started within 2-4 minutes of the start of halftime.

Also according to the Wells Report, the measurement of the Patriots' footballs took 4-5 minutes, so I split the difference and assumed that it was 4.5 minutes. Also, Wells' estimate was that the refilling of the Patriots' footballs required 2-5 minutes. Normally, I'd split the difference once again and go with 3.5 minutes, but that would bring us to a total of 11 minutes, and I believe that the Colts' footballs were measured at the 12 minute mark, for reasons you will understand in a moment, so I went with 4.5 minutes for the refilling.

According to Appendix II of the Wells Report, a man can enter a bathroom, open a zippered bag, dump out 13 footballs, deflate each of them using a needle, then repack the balls and leave the bathroom in as little as 61 seconds. So I figure that, if a man can do all that in a minute, then surely two officials can check the pressure on four footballs in a minute too, since halftime was ending and they were in a hurry. I therefore assumed that the measurement of the Colts' footballs began at the 12 minute mark and continued for one minute, at which point the two officials packed up the balls and sent them back on to the field. This would match the Wells Report's contention that the balls were in the locker room for 13.5 minutes.

Of course, it is true that the temperatures are estimated, and I list the balls in order by number, even though weren’t necessarily measured in that order. What I was trying to capture is that the Patriots’ footballs would have had moderate gains, while the Colts’ gains would have been much larger.

Feel free to double-check any of my calculations using the IGL Calculator, making sure to use 48 degrees as a starting temperature, and the Est. Temp at Measurement value from the table for the final temperature.


Locker Room PSI Gains – Halftime


Interesting, no? Looks like our differential is right around the 0.66 we’re looking for!

I’m sure we could debate what the most likely temperatures were at each measurement. Of course, no one took the footballs’ temperatures before they measured them. But the one point we can all agree on is that the balls’ temperatures were rising slowly. We could also debate which balls were most likely to have been measured when.

The point is, if you’re a Wells supporter, you are now the one with a huge discrepancy to explain away. Can you tweak the temperatures and order of the footballs enough to make 0.59 go away? I doubt it—but please let me know if you can. Otherwise, I’d say this mystery has been solved.