Friday, May 25, 2018
Perspective

In all probability When the numbers crunch

Let's say a friend has the world's biggest jar and fills it with 300 million marbles, a mix of red and blue, and wants you to guess the proportion of each. How many would you need to count to be pretty sure you knew the answer? Believe it or not, only 800 or so would do the trick — if you plucked them at random from throughout the jar. That's how the math of probability works. And that is the basis behind modern presidential polling.

. It gets trickier when you're dealing with people instead of marbles, of course, and when it's the population of the United States. You still need only 800, but how do you reach them — by land line, by cellphone, text message, carrier pigeon? — and how do you know you've collected a representative sample? How likely is it that a person who is registered to vote is actually going to vote? And what of those who refuse to answer? When Pew Research called up people 15 years ago, nearly four in 10 answered. This year? Not even one in 10.

. None of this has changed the laws of probability. Rather, it has just made them harder to put into practice. And it makes modern polling both art and science. The lesson of this year's election is that polls actually worked pretty well as a group, but that it was dangerous — and the rules of probability back this up — to make too much of any one poll. As statisticians put it, it's important to separate the signal from the noise. And any one poll, no matter how well designed, could be "noisy," because that's just how statistics work. Better to look at a group of polls over time and not to make too much of any one.

. By now, you've no doubt heard of Nate Silver, at right, and his FiveThirtyEight blog at the New York Times. (His work has been featured in our Saturday "Reading File.") A former professional poker player, he is a nerd who made a name for himself by devising a statistical system to analyze professional baseball, and then by working out a system to assess political races. He was right in 2008, and he was dead on again this year. All campaign season, and against the pushback of pundits, Silver's number-crunching of Big Data said that President Barack Obama was the favorite. He didn't say Obama would win the vote by a huge amount or that Mitt Romney had no chance, just that the probability of an Obama victory was high. He took all of the polls, particularly state polls, plugged them and other data into his algorithm — a formula — and let his computer chug away. He didn't rely on his gut instinct but on pure data. This chart shows his calculations of popular vote for president throughout the campaign season. Read him at fivethirtyeight.blogs.nytimes.com. His book is The Signal and the Noise.

After both political conventions but before the first debate — the president's debacle in Denver — Silver's numbers, below, showed Obama beginning October at 51.5 percent to Romney's 47.4. After Romney's strong debate performance on Oct. 3, Silver's numbers on Oct. 12 showed the race as tight as it ever would be, with Obama at 49.9 to Romney's 49.1. Afterward, pundits kept talking about Romney's building momentum right up to and even after Hurricane Sandy. Silver's formula — in other words, the numbers — simply wasn't showing it. Romney would never again come so close.

. The numbers guys: Although Nate Silver has been dubbed king of "the Quants" — so-called because they quantify terabytes of information on the polls to arrive at their conclusions — there are other practitioners, among them Drew Linzer at Emory University (Votamatic.org) and Sam Wang, at the Princeton (University) Election Consortium (election.princeton.edu).

Different samples, different results

Here are samples of some national and Florida polls. Note that as different as they are — most obviously when they disagreed on who was ahead, including our own that oddly pointed to a big Romney lead in Florida — they all reveal similar trends: that Obama held a lead in September, that Romney's percentages improved after the first debate, and that Obama's numbers improved just before the election.

National polls

Gallup

Sept. 5-11: Obama 50, Romney 43

Oct. 3-9: Obama 48, Romney 48

Oct. 11-17: Romney 52, Obama 45

Nov. 1-4: Romney 49, Obama 48

Pew

Sept. 12-16: Obama 51, Romney 43

Oct. 4-7: Romney 49, Obama 45

Oct. 24-28: Romney 47, Obama 47

Oct. 31-Nov. 3: Obama 48, Romney 45

Wall Street Journal/NBC News

Sept. 18: Obama 50, Romney 45

Oct. 2: Obama 49, Romney 46

Oct. 20: Obama 47, Romney 47

Nov. 4: Obama 48, Romney 47

Florida polls

Times/Bay News 9/Herald

Sept. 17-19: Obama 48, Romney 47

Oct. 8-10: Romney 51, Obama 44

Oct. 30-Nov. 1: Romney 51, Obama 45

Rasmussen

Sept. 12: Obama 48, Romney 46

Oct. 11: Romney 51, Obama 47

Oct. 26: Romney 50, Obama 48

NBC/WSJ/Marist

Sept. 13: Obama 49, Romney 44

Oct. 9: Obama 48, Romney 47

Nov. 1: Obama 49, Romney 47

Comments
The real stuff is how Tom Wolfe best used his write stuff

The real stuff is how Tom Wolfe best used his write stuff

Tom Wolfe’s best writing lifted real people into legend: car designers and astronauts and disciples of LSD. With that writing, Wolfe lifted himself into legend as well. The author of 16 books, including such bestsellers as The Right Stuff and ...
Published: 05/18/18
Oh, Florida! Without air conditioning we’re a stinky swamp of sweat. With it, we warm the world

Oh, Florida! Without air conditioning we’re a stinky swamp of sweat. With it, we warm the world

As I write this, some workers are disassembling the 24-year-old air conditioning system in my house. They’re clunking and clanking around, tromping up and down my stairs, so they can replace the old system with a new one that presumably wonR...
Published: 05/17/18
Updated: 05/18/18
PolitiFact: Is Mike Pence right that religion is gaining new life in U.S.?

PolitiFact: Is Mike Pence right that religion is gaining new life in U.S.?

Speaking at a commencement ceremony at Hillsdale College in Michigan, Vice President Mike Pence told the graduates that religion in the United States is going strong."The percentage of Americans who live out their religion on a weekly basis ó praying...
Published: 05/17/18
Updated: 05/18/18
Column: Why baby steps toward cheaper drugs are the best we can do

Column: Why baby steps toward cheaper drugs are the best we can do

On the stump, Donald Trump the candidate promised big changes in the way America buys prescription drugs ó allowing Medicare to negotiate drug prices directly with pharmaceutical manufacturers, and allowing Americans to buy at the prices that Canada ...
Published: 05/15/18
Updated: 05/18/18
PolitiFact: Can Robert Mueller subpoena Donald Trump? A look at the legal precedents

PolitiFact: Can Robert Mueller subpoena Donald Trump? A look at the legal precedents

President Donald Trump has said heíd "love to speak" to special counsel Robert Mueller but that some of his lawyers advise against it.The latest member of Trumpís legal team, Rudy Giuliani, said Trump is under no obligation to comply with a subpoena ...
Published: 05/09/18
Updated: 05/13/18

Column: Moms looking out for daughters who need special medical treatment

Five years ago, shortly after celebrating Motherís Day, my mom watched as her oldest child was wheeled into brain surgery to undergo a procedure to help cope with the symptoms of early Parkinsonís disease. The operation, known as Deep Brain Stimulati...
Published: 05/09/18
Updated: 05/13/18
Column: As the last Rosewood survivor dies, letís remember our duty to address injustice

Column: As the last Rosewood survivor dies, letís remember our duty to address injustice

Mary Hall Daniels was a child of 3 when a white mob destroyed her home and the predominantly African-American community of Rosewood in Levy County in 1923. The last survivor of what came to be known as the Rosewood massacre, Mrs. Daniels died on May ...
Published: 05/08/18
Updated: 05/13/18
Perspective: Let’s build a ‘house’ for Kerouac in St. Pete ... (no not that one)

Perspective: Let’s build a ‘house’ for Kerouac in St. Pete ... (no not that one)

Over my writing desk is a pop-art image of Jack Kerouac. He is so handsome. In purple, orange, and shades of green, it shows him in his prime, a typewriter in the corner and his words about the people he loves, the ones who "burn, burn, burn like fab...
Published: 05/07/18
Updated: 05/13/18
Five interesting facts

Five interesting facts

$171.5 millionis how much drug makers spent lobbying the federal government last year, more than any other industry.Just 36%of Republicans last year thought free trade had been good for the United States, down from 57 percent in 2009, according to th...
Published: 05/07/18
Updated: 05/13/18
A Little Perspective: Interesting news and notes from around the world

A Little Perspective: Interesting news and notes from around the world

Another state has joined the National Popular Vote Interstate Compact, bringing electoral reformers closer to their goal of sidestepping the Electoral College to elect presidents by a nationwide popular vote instead. Under the compact, states pledge ...
Published: 05/03/18
Updated: 05/13/18