Statistical controversy is no crime
Let’s start with a statistical discussion around safety: So who is lying to us?
Vice President Harris assures us that we are safer now than when she took office. National Public Radio tells us that “Violent crime is dropping fast in the U.S. — even if Americans don’t believe it.”
But the director of the Crime Prevention Research Center says not to believe believe media reports that crime is declining, and statistics from the Department of Justice’s Bureau of Justice Statistics appear to support him. From 2019 to 2023, violent crime victimization increased by more than 20 percent, excluding simple assault.
At our cultural moment of distrust, it sounds as if the phrase popularized by Mark Twain more than a century ago remains as accurate today: “Lies, damned lies and statistics.” Reflexively, we interpret conflicting statistics as clear evidence of a statistical lie. But is that go-to interpretation always or even usually warranted?
As with language, people can use statistics to mislead. However, statistical controversy does not imply a statistical crime. Collecting data and summarizing them with statistics is less straightforward than many believe. It involves overcoming inherent measurement challenges and myriad practical and conceptual judgments that people can and should debate.
Choosing which statistic to emphasize in reporting requires further judgment. I should know: I’ve seen the statistical sausage from pig to table, having collected data from farmers in the field, cleaned it in a federal statistical agency, and interpreted it in White House policy debates.
Imagine trying to measure the prevalence of crime. One approach is to measure crimes reported to law enforcement, the basis of FBI crime statistics. This tacitly overlooks the large and significant percentage of sexual or domestic assaults, for instance, that go unreported.
Another approach is to survey people and ask if they have been the victim of a crime, which is what the Bureau of Justice Statistics does. If we resolve all the practical data collection quandaries, we still face hard conceptual and often moral questions. What constitutes a crime? What crimes matter most? And which should we include in the statistic to answer questions such as whether we are safer now than before?
Similar practical and conceptual challenges arise when measuring other issues of public concern such as poverty and unemployment. For example, when determining whether someone is in poverty, should we treat the value of housing vouchers and Medicaid benefits as income? The answer matters, since the inclusion of such benefits yields much lower poverty rates.
For unemployment, should we count as unemployed people who recently gave up looking for work? How do we treat those working minimal hours, who would like to work more but have not found the opportunity? People can provide different answers with good reasons behind them, all of which are healthy to debate publicly.
Lively public debate can reflect a healthy desire to verify that the statistics support the stories told through them. FBI crime data capture a minority share of the crime that occurs, so it is good to ask whether crime is really falling, or we truly have a crisis.
Woe to us if we collectively stop asking what’s really happening and how do we know. If we do stop asking, we will ignore serious problems and instead waste attention and money on phantoms.
We should expect politicians and advocacy groups to report statistics with partiality, selecting and amplifying only the ones that tell the good story and advance their agenda. We should see these people more as trial lawyers whom we know will selectively present evidence supporting their client’s interests. Journalists and academics play different roles, and we should expect and demand more evenhandedness and explanation from them.
The closer we get to statistics and their construction, the messier they look, but keep in mind TINAS: There Is No Alternative to Statistics. Yes, journalists can drop them from their articles, and politicians drop them from their speeches. But don’t expect them to drop their statistical-like claims.
They will still claim that something is rising or falling, common or rare, a crisis or not. They will still claim that illegal immigration is surging or that we’re safer than before. The claims are statistical in nature and are better anchored to actual statistics: summaries of systematic measurements of people crossing the border or being robbed.
Lively discussions about the accuracy of our statistics are better than discussions about anecdotes alone, and far better than no discussion at all.
Jeremy G. Weber is a professor at the University of Pittsburgh Graduate School of Public and International Affairs and author of Statistics for Public Policy: A Practical Guide to Being Mostly Right (or at Least Respectably Wrong), University of Chicago Press.
Date: |
-
World - The Guardian
The Crime Is Mine review – François Ozon’s 1930s crime comedy is a moreish crowdpleaser
Ozon and a stellar cast serve up an entertaining, if shallow caper that shades a little too close to #MeToo. François Ozon has directed plenty of complex, demanding and serious dramas: Everything ...11 hours ago -
Politics - The Hill
UN anti-cybercrime treaty could make journalism a crime
Critics argue that the vagueness of the treaty’s language, along with its deference to national laws creates a new vector for transnational repression.Yesterday - United Nations -
Politics - The Hill
New York City offices of Mediaite, Law and Crime Network robbed
The New York City offices of Mediaite and Law & Crime Network were robbed over the weekend, the outlets reported Wednesday. Calling it "one of the most meta crimes ever committed" in a story on the ...Yesterday - New York -
Sports - Yahoo Sports
Canadiens: Bergevin's Controversial Call About Jean Béliveau
Marc Bergevin's reign at the helm of the Montreal Canadiens had its ups and downs but one particular call was puzzling to say the least.4 days ago -
Top stories - BBC News
Actor says Trump 'should be grateful' for controversial film
The Apprentice, which focuses on Trump's early years as a real estate tycoon, is released this week.Yesterday - Donald Trump -
Top stories - CBS News
Massachusetts restaurant threatened after Nazi uniforms controversy
A Hudson, Massachusetts restaurant apologized for serving World War II reenactors dressed as Nazis. Then the threats came.Yesterday -
Top stories - ABC News
Georgia judge invalidates more controversial election rules
A Georgia judge determined that seven new rules passed by the GOP-controlled state election board were "unlawful and void."17 hours ago -
World - The Guardian
Italy sends first asylum seekers to Albania under controversial pact
Men from countries deemed safe are transferred to Albania to have asylum claims processed . The first people to be intercepted at sea by the Italian navy under a controversial migration deal with ...2 days ago -
World - The Guardian
Donald Trump pens 1am screed against controversial biopic The Apprentice
Former president calls film about his rise in real estate in 1970s and 80s a ‘politically disgusting hatchet job’. Donald Trump railed against a just released biopic about his life in a social ...3 days ago - Donald Trump
More from The Hill
-
Politics - The Hill
12:30 Report — Everyone claims victory in Harris’s Fox interview
{beacon} 12:30 REPORT Happy Thursday! Halloween is creeping up. What do you think will be the most popular/timely Halloween costume based on pop culture this year? An "SNL" Domingo bridesmaid would ...45 minutes ago -
Politics - The Hill
Hamas leader Yahya Sinwar likely killed in Israeli operation
Yahya Sinwar, the head of Hamas and the architect of the Oct. 7 terrorist attack on the country, was likely killed on Thursday during an Israeli military operation in the Gaza Strip. NewsNation ...49 minutes ago - Israel -
Politics - The Hill
Biden is letting Israel and Ukraine call the shots
The U.S. is a superpower seemingly stripped of agency.58 minutes ago - Joe Biden -
Politics - The Hill
US unveils sanctions tied to Russian drone attacks in Ukraine
The Treasury Department announced Thursday it was imposing sanctions for the first time on Chinese entities directly developing and producing drones that Russia is using in Ukraine. “Russia ...1 hour ago - Ukraine -
Politics - The Hill
More than 600K ballots cast in Georgia early voting
Georgia residents are casting early voting ballots in record numbers with over 600,000 votes recorded as of Wednesday, according to the office of Georgia's Secretary of State. “As of 3:30pm we have ...1 hour ago