(Roughly) Daily

“The first principle is that you must not fool yourself – and you are the easiest person to fool”*…

Close-up of multiple petri dishes filled with reddish liquid, reflecting a scientist's face. The background is softly blurred, emphasizing the petri dishes.

We live in a time when a growing number of “authorities” in the U.S. and around the world are actively trading fact for convenient fiction. Science is under attack; there’s (all-too-grounded) concern that we may be headed into a new “Dark Age.”

C. Brandon Ogbunu pushes back, arguing that science– and more particularly, the emerging research field of metascience, a form of scientific self-examination– is essential for navigating our uncertain future…

On May 24, Vice President J.D. Vance authored a post on X that highlighted a “reproducibility crisis” in the sciences. Vance offered this amid a series of other critiques of higher education to justify the withholding of federal science funding to universities over the past several months. His post was timed to accompany a White House executive order that invoked the language of open science to introduce sweeping changes to our federal scientific infrastructure. It came just weeks after the release of plans to cut science funding in the 2026 fiscal year budget.

The playbook is standard: Fuse an aggressive political agenda to a more palatable set of criticisms. In this case, many agree that processes within professional science have, for decades, had significant flaws. In my view, politicians in power are using this as a justification to burn it down. And outside of a few higher-education legal efforts to fight back, the scientific community remains shell-shocked, unable to gather the momentum to resist effectively.

But in addition to resisting the changes, there might be other ways that we can navigate an uncertain future. In recent years, a field called “metascience” (often referred to as “the science of science”) has emerged, charged with understanding the processes of science, how it operates, and identifying themes in what is produced. I argue that this area is going to be essential moving forward in stormy times, as it can dispel the myth that science is an ideological leviathan incapable of self-reflection and can help us rebuild science into a craft that interrogates its fragilities.

As described in a 2018 review, the science of science “is based on a transdisciplinary approach that uses large data sets to study the mechanisms underlying the doing of science—from the choice of a research problem to career trajectories and progress within a field.” It asks questions about aspects of the scientific enterprise, including employment, publishing trends, economic incentives, merit, and other forces that influence science in ways that may escape our intuition…

[Ogbunu explains metascience, and explores examples of work-to-date and questions like: Who is doing science? What are their incentives (and how do they shape behavior)? How innovative is science? He reminds us that “metascientists” are following in the footsteps of humanists and social scientists (Bruno Latour, for example) have examined science practice for many decades…]

… metascience offers a lens that is especially important at this critical moment. Support for science in the face of attacks is critical and necessary. But ironically, one of the best ways to defend the craft might be for scientists to identify the fragilities before the enemy does. We can use data and models, not solely our op-ed voices and social media timelines (though all can be useful). The field is already disabusing us of the notion that science as practiced is based on defensible incentives, neutrality of any kind, or merit, however defined.

Instead, it operates on what looks more like a runaway Matthew Effect, whereby the most established scientists benefit disproportionately from the system of reward — and thus the rich get richer. And the problem isn’t that the flaws exist, but that science’s practitioners aren’t interested in a critical lens towards them.

Metascience won’t fix our problems, but it formalizes ways that we can use to reflect, which may implore us to change science for the better…

Physicians (and other scientists) healing themselves: “Metascience Is More Important Now Than Ever,” from @cbo.bsky.social in @undark.org.

Richard Feynman

###

As we commit to comprehension, we might send insightful birthday greetings to a forefather of metascience, Charles Sanders Peirce; he was born on this date in 1839. A scientist, mathematician, logician, and philosopher, he was (per philosopher Paul Weiss) “the most original and versatile of America’s philosophers and America’s greatest logician”. Bertrand Russell wrote “he was one of the most original minds of the later nineteenth century and certainly the greatest American thinker ever.” He is considered by many to be “the father of pragmatism“; he helped formalize the field of statistics; and his contributions logic were foundational– helping to found semiotics (the study of signs).

For Peirce, logic encompassed much of what is now called epistemology and the philosophy of science. Peirce approached science as a practice, defining the concept of abductive reasoning to explain scientific advance, as well as rigorously formulating mathematical induction and deductive reasoning.

Black and white portrait of Charles Sanders Peirce, featuring a man with a prominent beard, wearing a dark suit and patterned tie, with a serious expression.

source

Discover more from (Roughly) Daily

Subscribe now to keep reading and get access to the full archive.

Continue reading