(Roughly) Daily

We’ve looked at methodical problems in scientific and medical research before (see here, here, and here). Let us turn now to outright dishonesty. The rising number of retracted research papers suggests that either medical research fraud is on the rise or that efforts to spot it are getting better. Either way, it’s a problem …

… Partly or entirely fabricated papers are being found in ever-larger numbers, thanks to sleuths like Dr Mol. Retraction Watch, an online database, lists nearly 19,000 papers on biomedical-science topics that have been retracted (see chart 1). In 2022 there were about 2,600 retractions in this area—more than twice the number in 2018. Some were the results of honest mistakes, but misconduct of one sort or another is involved in the vast majority of them…

… Yet journals can take years to retract, if they ever do so. Going by these numbers, roughly one in 1,000 papers gets retracted. That does not sound too bad. However, Ivan Oransky, one of Retraction Watch’s founders, reckons, based on various studies of the matter and reports from sleuths, that something more like one in 50 papers has results which are unreliable because of fabrication, plagiarism or serious errors…

… It is often asserted that science is self-correcting. And it is true that, if a claimed result is important enough, an inability to replicate it or of subsequent work to conform to it will eventually be noticed. In the short term, though, it is easy to hide in the shadows. Even co-authors of a data-fabricating scientist—those, in other words, who are closest to him or her—may not notice what the culprit is up to. In complex studies of a particular disease, several types of researchers will be involved, who are, by definition, not experts in each other’s fields. As Dr Bishop observes, “You just tend to take on trust the bits of data that somebody else has given you.”…

In the end, however, keeping fakes out of the scientific record depends on the willingness of publishers to stump up more resources. Statistical checks of clinical-trial papers often involve laborious manual work, such as typing up specific data in spreadsheets. This would require journals to hire dedicated staff, cutting into profits.

Many academics who have spent years trying to get fabricated papers retracted are pessimistic that better ways to detect fraud will, alone, make a big difference. Dr Roberts and Dr Mol want journals to be regulated in the way that social media and the news business are in some countries, with standards on what they publish. Peter Wilmshurst, a British cardiologist who has raised the alarm about numerous cases of research misconduct in his field, thinks there should be criminal penalties for those who fabricate data. Dr Gunsalus wants universities to make public the reports from their research-fraud investigations. And everyone agrees that publish or perish is a recipe for disaster.

None of these solutions will be quick or straightforward. But it is now clear that choosing to look the other way is causing palpable harm to patients…

“There is a worrying amount of fraud in medical research- and a worrying unwillingness to do anything about it,” from @TheEconomist.

* Stuart Ritchie, Science Fictions

###

As we look harder, we might spare a thought for Alfred Habdank Skarbek Korzybski; he died on this date in 1950. Trained as an engineer, he developed a field called general semantics, which he viewed as both distinct from, and more encompassing than, the field of semantics. He argued that human knowledge of the world is limited both by the human nervous system and the languages humans have developed, and thus no one can have direct access to reality, given that the most we can know is that which is filtered through the brain’s responses to reality. (Korzybski assumed that the quest for knowledge was an authentic, honest one; that said, if “human nervous system” an be understood to extend to “human nature”…)

Korzybski was influential in fields across the sciences and humanities through the 1940s and 50s (perhaps most notably, gestalt therapists), and inspired science fiction writers (like Robery Heinlein and A.E. van Vogt) and philosophers like Alan Watts.

His best known dictum is “The map is not the territory.”

source