(Roughly) Daily

Posts Tagged ‘academic communications

“Science is a cooperative enterprise spanning the generations… a community of minds, reaching back to antiquity and forward to the stars”*…

The sharing of experimental results and the underlying data is critical to the advance of science. Indeed, when I had the chance to do a scenario planning exercise with a collection of the leading research university librarians in the U.S. a couple of decades ago, the biggest threat/fear they surfaced was the concern that the free and open exchange of ideas and data, as manifest formally in scientific publication and informally in the collegial cooperation among scientists, would be occluded by an increasing proprietary embrace of knowledge.

73% of geneticists surveyed in an article in the 23/30 January 2002 issue of the Journal of the American Medical Association agreed that although keeping data private may help the individual researcher, data hoarding is detrimental to the progress of science Still, sadly, that threat has grown since the turn of the millennium.

By way of current (and dramatic) example: as Celina Zhao reports, more than half of AI “unicorns” have never published a paper or preprint…

Today’s biggest artificial intelligence (AI) startups make no shortage of bold promises. Their technologies, some boast, will revolutionize software development, drug discovery, and scientific research.

Yet a new preprint posted on 16 July on bioRxiv suggests many of these firms barely participate in one of science’s most fundamental practices: publicly documenting discoveries in scientific literature so other researchers can evaluate and build on them. More than half of AI unicorns—private companies valued at more than $1 billion—have never played a leading role in publishing a scientific paper or preprint, according to the new analysis. Collectively, they accounted for just one in every 1000 AI papers published in 2025.

“For a field that is supposedly reshaping science and is so advanced in terms of scientific potential, not having any scientific documentation seems like a very weird paradox,” says paper co-author John Ioannidis, a metascientist at Stanford University [see here]. “How can you judge that what they say is real, validated, and reproducible?” The scarcity of publications, others say, also makes it harder to assess AI’s social impacts, including energy use and safety.

But University of Alberta AI ethicist Mohamed Abdalla says the findings reflect the incentives facing commercial AI developers, rather than solely a failure to uphold scientific norms. “It’s not the company’s job to advance science, right?” he says. “The company’s job is to advance money.”

Ioannidis has long studied how unicorns, particularly in biotech, engage with the scientific literature. (In 2015, he was the first to publicly scrutinize the lack of peer-reviewed studies produced by Theranos, the blood testing startup that proved to be based on fraudulent data.) He wondered whether AI unicorns would show similar patterns.

To find out, he and his team first identified all 317 unicorn AI companies that have existed from 1998 to 2025. Then, they searched for publications affiliated with these startups—including journal articles, conference papers, reviews, and preprints. They selected those where a company researcher played a leading role as a first or last author, indicating the startup had made a substantial contribution to the work. The final data set included 2077 final publications, comprising 1389 peer-reviewed papers and 688 preprints.

More than half of the startups had never produced a single qualifying paper, the analysis revealed. Scientific influence proved even more concentrated, with the top 5% of firms accounting for greater than 90% of all citations. OpenAI alone was responsible for nearly 40% of all citations in the data set, followed by the Chinese computer vision company Megvii and the platform Hugging Face. And even at the most prolific companies, much of the output came from the same small group of repeat authors. For example, despite OpenAI employing roughly 4500 people, only eight researchers had authored five or more qualifying papers.

The findings are unsurprising to some AI researchers given how the industry is structured. For example, unlike the pharmaceutical industry, where published discoveries can be protected by patents, AI companies have learned they often gain little from publicly disclosing technical advances, says Nur Ahmed, an AI researcher at the University of Arkansas. Google’s landmark 2017 paper on the transformer—the architecture that underpins today’s large language models—has become a classic cautionary example, Abdalla adds. Although Google patented aspects of the technology, “I don’t think anybody’s paying Google for that,” he says.

Startups also operate on much faster timelines than academia, where peer review can lumber on for months or even years. That’s why many AI companies have embraced what Avijit Ghosh, an AI policy researcher at Hugging Face, calls the “blogification” of research: announcing new models and releasing code or data sets through blog posts and technical reports rather than scientific journals. The new analysis didn’t track those outputs, he points out.

For Ghosh, the debate shouldn’t center on publishing in journals versus blogs. What matters is whether companies are releasing enough code, data sets, or model weights (the numbers that determine how a model interprets and responds to a prompt) for others to independently verify and build on their work, he says.

The preprint also found that firms based in China consistently published more papers than their counterparts based in the United States. Whereas leading U.S. frontier labs have increasingly kept the details of their most capable models secret or “closed sourced,” leading Chinese companies have embraced “open-source” models. Moonshot AI, one of the Chinese startups included in the study, recently unveiled Kimi K3—one of the strongest open models to date—and publicly released its model weights through Hugging Face today.

But whether models are open or closed, the rapid pace toward increasingly powerful generalist AI worries Emma Pierson, a computer scientist at the University of California, Berkeley. She argues AI research—whether published freely or kept secret—risks accelerating models that pose serious societal and safety concerns, including supercharging cyberattacks. “If we were racing forward on cancer-curing AI, I would be like, ’Fantastic, full steam ahead,’” she says. “But that’s not what we’re racing toward, right?”…

The secretive unicorns: “AI’s top startups are barely publishing their research,” from @science.org.

By way of example? In order to have a broader footprint in AI for (default proprietary) scientific discovery, Google moves away from a successful AI effort (that did publish): “Google DeepMind dismantles Nobel-winning AlphaFold team in strategy shift” (gift article from the FT). One wonders: when these LLMs run out of published papers on which to train, where (and how) will they source the knowledge they need to stay useful?

* Neil deGrasse Tyson

###

As we share and share alike, we might recall that it was on this date in 1887 that Chester A. Hodge of Beloit, Wisconsin received patent No. 367,398 for ‘spur rowel’ barbed wire (consisting of spur shaped wheels with 8 or 10 points mounted between 2 wires).  It was one of many patents for barbed wire (e.g., here), which spread across the American West rapidly (thanks, in no small measure to the guy featured in the almanac entry here)– and (by protecting farmers from foraging free-ranging cattle) paved the way for the expansion of wheat (and other kinds of) farming… even as it spelled the doom of a commons– the open range.

Close-up view of coiled barbed wire, showcasing its intricate twists and pointed spikes.
Roll of modern agricultural barbed wire (source)

“Any fool can know. The point is to understand.”*…

A corridor in King’s College, Cambridge, England dating from the 15th century

… and, Rachael Scarborough King and Seth Rudy argue, to serve a clear purpose…

Right now, many forms of knowledge production seem to be facing their end. The crisis of the humanities has reached a tipping point of financial and popular disinvestment, while technological advances such as new artificial intelligence programmes may outstrip human ingenuity. As news outlets disappear, extreme political movements question the concept of objectivity and the scientific process. Many of our systems for producing and certifying knowledge have ended or are ending.

We want to offer a new perspective by arguing that it is salutary – or even desirable – for knowledge projects to confront their ends. With humanities scholars, social scientists and natural scientists all forced to defend their work, from accusations of the ‘hoax’ of climate change to assumptions of the ‘uselessness’ of a humanities degree, knowledge producers within and without academia are challenged to articulate why they do what they do and, we suggest, when they might be done. The prospect of an artificially or externally imposed end can help clarify both the purpose and endpoint of our scholarship.

We believe the time has come for scholars across fields to reorient their work around the question of ‘ends’. This need not mean acquiescence to the logics of either economic utilitarianism or partisan fealty that have already proved so damaging to 21st-century institutions. But avoiding the question will not solve the problem. If we want the university to remain a viable space for knowledge production, then scholars across disciplines must be able to identify the goal of their work – in part to advance the Enlightenment project of ‘useful knowledge’ and in part to defend themselves from public and political mischaracterisation.

Our volume The Ends of Knowledge: Outcomes and Endpoints Across the Arts and Sciences (2023) asks how we should understand the ends of knowledge today. What is the relationship between an individual knowledge project – say, an experiment on a fruit fly, a reading of a poem, or the creation of a Large Language Model – and the aim of a discipline or field? In areas ranging from physics to literary studies to activism to climate science, we asked practitioners to consider the ends of their work – its purpose – as well as its end: the point at which it might be complete. The responses showed surprising points of commonality in identifying the ends of knowledge, as well as the value of having the end in sight…

Read on for a provocative case that academics need to think harder about the purpose of their disciplines and a consideration of whether some of those should come to an end: “The Ends of Knowledge,” in @aeonmag.

* Albert Einstein

###

As we contemplate conclusions, we might recall that it was on this date in 1869 that the first issue of the journal Nature was published.  Taking it’s title from a line of Wordsworth’s (“To the solid ground of nature trusts the Mind that builds for aye”), its aim was to “provide cultivated readers with an accessible forum for reading about advances in scientific knowledge.”  It remains a weekly, international, interdisciplinary journal of science, one of the few remaining that publish across a wide array of fields.  It is consistently ranked the world’s most cited scientific journal and is ascribed an impact factor of approximately 64.8, making it one of the world’s top academic journals.

Nature‘s first first page (source)