Posts Tagged ‘effective altruism’
“Even a fool who keeps silent is considered wise; when he closes his lips, he is deemed intelligent.”*…
A substantial– and important– look at a troubling current aflow in the world of technology today: Emily Gorcenski on the millenarianism and manifest destiny of AI and techno-futurism…
… Early Christian missionaries traveled the pagan lands looking for heathens to convert. Evangelical movements almost definitionally involve spreading the word of Jesus Christ as a core element of their faith. The missionary holds the key that unlocks eternal life and the only cost is conversion: the more souls saved, the holier the work. The idea of going out into the world to spread the good word and convert them to our product/language/platform is a deep tradition in the technology industry. We even hire people specifically to do that. We call them technology evangelists.
Successful evangelism has two key requirements. First, it must offer the promised land, the hope of a better life, of eternal salvation. Second, it must have a willing mark, someone desperate enough (perhaps through coercion) to be included in that vision of eternity, better if they can believe strongly enough to become acolytes themselves. This formed the basis of the crypto community: Ponzi schemes sustain only as long as there are new willing participants and when those participants realize that their own continued success is contingent on still more conversions, the incentive to act in their own best interest is strong. It worked for a while to keep the crypto bubble alive. Where this failed was in every other aspect of web3.
…
There’s a joke in the data science world that goes something like this: What’s the difference between statistics, machine learning, and AI? The size of your marketing budget. It’s strange, actually, that we still call it “artificial intelligence” to this day. Artificial intelligence is a dream from the 40s mired in the failures of the ’60s and ’70s. By the late 1980s, despite the previous spectacular failures to materialize any useful artificial intelligence, futurists had moved on to artificial life.
Nobody much is talking about artificial life these days. That idea failed, too, and those failures have likewise failed to deter us. We are now talking about creating “cybernetic superintelligence.” We’re talking about creating an AI that will usher a period of boundless prosperity for humankind. We’re talking about the imminence of our salvation.
The last generation of futurists envisioned themselves as gods working to create life. We’re no longer talking about just life. We’re talking about making artificial gods.
…
I’m certainly not the first person to shine a light on the eschatological character of today’s AI conversation. Sigal Samuel did it a few months back in far fewer words than I’ve used here, though perhaps glossing over some of the political aspects I’ve brought in. She cites Noble and Kurzweil in many of the same ways. I’m not even the first person to coin the term “techno-eschatology.” The parallels between the Singularity Hypothesis and the second coming of Christ are plentiful and not hard to see.
…
… The issue is not that Altman or Bankman-Fried or Andreesen or Kurzweil or any of the other technophiles discussed so far are “literally Hitler.” The issue is that high technology shares all the hallmarks of a millenarian cult and the breathless evangelism about the power and opportunity of AI is indistinguishable from cult recruitment. And moreover, that its cultism meshes perfectly with the American evangelical far-right. Technologists believe they are creating a revolution when in reality they are playing right into the hands of a manipulative, mainstream political force. We saw it in 2016 and we learned nothing from that lesson.
Doomsday cults can never admit when they are wrong. Instead, they double down. We failed to make artificial intelligence, so we pivoted to artificial life. We failed to make artificial life, so now we’re trying to program the messiah. Two months before the Metaverse went belly-up, McKinsey valued it at up to $5 trillion dollars by 2030. And it was without a hint of irony or self-reflection that they pivoted and valued GenAI at up to $4.4 trillion annually. There’s not even a hint of common sense in this analysis.
This post won’t convince anyone on the inside of the harms they are experiencing nor the harms they are causing. That’s not been my intent. You can’t remove someone from a cult if they’re not ready to leave. And the eye-popping data science salaries don’t really incentivize someone to get out. No. My intent was to give some clarity and explanatory insight to those who haven’t fallen under the Singularity’s spell. It’s a hope that if—when—the GenAI bubble bursts, we can maybe immunize ourselves against whatever follows it. And it’s a plea to get people to understand that America has never stopped believing in its manifest destiny.
David Nye described 19th and 20th century American perception technology using the same concept of the sublime that philosophers used to describe Niagara Falls. Americans once beheld with divine wonder the locomotive and the skyscraper, the atom bomb and the Saturn V rocket. I wonder if we’ll behold AI with that same reverence. I pray that we will not. Our real earthly resources are wearing thin. Computing has surpassed aviation in terms of its carbon threat. The earth contains only so many rare earth elements. We may face Armageddon. There will be no Singularity to save us. We have the power to reject our manifest destinies…
Eminently worth reading in full: “Making God,” from @EmilyGorcenski (a relay to mastodon and BlueSky).
See also: “Effective Obfuscation,” from Molly White (@molly0xFFF) and this thread from Emily Bender (@emilymbender).
* Proverbs 17:28
###
As we resist recruitment, we might spare a thought for Ada Lovelace (or, more properly, Augusta Ada King, Countess of Lovelace, née Byron); she died on this date in 1852. A mathematician and writer, she is chiefly remembered for her work on Charles Babbage‘s proposed mechanical general-purpose computer, the Analytical Engine— for which she authored what can reasonably be considered the first “computer program.” She was the first to recognize that the machine had applications beyond pure calculation, and so is one of the “parents” of the modern computer.
“To be what you want to be: isn’t this the essence of being human?”*…
… Ah, but what does one– should one– want to be? Jules Evans, with a history of the transhumanist-rationalist-extropian movement that has ensorcelled many of technology’s leaders, one that celebrates an elite few and promises an end to death and taxes…
Once upon a time there was an obscure mailing list. It only had about 100 people on it, yet in this digital village was arguably the greatest concentration of brain power since fifth-century Athens. There was Hans Moravec, pioneer in robotics; Eric Drexler, pioneer of nanotechnology; Eliezer Yudkowsky, father of the Rationalist movement; Max More, father of modern transhumanism; Nick Bostrom, founder of Long-Termism and the study of Existential Risks; Hal Finney, Nick Szabo and Wei Dai, the inventors of cryptocurrency; and Julian Assange, founder of Wikileaks. Together they developed a transhumanist worldview — self-transformation, genetic modification, nootropic drugs, AI, crypto-libertarianism and space exploration. It’s a worldview that has become the ruling philosophy of the obscenely rich of California.
It all started in Bristol, England. There, a young man called Max O’Connor grew up, and went to study philosophy at Oxford. But Max wanted more, more excitement, more life, more everything. He changed his name to Max More, and moved to California, where the future is invented. His dreams took root in the soil prepared by Californian transhumanists of the 1970s. Many of them were members of an organization called L5, dedicated to the colonization of space by a genetic elite — its members included Timothy Leary, Marvin Minsky, Isaac Asimov and Freeman Dyson, and its magazine was named Ad Astra — which was what Elon Musk named his school for SpaceX kids in 2014.
Max was also inspired by Robert Ettinger, an American engineer who argued that humans would soon become immortal superbeings, and we should freeze ourselves when we die so we can be resurrected in the perfect future. While doing a PhD at the University of Southern California, Max got a job at the Alcor Foundation for cryonic preservation, and in 1989 he started a magazine with his fellow philosophy grad, Tom Morrow, called Extropy: Journal of Transhumanist Thought. ‘Do you want to be an ubermensch?’ the first issue asked.
‘Ubermensch’ (overman or superman) is the German word used by Friedrich Nietzsche to describe the individual (male or female) who has overcome all obstacles to the perfection of him or herself…
A history and an explanation: “How did transhumanism become the religion of the super-rich?” from @JulesEvans11.
* David Zindell
###
As we ponder the (presumptuous) preference for perfection, we might recall that it was (tradition holds) on this date in 1517– All Hallows (All Saints) Eve– that Martin Luther, a priest and scholar in Wittenberg, Germany, upset by what he saw as the excesses and corruption of the Roman Catholic Church (especially the papal practice of taking payments– “indulgences”– for the forgiveness of sins), posted his 95 Theses on the door of Castle Church. Thus began the Protestant Reformation.
Martin Luther (source)
Today, of course, All Hallows (All Saints) Eve, is celebrated as Halloween, which is (if it is, as many scholars believe, directly descended from the ancient Welsh harvest festival Samhain) the longest-running holiday with a set date… and (usually, anyway) the second-biggest (after Christmas) commercial holiday in the United States.
“All our knowledge begins with the senses, proceeds then to the understanding, and ends with reason. There is nothing higher than reason.”*…
As Robert Cottrell explains, a growing group of online thinkers couldn’t agree more…
Much of the best new writing online originates from activities in the real world — music, fine art, politics, law…
But there is also writing which belongs primarily to the world of the Internet, by virtue of its subject-matter and of its sensibility. In this category I would place the genre that calls itself Rationalism, the raw materials of which are cognitive science and mathematical logic.
I will capitalise Rationalism and Rationalists when referring to the writers and thinkers who are connected in one way or another with the Less Wrong forum (discussed below). I will do this to avoid confusion with the much broader mass of small-r “rational” thinkers — most of us, in fact — who believe their thinking to be founded on reasoning of some sort; and with “rationalistic” thinkers, a term used in the social sciences for people who favour the generalised application of scientific methods.
Capital-R Rationalism contends that there are specific techniques, drawn mainly from probability theory, by means of which people can teach themselves to think better and to act better — where “better” is intended not as a moral judgement but as a measure of efficiency. Capital-R Rationalism contends that, by recognising and eliminating biases common in human judgement, one can arrive at a more accurate view of the world and a more accurate view of one’s actions within it. When thus equipped with a more exact view of the world and of ourselves, we are far more likely to know what we want and to know how to get it.
Rationalism does not try to substitute for morality. It stops short of morality. It does not tell you how to feel about the truth once you think you have found it. By stopping short of morality it has the best of both worlds: It provides a rich framework for thought and action from which, in principle, one might advance, better equipped, into metaphysics. But the richness and complexity of deciding how to act Rationally in the world is such that nobody, having seriously committed to Rationalism, is ever likely to emerge on the far side of it.
The influence of Rationalism today is, I would say, comparable with that of existentialism in the mid-20th century. It offers a way of thinking and a guide to action with particular attractions for the intelligent, the dissident, the secular and the alienated. In Rationalism it is perfectly reasonable to contend that you are right while the World is wrong.
Rationalism is more of an applied than a pure discipline, so its effects are felt mainly in fields where its adepts tend to be concentrated. By far the highest concentration of Rationalists would appear to cohabit in the study and development of artificial intelligence; so it hardly surprising that main fruit of Rationalism to date has been the birth of a new academic field, existential risk studies, born of a convergence between Rationalism and AI, with science fiction playing catalytic role. Leading figures in existential risk studies include Nicholas Bostrom at Oxford University and Jaan Tallinn at Cambridge University.
Another relatively new field, effective altruism, has emerged from a convergence of Rationalism and Utilitarianism, with the philosopher Peter Singer as catalyst. The leading figures in effective altruism, besides Singer, are Toby Ord, author of The Precipice; William MacAskill, author of Doing Good Better; and Holden Karnofsky, co-founder of GiveWell and blogger at Cold Takes.
A third new field, progress studies, has emerged very recently from the convergence of Rationalism and economics, with Tyler Cowen and Patrick Collison as its founding fathers. Progress studies seeks to identify, primarily from the study of history, the preconditions and factors which underpin economic growth and technological innovation, and to apply these insights in concrete ways to the promotion of future prosperity. The key text of progress studies is Cowen’s Stubborn Attachments…
…
I doubt there is any wholly original scientific content to Rationalism: It is a taker of facts from other fields, not a contributor to them. But by selecting and prioritising ideas which play well together, by dramatising them in the form of thought experiments, and by pursuing their applications to the limits of possibility (which far exceed the limits of common sense), Rationalism has become a contributor to the philosophical fields of logic and metaphysics and to conceptual aspects of artificial intelligence.
…
Tyler Cowen is beloved of Rationalists but would hesitate (I think) to identify with them. His attitude towards cognitive biases is more like that of Chesterton towards fences: Before seeking to remove them you should be sure that you understand why they were put there in the first place…
From hands-down the best guide I’ve found to the increasingly-impactful ideas at work in Rationalism and its related fields, and to the thinkers behind them: “Do the Right Thing,” from @robertcottrell in @TheBrowser. Eminently worth reading in full.
[Image above: source]
* Immanuel Kant, Critique of Pure Reason
###
As we ponder precepts, we might recall that it was on this date in 1937 that Hormel went public with its own exercise in recombination when it introduced Spam. It was the company’s attempt to increase sales of pork shoulder, not at the time a very popular cut. While there are numerous speculations as to the “meaning of the name” (from a contraction of “spiced ham” to “Scientifically Processed Animal Matter”), its true genesis is known to only a small circle of former Hormel Foods executives.
As a result of the difficulty of delivering fresh meat to the front during World War II, Spam became a ubiquitous part of the U.S. soldier’s diet. It became variously referred to as “ham that didn’t pass its physical,” “meatloaf without basic training,” and “Special Army Meat.” Over 150 million pounds of Spam were purchased by the military before the war’s end. During the war and the occupations that followed, Spam was introduced into Guam, Hawaii, Okinawa, the Philippines, and other islands in the Pacific. Immediately absorbed into native diets, it has become a unique part of the history and effects of U.S. influence in the Pacific islands.
You must be logged in to post a comment.