Thursday, July 24, 2025
LBNN
  • Business
  • Markets
  • Politics
  • Crypto
  • Finance
  • Energy
  • Technology
  • Taxes
  • Creator Economy
  • Wealth Management
  • Documentaries
No Result
View All Result
LBNN

The fight over a ‘dangerous’ ideology shaping AI debate

Simon Osuji by Simon Osuji
August 27, 2023
in Artificial Intelligence
0
The fight over a ‘dangerous’ ideology shaping AI debate
0
SHARES
0
VIEWS
Share on FacebookShare on Twitter


Tesla's Elon Musk is among those claiming that AI could make humanity extinct, while standing to benefit by arguing only their p
Tesla’s Elon Musk is among those claiming that AI could make humanity extinct, while standing to benefit by arguing only their products can save us.

Silicon Valley’s favorite philosophy, longtermism, has helped to frame the debate on artificial intelligence around the idea of human extinction.

Related posts

The Very Real Case for Brain-Computer Implants

The Very Real Case for Brain-Computer Implants

July 24, 2025
Automated tool detects silent errors in deep learning training

Automated tool detects silent errors in deep learning training

July 24, 2025

But increasingly vocal critics are warning that the philosophy is dangerous, and the obsession with extinction distracts from real problems associated with AI like data theft and biased algorithms.

Author Emile Torres, a former longtermist turned critic of the movement, told AFP that the philosophy rested on the kind of principles used in the past to justify mass murder and genocide.

Yet the movement and linked ideologies like transhumanism and effective altruism hold huge sway in universities from Oxford to Stanford and throughout the tech sector.

Venture capitalists like Peter Thiel and Marc Andreessen have invested in life-extension companies and other pet projects linked to the movement.

Elon Musk and OpenAI’s Sam Altman have signed open letters warning that AI could make humanity extinct—though they stand to benefit by arguing only their products can save us.

Ultimately critics say this fringe movement is holding far too much influence over public debates over the future of humanity.

‘Really dangerous’

Longtermists believe we are dutybound to try to produce the best outcomes for the greatest number of humans.

This is no different to 19th century liberals, but longtermists have a much longer timeline in mind.

They look to the far future and see trillions upon trillions of humans floating through space, colonizing new worlds.

They argue that we owe the same duty to each of these future humans as we do to anyone alive today.

And because there are so many of them, they carry much more weight than today’s specimens.

This kind of thinking makes the ideology “really dangerous”, said Torres, author of “Human Extinction: A History of the Science and Ethics of Annihilation”.

“Any time you have a utopian vision of the future marked by near infinite amounts of value, and you combine that with a sort of utilitarian mode of moral thinking where the ends can justify the means, it’s going to be dangerous,” said Torres.

If a superintelligent machine could be about to spring to life with the potential to destroy humanity, longtermists are bound to oppose it no matter the consequences.

When asked in March by a user of Twitter, the platform now known as X, how many people could die to stop this happening, longtermist idealogue Eliezer Yudkowsky replied that there only needed to be enough people “to form a viable reproductive population”.

“So long as that’s true, there’s still a chance of reaching the stars someday,” he wrote, though he later deleted the message.

Eugenics claims

Longtermism grew out of work done by Swedish philosopher Nick Bostrom in the 1990s and 2000s around existential risk and transhumanism—the idea that humans can be augmented by technology.

Academic Timnit Gebru has pointed out that transhumanism was linked to eugenics from the start.

British biologist Julian Huxley, who coined the term transhumanism, was also president of the British Eugenics Society in the 1950s and 1960s.

“Longtermism is eugenics under a different name,” Gebru wrote on X last year.

Bostrom has long faced accusations of supporting eugenics after he listed as an existential risk “dysgenic pressures”, essentially less-intelligent people procreating faster than their smarter peers.

The philosopher, who runs the Future of Life Institute at the University of Oxford, apologized in January after admitting he had written racist posts on an internet forum in the 1990s.

“Do I support eugenics? No, not as the term is commonly understood,” he wrote in his apology, pointing out it had been used to justify “some of the most horrific atrocities of the last century”.

‘More sensational’

Despite these troubles, longtermists like Yudkowsky, a high school dropout known for writing Harry Potter fan-fiction and promoting polyamory, continue to be feted.

Altman has credited him with getting OpenAI funded and suggested in February he deserved a Nobel peace prize.

But Gebru, Torres and many others are trying to refocus on harms like theft of artists’ work, bias and concentration of wealth in the hands of a few corporations.

Torres, who uses the pronoun they, said while there were true believers like Yudkowsky, much of the debate around extinction was motivated by profit.

“Talking about human extinction, about a genuine apocalyptic event in which everybody dies, is just so much more sensational and captivating than Kenyan workers getting paid $1.32 an hour, or artists and writers being exploited,” they said.

© 2023 AFP

Citation:
The fight over a ‘dangerous’ ideology shaping AI debate (2023, August 27)
retrieved 27 August 2023
from https://techxplore.com/news/2023-08-dangerous-ideology-ai-debate.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.





Source link

Previous Post

Intercontinental Exchange and Black Knight Announce Entry into Agreement Containing Consent Orders with FTC’s Bureau of Competition

Next Post

A Brazilian phone spyware was hacked and victims’ devices ‘deleted’ from server

Next Post
A Brazilian phone spyware was hacked and victims’ devices ‘deleted’ from server

A Brazilian phone spyware was hacked and victims’ devices 'deleted' from server

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

RECOMMENDED NEWS

Researchers’ sweeping discovery shows how kidney cells self-renew

Researchers’ sweeping discovery shows how kidney cells self-renew

2 years ago
ARMSCOR delivers third and final MMIPV SAS ADAM KOK III (P1573)

ARMSCOR delivers third and final MMIPV SAS ADAM KOK III (P1573)

3 months ago
The 11 Best Early Memorial Day 2024 Mattress Deals

The 11 Best Early Memorial Day 2024 Mattress Deals

1 year ago
For Under $50K You can Start a WIN Home Inspection Franchise

For Under $50K You can Start a WIN Home Inspection Franchise

8 months ago

POPULAR NEWS

  • Ghana to build three oil refineries, five petrochemical plants in energy sector overhaul

    Ghana to build three oil refineries, five petrochemical plants in energy sector overhaul

    0 shares
    Share 0 Tweet 0
  • When Will SHIB Reach $1? Here’s What ChatGPT Says

    0 shares
    Share 0 Tweet 0
  • The world’s top 10 most valuable car brands in 2025

    0 shares
    Share 0 Tweet 0
  • Top 10 African countries with the highest GDP per capita in 2025

    0 shares
    Share 0 Tweet 0
  • Tanzania’s natural gas sector goes global with Dubai deal

    0 shares
    Share 0 Tweet 0
  • Privacy Policy
  • Contact

© 2023 LBNN - All rights reserved.

No Result
View All Result
  • Home
  • Business
  • Politics
  • Markets
  • Crypto
  • Economics
    • Manufacturing
    • Real Estate
    • Infrastructure
  • Finance
  • Energy
  • Creator Economy
  • Wealth Management
  • Taxes
  • Telecoms
  • Military & Defense
  • Careers
  • Technology
  • Artificial Intelligence
  • Investigative journalism
  • Art & Culture
  • Documentaries
  • Quizzes
    • Enneagram quiz
  • Newsletters
    • LBNN Newsletter
    • Divergent Capitalist

© 2023 LBNN - All rights reserved.