Existential risk from artificial intelligence

Transhumanism is a philosophical movement that advocates the enhancement of the human condition by developing and making widely available new and future technologies to enhance longevity, cognition, and well-being. Influenced by seminal works of science fiction, the transhumanist vision of a transformed future humanity has many supporters and detractors from a wide range of perspectives, including philosophy and religion. Some critics argue that transhumanism amounts to little more than a "rebranding" of eugenics.

hypothetic future event in which artificial intelligence iteratively redesigns itself to rapidly become more intelligent, causing technological and social change beyond prediction

Anthropic PBC is an American artificial intelligence (AI) company headquartered in San Francisco. It has developed a family of large language models (LLMs) named Claude. Anthropic operates as a public benefit corporation, which researches and develops AI to "study their safety properties at the technological frontier" and use this research to deploy safe models for the public.

A superintelligence is a hypothetical agent that possesses intelligence surpassing that of the most gifted human minds. Philosopher Nick Bostrom defines superintelligence as "any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest".

fictional synthetic intelligent machine network

Accelerationism is a range of ideologies that call for the use of capitalism and associated processes to create radical social transformations. Broadly, accelerationism engages with antihumanism, as well as posthumanism, and seeks to accelerate desired tendencies within capitalism at the expense of negative ones, though variants differ greatly on which tendencies and if this will lead beyond capitalism or further into it.

research area on making artificial intelligence safe and beneficial

hypothesis that artificial general intelligence could result in human extinction

hypothetical scenario in which AI becomes the dominant form of intelligence on Earth

alignment of AI systems towards human goals, preferences and ethical principles

policy, law and regulation on the development and use of artificial intelligence

hypothetical tendency for sufficiently intelligent agents to pursue unbounded instrumental goals such as self-preservation and resource acquisition

American non-profit organization

episode of The X-Files (S1 E7)

2014 essay by Nick Bostrom

philosophical and social movement advocating for a pro-technology stance that seeks to maximize the probability of a technocapital singularity

nonprofit organization

2017 book by Max Tegmark

hypothetical isolated computer hardware system where a possibly dangerous artificial intelligence is kept constrained in a virtual prison and not allowed to manipulate events in the external world

government regulation

2015 artificial intelligence warning

2016 film

AI safety research organization

TESCREAL is a neologism proposed by computer scientist Timnit Gebru and philosopher Émile P. Torres. An acronym, it stands for Transhumanism, Extropianism, Singularitarianism, (modern) Cosmism, Rationalists (the internet community, not to be confused with other uses of the term), Effective Altruism, and Longtermism. Gebru and Torres argue that these ideologies should be treated as an "interconnected and overlapping" group with shared origins. They claim these constitute a movement that allows its proponents to use the threat of human extinction to justify expensive or detrimental projects and

California bill

non-profit organization

open-letter calling to mitigate "the extinction risk from AI"