Three camps in the AI harm debate
A summary of Deep Questions with Cal Newport, “An Insider’s Guide to AI Doom” —
published 1 October 2026, 28 m 39 s. No guest: a solo explainer, drawn on a tablet as he
talks. Audio:
podcasts.apple.com;
video, same title, at youtu.be/McsQ7hXzd3M. Timestamps link
into the video at that moment.
Structure, from the show’s own chapters: intro (0:00), why the
debate is so heated (1:01), the doomers
(2:01), the doomer civil war
(9:12), the accelerationists
(14:03), the centrists
(17:51), the full landscape and the fight over
regulation (24:00).
This is the framework episode that precedes the Torres interview summarised in
A stark warning from a former AI doomer, published a week
later. Where that episode is one camp’s critique argued at length by a defector, this one is
Cal’s own map of all three camps — and it places him on it. See
Method and caveats for what was checked and what was not.
Cal’s claim is that the AI-harms argument is unreadable unless you know which of three
camps a given speaker belongs to, because two of them are asking for regulation and mean
entirely different things by it. The doomers descend from 1990s Bay-Area
transhumanism via rationalism and effective altruism; they hold that superintelligent AI is
inevitable and will be either a good god or a bad one, and Anthropic and OpenAI sit inside
this camp rather than opposite it — which is why the loudest attacks on those two labs come
from their own intellectual family. The accelerationists — VCs, the non-doomer AI
companies, the White House — think the doomers are weird and the race worth winning. The
centrists want AI regulated as a normal technology, share the accelerationists’
rejection of doomer metaphysics and the doomers’ appetite for intervention, and agree with
neither about why. Cal’s payoff: Congress is currently being briefed mostly by the doomers,
and a doomer-shaped regulation is the wrong instrument for the harms a centrist is worried
about.
Two caveats he opens with (0:50): he is “basically just
winging this episode,” the boundaries are “a little bit porous,” and he is trying to keep his
own opinion out of it — an attempt he abandons explicitly in the third camp, which is his.
|
Camp |
Who |
Core belief |
Motive Cal ascribes |
| 1 |
Doomers |
rationalists, AI-focused EAs, plus Anthropic and OpenAI |
superintelligent AI is inevitable; it will be a good god or a bad god |
an eschatological futurist utopianism dating to the 1980s–90s |
| 2 |
Accelerationists |
VCs, the other AI firms, the White House |
the doomers are weird; go fast, the benefits are real and China is racing |
money and power |
| 3 |
Centrists |
AI ethicists, “normal technology” computer scientists, cybersecurity experts |
AI is powerful but ordinary; regulate it like any other unsafe technology |
— (Cal’s own camp) |
On the asymmetry between those motives
(17:04): the accelerationist story is the familiar one
— “companies want to make more money and they don’t want stuff to stop them” — and so it
reads as legible. “The doomer story is a little bit more complicated and I think it’s sort of
thrown a lot of people off … way stranger in the American experience than just being driven
by I want to get a return on investment.”
Back to the Extropians, the futurist and “very utopian” Silicon Valley movement of the
1980s–90s (2:33). They wove two technologies together
into one transhumanist utopia: nanotechnology, via Eric Drexler — nanomachines that
repair bodies, reverse aging and disease — and AI, in the form of a superintelligence
acting as “essentially a benevolent digital deity”
(3:26). The Extropians were, on Cal’s telling, “pretty
positive.”
Eliezer Yudkowsky is the hinge (3:26): dropped out
after the 8th grade, read science fiction, found the Extropian mailing list, wrote heavily
for it, got funding for his own techno-utopian institute — and then concluded that
superintelligent AI “could also just as easily kill us all.” Inevitable, but not inevitably
good: “more eschatological than the Extropians realized”
(4:16). That strand became the rationalists.
Effective altruism arrives from a different direction
(5:07): William MacAskill and Toby Ord at Oxford,
influenced by Peter Singer, applying logic and rationality to altruism — rating charities by
good done per dollar, and a pledge campaign telling high earners to keep the lucrative job
and give a large share away. Nick Bostrom is the join
(5:57): an Oxford philosopher who was also on the
Extropian list, convinced by Yudkowsky-style arguments, and one of several voices that moved
EA from effective giving toward longtermism — “the most altruistic thing you could do is
prevent the extinction of humanity” (6:49). He founded
an existential-risk institute at Oxford where, over time, AI killing everyone became the
dominant risk.
The arithmetic that did the work, from a MacAskill talk Cal places at Google
(7:41): why weight hundreds of millions of present lives
over the tens of trillions of future lives that extinction forecloses? “So, they pulled
on this logical thread long enough, and a lot of effective altruists said, ‘Preventing
superintelligent AI from killing us all, that is what effective altruism should focus.’”
Cal is careful that EA is the broader movement — “incredibly well-funded mainly by tech
centimillionaires and tech billionaires,” with AI only part of the portfolio; Dustin
Moskovitz is cited as giving heavily to foreign aid after USAID was gutted. But in the Bay
Area the two labels have fused, which is why Cade Metz of the New York Times writes
“EA/rationalist circles” as one phrase (8:32).
The creed, as Cal summarises it: superintelligent AI is inevitable; they believed this long
before LLMs; carelessly built it kills us all; built right it delivers a transhuman utopia
that is “the ultimate good” — and therefore deserves to be the main object of altruism.
The structurally important move (9:25). Many companies
have hyper-scaled LLMs; Anthropic and OpenAI are distinguished by coming out of the
rationalist/EA tradition and being founded to execute its programme. OpenAI exists because
DeepMind — also from these circles — was bought by Google, and Musk funded an alternative on
the view that “we can’t trust a big company to shepherd superintelligent AI the right way.”
Anthropic is breakaway OpenAI employees, leaving two years after OpenAI’s for-profit
subsidiary was declared, on the grounds that OpenAI was “not sufficiently pursuing the
rationalist effective altruist goals.”
Anthropic in particular Cal calls “completely incestuously connected” with these movements
(10:15): Dario Amodei lived in a group house with major
effective altruists; his sister, an Anthropic co-founder, married one of them; early funding
came from EA individuals including Sam Bankman-Fried and from EA investment funds.
Rather than walk the connections, he points at sources
(11:05): his own New York Times op-ed from a few weeks
earlier, Cade Metz on The Daily, a Michelle Goldberg column, a Wall Street Journal column
from the previous week, Adam Becker’s book, and his own appearance alongside Becker on Ed
Zitron’s podcast.
What makes the picture confusing (11:55): the labs and
the rest of the camp are at each other’s throats while agreeing on the premises.
- Openly hostile. Yudkowsky and the rationalists: you are moving too fast and will produce
the bad god. “I think you’re you’re caring too much about money or winning.”
- In the middle (12:48). EAs partly aligned with
Amodei: regulate so that he sets the pace, because he will do it right, and hold the
competitors back.
- Shut it down. EAs lobbying hard to stop the labs outright.
“They all believe the same general things. Superintelligent AI is inevitable. It will either
be a good god or a bad god. They differ, however, in whether they believe we can get the good
god right now or whether we’re not ready and we need to wait.” The people at the labs think
they can; the people outside think not yet.
Hence the misreading Cal wants to correct
(13:39): when Nate Soares and EA figures appear around
Bernie Sanders’ anti-superintelligence legislation, it looks like an outside force
constraining the frontier labs. “But they all come from the same doomer mentality. They just
differ on where we are on this timeline that they both agree about.”
Defined by two beliefs (13:39): the doomers are weird,
and we should go as fast as possible — the benefits are large, and there is an economic race
with China to win.
- Venture capitalists, which Cal says makes obvious sense: they want portfolio companies
unimpeded. Marc Andreessen named; the All-In podcast hosts placed here
(14:31).
- The other AI firms — “a lot of the other companies, major AI companies in the US and
abroad, are not so directly connected to doomer philosophies and they think the doomers are
nuts,” producing an active feud with Anthropic and OpenAI
(15:21). Two instances: Jensen Huang asking what’s
with all the sci-fi, “just don’t build unsafe things, this is a fairy tale”; and a
Zuckerberg post Cal paraphrases as why is Anthropic obsessed with recursive
self-improvement — put that effort into useful products instead.
- The White House (16:13) — “the executive branch is
pretty firmly in the accelerationist camp right now,” with Trump’s AI rhetoric
“straight-up sort of accelerationist style.”
And the discount to apply: “You shouldn’t fully trust the accelerationist. They have an
obvious motive here, which is money.” A VC does not want impediments to returns; Huang does
not want chip export bans; the White House has “a lot of connections to … the right-aligned
corners of Silicon Valley.”
Named only for their position on his diagram, between the other two
(17:55). They want controls or safeguards, so they
reject “let her rip”; they have no interest in doomer philosophy, which they find
“anti-humanist and quite frankly kind of strange.” The positive programme: “regulate AI like
a normal technology … like we would regulate any other technology that we’re worried about
being unsafe. And if we think companies are acting weirdly, then we need to investigate and
find out why.”
So they overlap both neighbours and agree with neither
(18:47): the doomers’ appetite for regulation without
its style or motivation; the accelerationists’ rejection of doomer ideology without their
let-it-grow conclusion.
Three overlapping constituencies:
AI ethics (19:38) — a field predating LLMs,
focused on proximate harms: bias in training data propagating into automated decisions;
AI-driven surveillance, “which is happening um in China right now … to hunt down and
persecute … minority groups” (20:29). Cal gives them
priority on the ideological critique too: “they were the first to really point out early on
the unsavory aspects of the futurist ideologies that drives the doomer”
(21:21) — naming TESCREAL and Timnit Gebru, and
characterising the argument as these philosophies have deep anti-humanist aspects, almost
eugenicist: it doesn’t matter how many people die along the way if idealised transhumanist
individuals survive as the apotheosis of the race.
“Normal technology” computer scientists (22:11) —
his own box, with Arvind Narayanan and Gary Marcus in it, wary of hype and looking at the
actual technology: “We’re less worried about superintelligence than we are about
good old-fashioned straight-up harms that it could or couldn’t cause right now.” His own
work: the long-horizon LLM-agent experiments OpenAI and Anthropic run and other AI companies
do not — run, he believes, as part of the race to superintelligence first. Hence his call to
investigate and possibly regulate — “not because I’m trying to stop the bad god from coming,
but because I think these are bad actors. That their motivations are leading to dangerous
behavior” (23:03). He also claims a foot in AI ethics
via Georgetown’s Center for Digital Ethics.
Cybersecurity (19:38,
23:03) — not his expertise, and he reports their
position as two flat statements: the superintelligence material “is a fairy tale,” and the
hacking capabilities now shipping are “very dangerous for very realistic pragmatic reasons”
— advanced “just so you can do well on some benchmarks or … reach some … vision you have
about where you should be on the route to superintelligence.”
The part Cal calls “the most confusing thing at the moment”
(24:45): the centrists and the doomers are both calling
for regulation, with “very different visions and motivations for what that means.”
His reading of where Congress currently sits, attributed to congressional staffers he says he
has heard from directly:
- Legislative interest — “mainly the Democrats right now, but also some Republicans” — is
“being very influenced by the doomers,” the EA doomers especially, who “have a lot of money
and they’re aggressively lobbying.”
- Beyond lobbying, a placement strategy: “the effective altruist through the years and
through these sort of fellowship programs have been placing — specifically this is a plan —
they’ve been placing effective altruists onto congressional staff,” so that
representatives and senators have their own staffers saying superintelligence is the
overriding worry (25:36).
The centrist objection is not that intervention is wrong but that doomer-shaped intervention
misses. Normal-technology intervention asks “What are you doing? Why are you doing it? What’s
your motivation?” — and, he argues, would bite the two doomer labs harder than anyone else,
precisely because their conduct is the anomaly. Legislating against “superintelligence” or
“recursive self-improvement” — “an idea that comes out of the futurist circles not computer
science” — means missing “actual meaningful probably workable style interventions,” which
should instead target specific technologies and techniques with specific safeguards
(26:27). “We’re roughly aligned with the doomers who
are saying we need to intervene, but we’re really not aligned on why we need to intervene and
what that should look like.”
The closing instruction (27:19): whatever you are
reading — article, tweet, Bluesky thread, podcast, “a buddy of yours at a dinner party” —
“you got to first categorize that person somewhere in here to understand what they believe,
why, and what their agenda is.”
And a disclaimer of the authority the map might otherwise claim: “I’m not going to tell you
right now which of these you should agree with. I obviously I … I’m a centrist, but that
doesn’t mean I’m right. Doesn’t mean I’m right. I don’t even really want to be a part of this
debate, to be honest. I find it very stressful. But I do think clarity really matters.”
- Transcript provenance. No human captions exist for this video. The auto-generated
English track was pulled with
yt-dlp --write-auto-subs --sub-langs en-orig, de-duplicated
and re-flowed into ~50-second blocks (≈5,100 words across 34 blocks). Timestamps here are
cue times from that track, so they are accurate to within a block; the chapter times in the
header are the show’s own. Podcast audio (1,719 s) and video (1,720 s) are the same length,
so the two run in sync.
- Caption corrections. Conventional spellings, where the auto-captions mangled them:
Arvind Narayanan (“Arvin”), Eliezer Yudkowsky, Timnit Gebru, Marc Andreessen, Cade Metz,
Nate Soares, Dustin Moskovitz. “Demeris” at
4:16 is “the doomers.” One caption artefact is
rendered literally in the track as
{slash}, in “EA/rationalist.”
- Checked against sources outside the episode:
- TESCREAL’s co-coiner is misnamed on air. Cal credits “Timnit Gebru and others … Emad
Mostaque as well, I believe” (21:21). The acronym
is Gebru’s with Émile P. Torres — the guest of the following week’s
episode — first used in a draft of The TESCREAL bundle:
Eugenics and the promise of utopia through artificial general intelligence (First
Monday, April 2024). Emad Mostaque co-founded Stability AI and has no part in it. Cal’s
gloss of the letters is also loose: the E is Extropianism, with effective altruism
carrying the EA pair.
- The pledge campaign is misnamed. At 5:07 the
keep-the-high-paying-job-and-give-it-away campaign is called GiveWell. GiveWell is
the charity evaluator (Holden Karnofsky and Elie Hassenfeld, 2007) — which is the other
thing Cal describes in the same breath. The 10%-pledge organisation is Giving What We
Can, founded 2009 by Toby Ord and William MacAskill, and “earning to give” was
popularised through 80,000 Hours.
- Bostrom’s Oxford institute was the Future of Humanity Institute, founded 2005 —
and it no longer exists: Oxford’s Faculty of Philosophy closed it in April 2024, after
which Bostrom resigned from the university. The episode speaks of it in the present tense.
- Moskovitz and USAID. The donation is real in substance — Moskovitz and Cari Tuna’s
giving, through Good Ventures and Coefficient Giving (the former Open Philanthropy,
renamed in late 2025), has gone heavily to global health as USAID funding collapsed,
including a Health Aid Transition Fund. The captions say USAID was “denuded by the DoD’s
efforts,” which is DOGE, not the Department of Defense.
- The Amodei/EA connections check out as described: Dario and Daniela Amodei shared a
rationalist group house with Holden Karnofsky, who co-founded GiveWell and led Open
Philanthropy; Daniela married him in 2017; FTX/Alameda money was among Anthropic’s early
funding.
- The accelerationist quotes are close paraphrases of real ones. Jensen Huang has
repeatedly called existential-risk framing “science fiction” and “not helpful,” and told
the New York Times in September 2026 that labs unable to contain their own experiments
should be shut down — which is the “just don’t build unsafe things” half. Zuckerberg’s
September 2026 post did criticise rival labs for racing toward recursive
self-improvement and argued the “significant majority” of compute should serve users.
- The Sanders legislation is the Ban Artificial Superintelligence Act, introduced by
Sen. Bernie Sanders and Rep. Greg Casar in September 2026: a permanent ban on
superintelligence development, a pause on advanced AI until a new federal AI agency sets
safety rules. MIRI endorsed it, in a position statement from Nate Soares — so Cal’s
example holds, though Soares is a rationalist (MIRI’s president) rather than an EA
proper.
- The staffer-placement claim has independent support. The Horizon Institute for
Public Service, funded by Open Philanthropy / Coefficient Giving, recruits, trains and
pays fellows placed in congressional offices and committees, federal agencies and think
tanks for up to two years, many converting to permanent posts; the conflict-of-interest
criticism Cal is gesturing at has been reported since 2023. What is not independently
verified here is the characterisation of intent — “specifically this is a plan.”
- Cal’s own affiliations and sources. He is a full professor of computer science at
Georgetown and a founding faculty member of its Center for Digital Ethics. The op-ed is
his New York Times piece of 24 September 2026 arguing Congress should investigate the AI
labs. “Normal technology” is the frame from Arvind Narayanan and Sayash Kapoor’s AI as
Normal Technology (April 2025). Adam Becker’s book is More Everything Forever (April
2025); the joint appearance with Becker is Ed Zitron’s Better Offline, “Stopping The AI
Safety Cult,” 16 September 2026.
- Not traced: the MacAskill talk Cal places at Google and its “tens of trillions of future
lives” phrasing; the Michelle Goldberg and Wall Street Journal columns; Cade Metz’s The
Daily appearance; the claim that other AI companies do not run long-horizon agent
experiments of the kind OpenAI and Anthropic do; and the reported views of unnamed
congressional staffers and unnamed cybersecurity experts, which are Cal’s private sourcing
and unverifiable from outside.
- Everything else on this page is a summary of what was said on air, including the camp
assignments themselves. The three-camp map is one participant’s model, offered as such —
Cal says in the first minute that he is winging it, that the boundaries are porous, and
that “there’s some people that fall in between and some people that won’t like the
characterization.” He also places himself in one of the three camps. Treat the page as a
record of his framework, not as a neutral census of the field.