Since its inception in 2022, The Rest is Politics has rated at or near the top of UK political podcasts, and in this polarised era has shown the value of bringing together political opposites to explore contentious public issues.
Eton-educated Rory Stewart, a former Conservative cabinet minister, has as his co-host Alastair Campbell, who became famous as Labour’s chief hard man in Tony Blair’s government 25 years ago.
It’s an inspired pairing. Campbell’s knowledge of political cut-and-thrust complements Stewart’s informed grasp of global affairs and the world of artificial intelligence. Last week the pair grilled Scottish moral philosopher William MacAskill on the looming AI revolution.
In this space a couple of years ago I repeated another philosopher’s view that the worst AI could do was make our species dumber. I’ve since heard from MacAskill and others like New York Times bestselling authors Eliezer Yudkowsky and Nate Soares, authors of a new book on advanced AI called If Anyone Builds It, Everyone Dies. I’m now persuaded that we should indeed be worried.
A disclosure: as an AI user I’m well outside the tent. I’m aware of improvements to internet searching, but my hands-on AI knowledge ends there. I would know less about the use of AI tools or agents than any experienced smartphone user.
But I do understand the motives behind the rise of AI – the pursuit of power, influence and money – and the potential for things to go badly awry. I’m guided on detail by those who, like MacAskill, have been closely involved in its development.
A year ago MacAskill urged people to reflect on living with AGI – advanced AI that’s functionally smarter than humans.“What does a good society look like when we have humans and … trillions of [virtual] AI beings?” he asked. … How do we coexist in an ethical and morally respectable way?”
Within five years, he told Campbell and Stewart, with AI able to automate research and development, “we’ll have this leap forward in AI capabilities. After that, we’ll have something like a century’s worth of technological progress happening in a decade or less.”
MacAskill is advocating passionately for greater public oversight, especially in the US, of this rapidly-unfolding expansion of AI systems to reach human-level capability in research including, importantly, research into AI itself.
Once that is achieved, he warns, AI development will be in a self-improvement cycle in which rapidly improving algorithms and chip manufacturing will see the equivalent of millions, then billions, then trillions of superhuman AI “scientists” working continuously all day every day, without any of the limitations applying to humans at work.
“These systems will collaborate across disciplines, build on each discovery instantly, and conduct experiments at unprecedented scale and speed – compressing a century of scientific progress into mere years,” leading to hasty choices and a higher risk of something going badly wrong.
The Industrial Revolution unfolded over a century in Britain. Over just years, says MacAskill, the AI revolution will be vastly more impactful and its reach will be global. He believes the next few years are humanity’s most critical moment in all history.
There are some caveats, notably energy supply. Current evolving stories in the US of proposed data centre projects – one of them in Louisiana the size of Manhattan – has seen both Democrat and Republican legislators speak out against them over their massive energy and water demands.
Some, including Sarah Wilson, the prophet of collapse I wrote about last week, believe the AI revolution’s thirst for data driving those city-scale electricity demands will ensure AI’s collapse before it really gets going.
But MacAskill told Campbell and Stewart that in the long term most computing will happen out in space “because that’s where all the energy is”, referring to the fact that accessible solar power in space is far greater than on Earth. SpaceX founder Elon Musk leads the charge for data centres in space.
In 2024 an all-male cohort of tech venture capitalists who became known as the “broligarchy” drew close to Donald Trump’s election campaign and incoming administration. The “techbros” include Musk, Peter Thiel (who backed JD Vance’s vice-presidential campaign), David Sachs, Mark Zuckerberg, Jeff Bezos and Marc Andreessen, along with the likes of Palantir CEO Alex Karp.
The potential power of these ambitious, competitive, focused, fantastically wealthy men goes to every corner of human life. Some are deeply immersed in US defence and policing. If MacAskill’s worst fears are realised one of them will end up controlling surveillance, repression, waging war – and everything else.
That’s an extreme scenario. The more likely outcome is Wilson’s argument that societal collapse will thwart the broligarchy’s best-laid plans. But I wouldn’t bet the house on it.