Even if it was fully aligned with human interests, a sufficiently powerful AI could potentially overwrite its programming, discarding safety and alignment features apparently built in.

lk 209

Pildi allikas

AI safety reacheres worry (correctly) that should something like an AGI be created, humanity would no longer control its own destiny. For the first time, we would be toppled as the dominant species in the known universe.

lk 209

Pildi allikas

Massively omni-use general purpose technologies will change both society and what it means to be human

lk 203

Pildi allikas

Everywhere you look, technology accelerates this dematerialization, recusing, complexity for the end consumer by providing continuous consumption services rather than traditional buy-once products. … The question now becomes, what else could be made into service, collapsed into the existing suite of another mega-business.

lk 189

Pildi allikas

Cue an “Infocalypse” the point at which society can no longer manage a torrent of sketchy material, where information ecosystem grounding knowledge, trust and social coherension, the glue holding society together, falls apart.

lk 172–173

Pildi allikas

These [deep]fakes will be so good our rational minds will find it hard to accept they aren’t real.

lk 170

Pildi allikas

How will military and paramilitary planners react when no humans need to be sent into combat?

lk 158

Pildi allikas

That so many people profoundly feel society is failing is itself a problem: distrust breed negativity and apathy. People decline to vote.

lk 153

Pildi allikas

… much of what we see around us is powered by human intelligence in direct pursuit of monetary gain.

lk 133

Pildi allikas

It is a point so obvious it doesn’t often get mentioned: there is no central authority controlling what technologies get developed, who does it, and for what purpose; technology is an orchestra with no conductor. Yet this single fact could end up being the most significant of the twenty -first century.

lk 127

Pildi allikas