The Coming Wave

[T]he entirety of the human world depends on either living systems or our intelligence. And yet both are now in an unprecedented moment of exponential innovation and upheaval, an unparalleled augmentation that will leave little unchanged. Starting to crash around us is a new wave of technology. This wave is unleashing the power to engineer these two universal foundations: a wave of nothing less than intelligence and life... defined by two core technologies: artificial intelligence (AI) and synthetic biology. Together they will usher in a new dawn for humanity, creating wealth and surplus unlike anything ever seen. And yet their rapid proliferation also threatens to empower a diverse array of bad actors to unleash disruption, instability, and even catastrophe on an unimaginable scale. This wave creates an immense challenge that will define the twenty-first century: our future both depends on these technologies and is imperiled by them. From where we stand today, it appears that containing this wave — that is, controlling, curbing, or even stopping it is not possible.... Even as we worry about their risks, we need the incredible benefits of the technologies of the coming wave more than ever before. This is the core dilemma.

Mustafa Suleyman, The Coming Wave

If a machine can think, it might think more intelligently than we do, and then where should we be? Even if we could keep the machines in a subservient position, for instance by turning off the power at strategic moments, we should, as a species, feel greatly humbled. … This new danger … if it comes at all … is remote but not astronomically remote, and is certainly something which can give us anxiety. It is customary, in a talk or article on this subject, to offer a grain of comfort, in the form of a statement that some particularly human characteristic could never be imitated by a machine. It might for instance be said that no machine could write good English, or that it could not be influenced by sex-appeal or smoke a pipe. I cannot offer any such comfort, for I believe that no such bounds can be set.

Alan Turing, quoted by Sebastian Sunday Grève in AI’s first philosopher:  https://aeon.co/essays/why-we-should-remember-alan-turing-as-a-philosopher

[R]elying on the Internet for facts and figures is making us mindless sloths.... a study in Science ...  demonstrates that the wealth of information readily available on the Internet disinclines users from remembering what they’ve found out.


Sue Halpern, "How Robots & Algorithms Are Taking Over," New York Review (April 2, 2015)