Received 4 september 2014 received in revised form 11 july. Jul 17, 2014 bostrom is a 41yearold academic philosopher. About nick bostrom nick bostrom is a swedishborn philosopher and polymath with a background in theoretical physics, computational neuroscience, logic, and artificial intelligence, as well as philosophy. Bostrom articulates his own warnings in a suitably fretful. The artificial intelligence channel 27,370 views 33. Aug 28, 2000 the stagnation of ai during the seventies and eighties does not have much bearing on the likelihood of ai to succeed in the future since we know that the cause responsible for the stagnation namely, that the hardware available to ai researchers was stuck at about 106 ops is no longer present. Jan 16, 2018 nick bostrom, the author of superintelligence, suggests that artificial intelligence does bring the promise of a more prosperous, smarter and safer world. There are few real world examples, because its not a history of ai, but theoretic conjectures. Taking superintelligence seriously superintelligence. Paths, dangers, strategies ebook written by nick bostrom. Nick bostrom audio books, best sellers, author bio. Jun 12, 2016 bostroms book, which is a shrill alarm call about the darker implications of artificial intelligence, is dedicated to scronkfinkle. Jun 04, 2014 nick bostrom makes a persuasive case that the future impact of ai is perhaps the most important issue the human race has ever faced.
Far from being the smartest possible biological species, we are probably better thought of as the stupidest possible biological species capable of starting a technological civilization a niche we filled because we got there first, not because we are in any sense optimally adapted to it. Sufficiently intelligent machines could improve their own capabilities faster than human computer scientists, and the outcome could be an existential catastrophe for humans. This oxford professor thinks artificial intelligence will. Summary of nick bostroms ethical issues in advanced ai april 30, 2018 superintelligence john messerly nick bostrom 1973 holds a ph. Nick bostrom is a swedishborn philosopher at the university of oxford known for his work on existential risk, the anthropic principle, human enhancement ethics, superintelligence risks, and the reversal test. Last year, a curious nonfiction book became a times bestseller. In superintelligence a thoughtprovoking look at the past, present and above all the future of ai nick bostrom, founding director of oxfords universitys future of humanity institute. Superintelligence by nick bostrom is a hard book to recommend, but is one that thoroughly covers its subject. Long convoluted sentences, with lots of commas and references to footnotes.
Bostrom could have opened with chapter 10 of the book by introducing the various castes of ai and the potential threats they pose and then gone into examining the challenges to controlling these threats chapter 9. The stagnation of ai during the seventies and eighties does not have much bearing on the likelihood of ai to succeed in the future since we know that the cause responsible for the stagnation namely, that the hardware available to ai researchers was stuck at about 106 ops is no longer present. A philosopher and technologist, bostrom asks us to think hard about. In 2011, he founded the oxford martin programme on the impacts of future technology, and is the founding director of the future of humanity institute at oxford university. Bostroms book has been translated into many languages. Elon musk nick bostrom ray kurzweil superintelligence. However, he argues, humanity may not succeed in bringing all ais promises to life. Ai is the last invention we would ever have to make the infinite monkey cage.
Nick bostrom s strategic artificial intelligence research center seeks to assist in resolving this issue by understanding, and ultimately shaping, the strategic landscape of longterm ai development on a global scale. The rest of this paper will spell it out more carefully. A defense of the warnings about ai in philosopher nick bostroms book superintelligence. Paths, dangers, strategies is a 2014 book by the swedish philosopher nick bostrom from the university of oxford. Bostrom s book, which is a shrill alarm call about the darker implications of artificial intelligence, is dedicated to scronkfinkle. Superintelligence pdf summary nick bostrom 12min blog. Bostrom, with a wealth of detail, a bit of humor, and copious endnotes, touches on relevant topics regarding how humanmade artificial intelligence ai could come into being and become far more intelligent than its creators, including.
Yes, we are worried about the existential risk of artificial. Read the book and learn about oracles, genies, singletons. It argues that if machine brains surpass human brains in general intelligence, then this new superintelligence could replace humans as the dominant lifeform on earth. Machine intelligence is the last invention that humanity will ever need to make. Everyday low prices and free delivery on eligible orders. Nick bostrom calls this phenomenon superintelligence. Superintelligence 2014 swedish philosopher nick bostrom argued that if machine brains surpass human brains in general intelligence, their superintelligence could surpass humans as dominant life forms. Ai researcher nick bostrom future of life institute. Nick bostrom is professor in the faculty of philosophy at oxford university and founding director of the future of humanity institute and of the programme on the impacts of future technology within the oxford martin school. Paths, dangers, strategies asks what will happen once we manage to build computers that are smarter than us, including what we need to do, how it is going to work, and why it has to be done the exact right way to make sure the human race does not go extinct. Paths, dangers, strategies unabridged by bostrom, nick isbn.
Download for offline reading, highlight, bookmark or take notes while you read superintelligence. Bostrom could have opened with chapter 10 of the book by introducing the various castes of ai and the potential threats they pose and then gone into examining the challenges to. Superintelligence charts the submerged rocks of the future with unprecedented detail. Anticipating superintelligence with nick bostrom twiml ai. Mps want pupils to learn to rival robots they should be equipped for a workfree world instead. Director of the future of humanity institute nick bostrom, nick bostrom 20. Philosopher david chalmers has also believed artificial. Paths, dangers, strategies by nick bostrom oxford university press, 2014 miles brundage consortium for science, policy, and outcomes, arizona state university, tempe, az 85287, united states a r t i c l e i n f o article history. Aug 19, 2014 nick bostrom doesnt worry about the same things most philosophers worry about. If it has been constructed with a roughly human level of general intelligence, the agi might collect paperclips, earn money to buy paperclips, or begin to manufacture paperclips.
Nick bostrom makes a persuasive case that the future impact of ai is perhaps the most important issue the human race has ever faced. Instead of passively drifting, we need to steer a course. Nick bostrom lays the foundation for understanding the future of humanity and intelligent life. Bostrom could have opened with chapter 10 of the book by introducing the various castes of ai and the potential threats they pose and then gone into examining. Paths, dangers, strategies became an improbable bestseller in 2014 alex massie, times scotland about the author nick bostrom is professor in the faculty of philosophy at oxford university and founding director of the future of humanity institute and of the programme on the impacts of future technology within the. Superintelligence hardcover nick bostrom oxford university press. The human brain has some capabilities that the brains of other animals lack. Nick bostrom, the author of superintelligence, suggests that artificial intelligence does bring the promise of a more prosperous, smarter and safer world. After an utterly engrossing journey that takes us to the frontiers of thinking about the human condition and the future of intelligent life, we find in nick bostroms work nothing less than a reconceptualization of the essential task of our time. Bostrom has a background in physics, computational neuroscience, and mathematical logic as well as philosophy. There are few real world examples, because its not a history of ai, but. He is a professor at oxford university, where he leads the future of humanity institute as its founding director. The oxford professor has written about the possibility that were all living in a simulation, the likelihood that. In 2009 and 2015, he was included in foreign policys top 100 global thinkers list.
Bostrom has written a book that i believe will become a classic within that subarea of artificial intelligence ai concerned with the existential dangers that could. However, the writing is dry and systematic, more like plato than wired magazine. What properties should we want a proposal for an ai governance pathway to have. Superintelligence a history of artificial intelligence. Bostroms book, which is a shrill alarm call about the darker implications of artificial intelligence, is dedicated to scronkfinkle. Summary of nick bostroms ethical issues in advanced ai. Max tegmark, professor of physics, mit those disposed to dismiss an ai takeover as science fiction may think again after reading this original and wellargued book martin rees, past president, royal society nick bostrom makes a persuasive case that the future impact of ai is perhaps the most important issue the human race has ever faced. Ai is a very interesting topic, but the writing style of nick bostrom makes what is already a complicated topic even more difficult to understand by using overly ornate language. Jul 03, 2014 superintelligence by nick bostrom is a hard book to recommend, but is one that thoroughly covers its subject. Yes, we are worried about the existential risk of artificial intelligence.
Paths, dangers, strategies, by nick bostrom, oxford, oxford university press, 2014, 352 pp. In his book, superintelligence, bostrom explains the existential crises that would emerge from artificial intelligence overpowering humans. Aug 10, 2014 the quest to create artificial intelligence is usually thought of as a crankish pursuit. A difficult read by an excellent strategic analyst on the very real existential threat posed by ai. Superintelligence by nick bostrom and a rough ride to the. Artificial intelligence is getting smarter by leaps and bounds within this century, research suggests, a computer ai could be as smart as a human being.
This book presented the first mathematical theory for how to correct for these biases. And while some books try to predict what will happen after weve created it, superintelligence is preoccupied with determining what the path towards it must be like in order for it to work out in our favor. In this episode, were joined by nick bostrom, professor in the faculty of philosophy at the university of oxford, where he also heads the future of humanity institute, a multidisciplinary institute focused on answering bigpicture questions for humanity with regards to ai safety and ethics. Sep 10, 2016 nick bostrom calls this phenomenon superintelligence. Observation selection effects in science and philosophy, p. Superintelligence paths, dangers, strategies nick bostrom. Nick bostrom doesnt worry about the same things most philosophers worry about. Nick bostrom is a swedishborn philosopher and polymath with a background in theoretical physics, computational neuroscience, logic, and artificial intelligence, as well as philosophy. Nick bostrom artificial intelligence will be the greatest revolution in history duration. The quest to create artificial intelligence is usually thought of as a crankish pursuit.
Superintelligence is a warning against developing artificial intelligence ai. Sep 22, 2014 nick bostrom lays the foundation for understanding the future of humanity and intelligent life. Takes the reader on a journey to the frontiers of thinking about the human condition and the future of intelligent life. Breaks down a vast track of difficult intellectual terrain. It is unknown whether humanlevel artificial intelligence will arrive in a matter of years, later this century, or not. Superintelligence artificial intelligence books ai books. May 05, 2015 a difficult read by an excellent strategic analyst on the very real existential threat posed by ai. Oxford futurist nick bostrom argues that artificial intelligence ai offers the promise of a safer, richer and smarter world, but that humanity may not be able to bring ais promise to fulfillment.
But, says bostrom, it could happen, perhaps within a few decades, perhaps within a few centuries. First described by bostrom 2003, a paperclip maximizer is an artificial general intelligence agi whose goal is to maximize the number of paperclips in its collection. Yet the writing is so lucid that it somehow makes it all seem easy. Lovelock, now 94, is a theorist and a prolific inventor his electron capture detector was key to the discovery of the stratospheric ozone hole.
89 1246 751 1603 476 1296 1431 542 287 1130 1226 525 1255 575 892 576 698 1593 633 1398 1220 972 377 805 424 1006 591 994 535 1219