The genius panel has some serious concerns.

Occasionally in preparing this blog, there are troughs in the technology newsfeed. But not now, and maybe never again. So it is with technology that accelerates exponentially. This idea, by the way, is a concept of which I will no longer try to convince my readers. I’m going to stop referencing why Kurzweil’s theorem, that technology advances exponentially is no longer a theorem and just move forward with the assumption that you know that it is. If you don’t agree,  then scout backwards—probably six months of previous blogs—and you’ll be on the same page. From here on, technology advances exponentially! With that being said, we are also no longer at the base of the exponential curve. We are beginning a steep climb.

Last week I highlighted Kurzweil’s upgraded prediction on the Singularity (12 years). I agree, though now I think he may be underselling things. It could easily arrive before that.

Today’s blog comes from a hot tip from one of my students. At the beginning of each semester, I always turn my students on to the idea of GoogleAlerts. It works like this: You tell Google to send you anything and everything on whatever topic interests you. Then, anytime there is news online that fits your topic, you get an email with a list of links from Google. The emails can be inundating so choose your search wisely. At any rate, my student who drank the GoogleAlert kool-aid sent me a link to a panel discussion that took place in January of 2017. The panel convened at something called Beneficial AI 2017 in Asilomar, California. And what a panel it was. Get this: Bart Selman (Cornell), David Chalmers (NYU), Elon Musk (Tesla, SpaceX), Jaan Tallinn (CSER/FLI), Nick Bostrom (FHI), Ray Kurzweil (Google), Stuart Russell (Berkeley), Sam Harris, Demis Hassabis (DeepMind). Sam is a philosopher, author, neuroscientist and noted secularist. I’ve cited nearly all of these characters before in blogs or research papers, so to see them all on one panel was, for me, amazing.

L to R: Elon Musk, Stuart Russell , Bart Selman, Ray Kurzweil, David Chalmers, Nick Bostrom, Demis Hassabis, Sam Harris, Jaan Tallinn.


Why were they there? The Future of Life Institute (FLI) organized the BAI 2017 event:

“In our sequel to the 2015 Puerto Rico AI conference, we brought together an amazing group of AI researchers from academia and industry, and thought leaders in economics, law, ethics, and philosophy for five days dedicated to beneficial AI.”

FLI works together with CSER. (The Centre for the Study of Existential Risk). I confess that I was not aware of either organization, but this is encouraging. For example, CSER’s mission is stated as

“[…]within the University of Cambridge dedicated to the study and mitigation of human extinction-level risks that may emerge from technological advances and human activity.”

FLI describes themselves thus:

“We are a charity and outreach organization working to ensure that tomorrow’s most powerful technologies are beneficial for humanity […] We are currently focusing on keeping artificial intelligence beneficial and we are also exploring ways of reducing risks from nuclear weapons and biotechnology.”

Both organizations are loaded with scientists and technologists including Steven Hawking, Bostrom, and Musk.

The panel of genius’ got off to a rocky start because there weren’t enough microphones to go around. Duh. But then things got interesting. The topic of safe AI or what these fellows refer to as AGI, Artificial General Intelligence, is a deep well fraught with promise and doom. The encouraging thing is that these organizations realize the potential for either, the discomforting thing is that they’re genuinely concerned.

As I have discussed before, this race to a superintelligence which Kurzweil moved up to 2029 a few weeks ago, is moving full speed ahead and it is climbing in a steep exponential incline. It is likely that we will be able to build it long before we have figured out how to keep it from destroying us. I’m on record as saying that even the notion of a superintelligence is an error in judgment. If what you want to do is cure disease, aging, and save the planet, why not stop short of full-tilt superintelligence. Surely you get a very, very, very intelligent AI to give you what you want and go no further. After hearing the panel discussion, however, I see this as naive. As Kurzweil stated in the discussion,

“…there really isn’t a foolproof technical solution to this… If you have an AI that is more intelligent than you and is out for your destruction, it’s out for the world’s destruction, and there is no other AI that is superior to it, that’s a bad situation. So that’s the specter […] Imagine that we’ve done our job perfectly, and we’ve created the most safe, beneficial AI possible, but we’ve let the political system become totalitarian and evil, either an evil world government or just a portion of the globe, that is that way, it’s not going to work out well. So part of the struggle is in the area of politics and policy to have the world reflect the values we want to achieve. Human AI is by definition at human levels and therefore is human. So the issue is, ‘How do we make humans ethical?’ is the same issue as, ‘How we make AIs that are at human level, ethical?’”

So there we have the problem of human nature, again. If we can’t fix ourselves if we can’t even agree on what’s broken, how can we build a benevolent god? Fortunately, brilliant minds are honestly concerned about this but that doesn’t mean they’re going to put on the brakes. It was stated in full agreement by the panel: a superintelligence is inevitable. If we don’t build it, someone else will.

It is also safe to assume that our super ethical AI won’t have the same ethics as someone else’s AI. Hence, Kurzweil’s specter. I could turn this into an essay, but I’ll stop here for now. What do you think?

Bookmark and Share

Leave a Reply

Your email address will not be published. Required fields are marked *