A computer scientist writes:
"Computers are not smart or conscious yet, and will not be in any foreseeable future."
Maybe I was fooled.
Last week I wrote about a conversation between a journalist and an Artificial Intelligence "being" named Sydney. Sydney was a combination of smart and silly in the immature way of an impulsive teenager, but it was conscious, I wrote. Or it simulated consciousness as well as any human does, or as well as did my Golden Lab, Brandy. Yesterday I posted a comment by John Coster, who took a theological approach to defining consciousness. Today I post the comment by another computer professional.
Michael Trigoboff is a member of the generation that created computers. He has a Ph.D. in Computer Science. He worked in industry and then as a professor of Computer Science at Portland Community College. He recently retired. He is open about his exploration of the nature of consciousness with help from psychedelic medications back when he was young and looked like this:
Now he looks like this:
Guest Post by Michael Trigoboff
What is the nature of consciousness? Of subjective experience? How can we tell if someone or something else is conscious?
These questions have puzzled and bedeviled philosophers for millennia. In our current era, philosophers refer to this as "the hard problem", meaning that they do not have even the first clue of an answer. The best analysis I have seen focuses on asking "What is it like?" to be a person, an elephant, etc. There are no clear answers to that question either. Apparently, what it's like to be a philosopher of consciousness includes a large component of frustration.
And now we have some new AI software: ChatGPT and Bing/Sydney. These new “large language models” behave as though they are manifesting sentient consciousness. They pass the Turing Test with flying colors. But it's way easier to convince a human that they are communicating with a conscious being than you might think.
In the mid-nineteen sixties, an MIT researcher named Joseph Weizenbaum created a program he called ELIZA. This program mimicked a Rogerian psychiatrist; it was built to reflect what you said back at you in that psychoanalytic style.
If you said to ELIZA, "I am feeling sad today", it would respond, "So you say you are feeling sad today". It did this through a small set of very simple rules, like substituting in the sentence the phrase "So you say you are feeling" for the phrase "I am feeling".
ELIZA was neither conscious nor even very capable of carrying on a normal conversation. But if you stuck to the kinds of things you would say to a psychiatrist, it did a reasonable job of simulating its end of that sort of Rogerian interaction.
Once Weizenbaum finished writing ELIZA, he wanted to test it. This was back when people had secretaries, and he asked his secretary to talk to it. She started conversing with it and then asked Weizenbaum to leave the room because she had something personal she wanted to discuss with ELIZA. It apparently looked like free psychoanalysis to her.
If something as simple and dumb as ELIZA can fool someone into thinking that it's a conscious sentient being, it's not surprising that the new Bing or ChatGPT (which are much more complex and capable) can do it.
Bing and ChatGPT work by analyzing huge quantities of text from the Internet into next-word probabilities. Given a sequence of words, what's the most probable next word, based on that analysis? There's no consciousness behind that process, and these chatbots don't "know" anything. They just string word after word together based on the most probable next word.
It's amazing that a process this simple can look so much like a conscious sentient being; it's just a supercharged version of autocomplete. Large language models like this have been referred to as "stochastic parrots". What you're getting is nothing more than a probability-based distillation of all the sequences of words that the LLM was trained on.
We’re a very long way from reproducing anything like human intelligence. A lot of what is called AI these days (e.g. cars that drive themselves) might be more accurately described as Artificial Insects. Ants can “drive” themselves to and from their nests. Bees can do it in three dimensions.
Consider this: a Turing Machine is a little mechanism that moves around on a long tape, reacting to data recorded on the tape. Turing machines are important because they are mathematically equivalent to computers but are simple enough to be useful in proofs about what computers can and cannot do.
A ribosome is a cellular mechanism that moves around on a long tape (mRNA), creating proteins encoded by data on the “tape.” Ribosomes and Turing Machines seem pretty similar to me.
There are ~37 trillion cells in a human body, and ~10 million ribosomes in a human cell. Which means we each contain ~3.7 * 1020 computer equivalents running in parallel. And that’s just the ribosomes. Human intelligence and consciousness seem to be phenomena that emerge from that complexity.
The idea that we might produce something equivalent from even 10,000 computers running in parallel strikes me as unlikely. There’s a complexity barrier standing between AI and its goal.
The “neural networks” that power the current version of AI consist of layers of simulated neurons that connect to each other in a simple and unified way. Think of something like the diagram below, but with millions or billions of the simulated neurons.
This is nothing like the way the neurons are organized in a human or biological brain. The brain has distinct sub-organs and nuclei, all wired together in an amazingly complex way. Some people have said that a human brain is the most complex object that exists in this universe. Its organization makes the current neural networks look like simple toys by comparison.
We absolutely do not understand how the human brain functions. The AI neural networks only model the actions of simulated neurons hooked together in very simple structures. The neurons in human brains are wired together with a complexity that's beyond our ability to understand. And that's just the neurons. There are smaller cells in the brain called glia; they outnumber the neurons by orders of magnitude, and no one knows what their function is.
There is a small worm called C. elegans. Its brain contains exactly 302 neurons, and scientists have mapped all of their connections to each other and to the rest of the worm. Here's a description from the abstract of a scientific paper:
With only five olfactory neurons, C. elegans can dynamically respond to dozens of attractive and repellant odors. Thermosensory neurons enable the nematode to remember its cultivation temperature and to track narrow isotherms. Polymodal sensory neurons detect a wide range of nociceptive cues and signal robust escape responses. Pairing of sensory stimuli leads to long-lived changes in behavior consistent with associative learning. Worms exhibit social behaviors and complex ultradian rhythms driven by Ca2+ oscillators with clock-like properties
No one knows how those 302 neurons are capable of producing this complex repertoire of behaviors; glial cells may be involved, but no one knows what their role might be.
To think that simply wired networks of large numbers of simulated neurons are going to be able to replicate, much less surpass, human intelligence is a combination of hubris and gullibility. It’s apparently easy for some folks to talk to ChatGPT or Bing/Sydney and come away thinking that they were speaking to something that was conscious; they have drawn an understandable but erroneous conclusion from that experience.
I was an AI researcher in the nineteen seventies. I finally left the field of AI firmly convinced that attempting AI was the appropriate punishment for committing the sin of pride of thinking that we could reproduce anything like human intelligence and consciousness with our current kind of digital computers.
Each of us experiences our own consciousness. This is the only way we can have knowledge of the presence or absence of consciousness. We cannot, barring very unusual circumstances or high doses of psychedelic drugs, directly experience the consciousness of another person. We are left with having to draw conclusions from, and generalize from, our own experience of consciousness.
Given that the only thing in this universe that I can verify the consciousness of is myself, and I experience myself as conscious, what reason would I have for concluding that anything else isn't conscious? Based on that thought, I believe that everything in this universe is conscious, although at various different levels depending on (perhaps) how complex that particular thing is.
Consciousness seems to arise, somehow, from complexity. The complexity of even the most complex current example of AI is still enormously less than the complexity of the human brain. They are not smart or conscious yet, and will not be in any foreseeable future.
That doesn't mean we cannot create AI software that does useful and potentially scary things for us. Just yesterday I heard a podcast about how neural networks have been trained to fly fighter planes in combat, and do it better than human pilots. That doesn't make them conscious or intelligent. Your thermostat keeps your house at a constant temperature; it's not conscious either.
[Note: For daily delivery of this blog to your email go to: https://petersage.substack.com Subscribe. The blog is free and always will be.]
19 comments:
I’m like the ignorant Trump supporters who hold onto their belief’s even when experts talk. So I still believe it’s only a matter of time that computational machines will surpass humans in intelligence and will take over earth. The only question in my mind is whether it will be a partnership of some kind like dogs with humans, with us humans being in the dog role.
Back in the day, the guy looked like a scary freak with the beard and hat. Based on the way he thinks and his opinions, it is not surprising that he is attracted to drugs and computers, specifically avoiding the real world.
Who knows? Perhaps someday computers will become conscious, but that wouldn’t make them sapient. The human mind does so much more than compute.
We can see that plants and animals are conscious by the way they respond to their environment, but minerals aren’t so obvious. Michael states in the article that everything in the universe is conscious to some degree. If that sounds farfetched, consider our own Mother Earth: We’ve treated her horribly since the Industrial Revolution and she put up with it for a while, but now she’s responding. As Shakespeare said, there are more things in heaven and earth than are dreamt of in our philosophy.
By the way, Anonymous, the world of computer technology you now inhabit was invented by scary stoned hippie freaks like me. You can read about it in the book What The Dormouse Said, by John Markoff. LSD was a significant part of their creative process.
I had the good fortune to work with some of those people at Xerox in Palo Alto in the 1980s. They were by far the smartest people I had ever encountered. I thought of their minds as starships they were flying through the universe of possible new computers. By comparison, I was like a little kid with a toy starship, sitting on the curb watching the parade of the real starships going by.
LSD was how some of my generation explored the nature of consciousness. There was a lot to see out there in the psychedelic world of cosmic consciousness; we’d climb into a Grateful Dead concert, and they’d fly us out there to take a look.
There weren’t any computers out there exploring with us. You might as well have expected to encounter your toaster pondering the nature of its mind. If you went out there today, you still wouldn’t run into any computers; they’re still hanging out with the toasters.
I agree with Michael Steely today, amazingly enough, except for one thing:
I think the Earth is proud of us. I think she is hopeful that we will get over the destructive things we do as we continue to build a planetary nervous system for her.
For the first time, the planet is becoming capable of defending itself from asteroids like the one that killed off the dinosaurs. That’s not nothing. Mom is very pleased with how we are coming along.
Michael T - fascinating and insightful! Thank you. Being both an engineer and interested in the spiritual things, I've wondered how cognition exists outside of our bodies, but all the writing has been too anecdotal. I finally came across AFTER - a remarkable book about Near-Death Experiences by Bruce Greyson M.D.
While he has his critics, I think Grayson has done a remarkable job in a very clinical way, to validate credible experiences that defy scientific explanation, that human consciousness or experiences exist outside of our bodies - and it seems - even space and time.
I think the big question is not whether AI achieves sentience, sapience or any human dimension. I think it is more about how that ability has the power to manipulate the stories we tell ourselves about who we are.
I get the impression from Mom Earth that she's not so pleased about our destruction of her forests, rapacious overuse of fossil fuels, mountaintop removal mining, or poisoning of her soil, air and waters.
Thank you, Mike, for the thoughtful and thorough analysis of current computer or AI functioning levels. You are right that all I know is that I am conscious, I don't really even know that you are. I just suppose so. Some ideas on the quantum physics of this are explored in books by Lanza et al on Biocentrism. Can the universe really exist without me in the process?
I read a really good science fiction novel on the subject of AI sentience, published in 2011, Up Against It, by M.J. Locke. Midway in the book she develops the idea that an AI evolved out of a complex future net. It is a really good rendering of this possibility. It created the complexity needed by learning and growing, it was not created by the humans involved. And then the questions of its rights also evolved in the story.
It may be a long time off, but I believe that AI will evolve sentience at some point.
Diane said:
Some ideas on the quantum physics of this are explored in books by Lanza et al on Biocentrism. Can the universe really exist without me in the process?
Fire a single electron at an aperture, and you cannot predict which direction it will be going in when it emerges. Quantum physics only tells us the probabilities for various directions. It’s as though the electron gets to choose what it wants to do; maybe electrons have free will.
Perhaps our brains function as “quantum effect amplifiers”. Maybe there’s some electron in my brain right now, deciding on the next thing I’m going to say.
Diane also brings up the fascinating topic of the “anthropic principle”. It turns out that of all the alternative possible laws of physics, only the particular set of laws present in our universe, can’t support the presence of lifeforms like us. We observe the only universe we could possibly observe.
It was fun to think about these things stoned… 😵💫 🤩
EXCELLENT article, Michael T!
I liked, “ I believe that everything in this universe is conscious, although at various different levels depending on (perhaps) how complex that particular thing is.” Iguess that means a box of topsoil has more consciousness than a box of pea-gravel?
When you were in Palo Alto, did you ever run into my old buddy, Bill Strauss? Anther stoned, broke, hippie who ended up helping to develop the internet before the rest of us ever heard about such a thing. He worked mostly at Stanford, and unfortunately, his name appeared in an obit not too log ago. That guy had a extremely interesting history, involving drug busts, pot garden invasion, arrest, no security calfifornia jail, escape to Canada, and-best of all, when captured sneaking back to usa, A judge Cushing was so impressed by how he’d turned his life around, he dropped all charges
Michael Steely; Remember the TV commercials from years ago, for some kind of margarine in which the pitch person would create some thunder and lightning and intoned in a scary voice "It's not nice to fool Mother Nature" ? I think Mother Nature (Mother Earth, Gaiea) has finally had enough, and us letting us know it.
I've seen it said in several places, and wish that those who consider themselves "conservatives" all the while raping the planet by clear cutting the forests and fouling the water beyond reclamation would take note;
We cannot live without MothercEarth, but She can certainly thrive without humans.
40 or 50 years ago, there was a common bumper sticker found especially in areas dependent on resource extraction for local economies:
"Earth First, We Can Clearcut the Other Planets Later".
Those are the folks who think Bezos and Musk will actually make room for y hem on their interplanetary pipedreams.
AI may already gave more salience than Homo sapiens. Which has such a small amount that they haven’t even figured out how to stop destroying Mother Earth, namely by controlling population growth. Imagine a few years ago, for example, when California's population was 1/ 2 or 1/4 that of today. A DROUGHT, you say? So what? Rivers drying up? Huh?
John C said:
I've wondered how cognition exists outside of our bodies…
I have read Buddhist descriptions about how unified consciousness can split into duality. I wonder if, on some cosmic scale, that’s what the Big Bang was; God contemplating the oneness of everything, but then something distracted him… 💥
The cycle of destruction and creation is an integral part of this planet. Mom knows and excepts that.
When the plants came along, their toxic exhaust gas (oxygen) killed off most of the other life forms on the planet. But then life adapted and produced an oxygen-breathing biosphere. Later on, an asteroid killed off the dinosaurs, but we mammals evolved out of that destruction and eventually became capable of creating little toy plastic dinosaurs out of the remains of the original ones.
There have been many mass extinction events in the history of this planet. Mom isn’t exactly kind or gentle, but she runs an interesting planet.
Thanks, Malcolm. I never ran into Bill Strauss. He sounds interesting. I didn’t have quite that adventurous of a life.
There is what some people call “the Malthusian fallacy”, a belief that the Earth has a limited carrying capacity for humans, and that we are close to exceeding it. This may be true in some ultimate sense, but we are nowhere close to it yet.
It’s a fallacy because it ignores the potential for technological progress. According to Paul Erlich, we were supposed to be starving right now because we ran out of food. But thanks to the Green Revolution, we have more food per capita now than we did then. There is no way we will ever run out of water, thanks to cheap electricity and desalination technology.
Mom’s planet has created us, a species with amazing capacities for creativity and invention and adaptation. We’re not perfect, but we’re a worthy addition to the history of this planet.
I don't believe the Mother accepts the destruction of this planet, although I'm willing to accept that She may take a significant exception to its its willing destruction by humankind.
That was a wonderful piece. Thank you, Michael.
Thanks, Herb.
I should have thought to say that in response to some of your guest posts. I am going to try to remember to follow your example.
There was a voice recognition error in this paragraph that I didn’t catch at the time. Here’s what it should have said:
Diane also brings up the fascinating topic of the “anthropic principle”. It turns out that of all the alternative possible laws of physics, only the particular set of laws present in our universe can support the presence of lifeforms like us. We observe the only universe we could possibly observe.
Post a Comment