back to indexCellular Automata and Rule 30 (Stephen Wolfram) | AI Podcast Clips
00:00:00.000 |
- So in 2002, you published A New Kind of Science, 00:00:15.960 |
Can you briefly describe the vision, the hope, 00:00:20.960 |
the main idea presented in this 1,200 page book? 00:00:27.240 |
- Sure, although it took 1,200 pages to say in the book. 00:00:35.400 |
a good way to get into it is to look at sort of 00:00:37.360 |
the arc of history and to look at what's happened 00:00:41.360 |
I mean, there was this sort of big idea in science 00:00:51.520 |
Let's use sort of the formal idea of mathematical equations 00:00:55.280 |
to describe what might be happening in the world, 00:00:58.560 |
just using sort of logical argumentation and so on. 00:01:07.840 |
to describe the natural world, which had worked pretty well. 00:01:10.520 |
But I got interested in how one could generalize 00:01:15.280 |
There is a formal theory, there are definite rules, 00:01:26.460 |
And we now have this sort of notion of programming 00:01:31.100 |
Let's use the kinds of rules that can be embodied 00:01:42.140 |
And so my kind of favorite version of these kinds 00:01:45.900 |
of simple rules are these things called cellular automata. 00:02:05.840 |
And in a series of steps that you can represent 00:02:13.060 |
according to a rule that depends on the color 00:02:15.380 |
of the cell above it and to its left and right. 00:02:21.020 |
if the cell and its right neighbor are not the same 00:02:26.020 |
and or the cell on the left is black or something, 00:02:39.280 |
That rule, I'm not sure I said it exactly right, 00:02:51.180 |
So some rules, you get a very simple pattern. 00:02:58.860 |
You start them off from a sort of simple seed. 00:03:03.460 |
But other rules, and this was the big surprise 00:03:07.900 |
the simple computer experiments to find out what happens, 00:03:10.800 |
is that they produce very complicated patterns of behavior. 00:03:14.220 |
So for example, this rule 30 rule has the feature 00:03:18.500 |
you started off from just one black cell at the top, 00:03:23.740 |
If you look like at the center column of cells, 00:03:29.340 |
it goes black, white, black, black, whatever it is. 00:03:32.020 |
That sequence seems for all practical purposes random. 00:03:39.380 |
you compute the digits of pi, 3.1415926, whatever. 00:03:48.420 |
it's the ratio of the circumference diameter of a circle, 00:03:56.440 |
they seem for all practical purposes completely random. 00:04:01.700 |
that even though the rule is very simple, much simpler, 00:04:11.700 |
you're still generating immensely complicated behavior. 00:04:16.340 |
I think you probably have said it and looked at it so long, 00:04:19.660 |
you forgot the magic of it, or perhaps you don't, 00:04:28.620 |
A one-dimensional, essentially, cellular automata, right? 00:04:43.740 |
If you were to guess what kind of things you would see, 00:05:27.260 |
And that's just, I mean, that's a magical idea. 00:05:35.220 |
but it's just, I think that has profound philosophical 00:05:48.020 |
I don't know, we can have all kinds of discussion 00:06:00.740 |
I don't know, maybe it was some psychedelics or something, 00:06:09.540 |
For some reason it's a deeply profound notion, 00:06:15.160 |
it was a very intuition-breaking thing to discover. 00:06:23.100 |
you point the computational telescope out there 00:06:26.100 |
and suddenly you see, I don't know, you know, 00:06:32.060 |
but suddenly you see something that's kind of 00:06:33.380 |
very unexpected and Rule 30 was very unexpected for me. 00:07:01.180 |
and black cell to the left and white cell to the right, 00:07:03.260 |
then the cell on the next step will be white. 00:07:05.820 |
And so here's the actual pattern that you get 00:07:08.340 |
starting off from a single black cell at the top there. 00:07:14.420 |
initial condition. - That's the initial thing. 00:07:19.380 |
And at every step, you're just applying this rule 00:07:28.740 |
you gotta get the, there's gotta be some trace 00:07:32.580 |
Okay, we'll run it, let's say, for 400 steps. 00:07:36.980 |
It's kind of aliasing a bit on the screen there, 00:07:38.700 |
but you can see there's a little bit of regularity 00:07:46.000 |
that just looks very complicated, very random. 00:07:56.100 |
- Your mind immediately starts, is there a pattern? 00:08:01.220 |
That's where the mind goes. - Well, right, so I spent, 00:08:04.740 |
And I thought, well, this is kind of interesting, 00:08:10.420 |
something will resolve into something simple. 00:08:15.980 |
of using mathematics, statistics, cryptography, 00:08:25.740 |
I started thinking maybe there's a real phenomenon here 00:09:06.300 |
even though its underlying rules may not be that complex. 00:09:24.500 |
- The truth of every sort of science discovery 00:09:29.740 |
I mean, I've spent, I happen to be interested 00:09:35.060 |
how did people come to figure out this or that thing? 00:09:38.140 |
And there's always a long kind of sort of preparatory, 00:09:46.220 |
and a mindset in which it's possible to see something. 00:09:56.420 |
I finally had a high-resolution laser printer. 00:10:01.780 |
of the acyllar automata, and I generate this one, 00:10:04.860 |
and I put it, I was on some plane flight to Europe, 00:10:10.940 |
you know, I really should try to understand this. 00:10:15.580 |
this is, I really don't understand what's going on. 00:10:24.300 |
It was not, it was depressingly unsudden, so to speak, 00:10:31.840 |
like principle of computational equivalence, for example, 00:10:35.180 |
you know, I thought, well, that's a possible thing. 00:10:50.660 |
of studying the computational universe of simple programs, 00:10:53.860 |
it took me probably a decade, decade and a half 00:11:06.180 |
in the computational universe, that's a good, you know, 00:11:09.260 |
it's a good brownie point or something for the whole idea. 00:11:21.480 |
What's been interesting sort of in the arc of history 00:11:26.980 |
it's kind of like the mathematical equations approach. 00:11:52.140 |
as somebody who's kind of lived inside this paradigm shift, 00:11:57.780 |
I mean, no doubt in sort of the history of science 00:12:00.240 |
that will be seen as an instantaneous paradigm shift, 00:12:03.260 |
but it sure isn't instantaneous when it's played out 00:12:08.720 |
And it's the kind of thing where it's sort of interesting 00:12:13.740 |
because in the dynamics of sort of the adoption 00:12:20.900 |
the younger the field, the faster the adoption typically, 00:12:45.980 |
And if I was, that makes me kind of thick-skinned 00:12:56.000 |
and any time you write a book called something 00:13:10.400 |
I have to say that I was fully aware of the fact that 00:13:14.040 |
when you see sort of incipient paradigm shifts in science, 00:13:18.880 |
the vigor of the negative response upon early introduction 00:13:23.560 |
is a fantastic positive indicator of good long-term results. 00:13:28.560 |
So in other words, if people just don't care, 00:13:50.140 |
Can you maybe talk about interesting properties 00:14:02.640 |
So I mean, the most interesting thing about cellular automata 00:14:07.460 |
is that it's hard to figure stuff out about them. 00:14:14.700 |
you try and bash them with some other technique, 00:14:26.580 |
that they're sort of showing irreducible computation. 00:14:31.760 |
"Oh, I know exactly what this is going to do. 00:14:36.020 |
- But there's specific formulations of that fact. 00:15:00.980 |
Now the question is, can you prove how random it is? 00:15:09.220 |
We haven't been able to show that it will never repeat. 00:15:11.980 |
We know that if there are two adjacent columns, 00:15:18.140 |
but just knowing whether that center column can ever repeat, 00:15:22.520 |
Another problem that I've sort of put in my collection of, 00:15:29.580 |
you know, for these three prizes for about Rule 30, 00:15:53.380 |
The problems, that's right, money's not the thing, 00:16:00.260 |
- It's just, you know, will it ever become periodic? 00:16:08.860 |
And the third problem is a little bit harder to state, 00:16:10.580 |
which is essentially, is there a way of figuring out 00:16:18.540 |
with a less computational effort than about T steps? 00:16:23.760 |
So in other words, is there a way to jump ahead and say, 00:16:42.380 |
we know what rule 30 does for a billion steps, 00:16:45.100 |
but, and maybe we'll know for a trillion steps 00:16:52.700 |
You might say, how could that possibly happen? 00:16:57.660 |
I thought, and this is typical of what happens 00:17:03.260 |
where it looks like it's just gonna be random forever, 00:17:09.060 |
And it's just, I did a search, I searched, I don't know, 00:17:11.980 |
maybe a million different rules with some criterion. 00:17:15.340 |
And this is, what's sort of interesting about that is, 00:17:21.620 |
in a kind of silly way about the computational universe, 00:17:23.860 |
which is, the animals are always smarter than you are. 00:17:31.480 |
even though I can't imagine how it's gonna do it. 00:17:37.820 |
that when I found sort of all possible things, 00:17:40.120 |
funky things, that I would have gotten my intuition wrapped 00:17:47.020 |
around the idea that these creatures are always, 00:17:58.500 |
And that makes it, that makes one feel very sort of, 00:18:18.220 |
- Oh, it's my favorite 'cause I found it first. 00:18:29.220 |
- And that doesn't prove anything about the other rules. 00:18:34.140 |
of how you go about trying to prove something 00:18:37.740 |
- Yes, and it also, all these things help build intuition. 00:18:41.060 |
That is, if it turned out that this was repetitive 00:18:43.500 |
after a trillion steps, that's not what I would expect. 00:18:51.860 |
would reveal something interesting about the-- 00:19:09.860 |
And the young chap in England named Alex Smith, 00:19:18.020 |
It took a little while to iterate, but he had a proof. 00:19:32.220 |
The big new principle is the simplest Turing machine 00:19:35.420 |
that might have been universal actually is universal, 00:19:38.380 |
and it's incredibly much simpler than the Turing machines 00:19:40.980 |
that people already knew were universal before that. 00:19:53.540 |
in that particular case, were not terribly illuminated. 00:19:55.540 |
- It would be nice if the methods would also be elegant. 00:19:59.340 |
Yeah, no, I mean, I think it's one of these things where, 00:20:02.220 |
I mean, it's like a lot of, we've talked about earlier, 00:20:04.700 |
kind of opening up AIs and machine learning and things 00:20:12.500 |
or can you sort of see the bigger picture more abstractly? 00:20:15.700 |
- It's unfortunate, I mean, with Fermat's last theorem proof, 00:20:25.060 |
I mean, it doesn't fit into the margins of a page. 00:20:31.620 |
that's another consequence of computational irreducibility, 00:20:34.860 |
this fact that there are even quite short results 00:20:39.020 |
in mathematics whose proofs are arbitrarily long. 00:20:51.940 |
How have people managed to navigate doing mathematics 00:20:56.740 |
where they're not just thrown into, it's all undecidable? 00:21:03.980 |
- And that would be, that would have a poetic beauty to it 00:21:08.980 |
if people were to find something interesting about rule 30, 00:21:17.060 |
It wouldn't say anything about the broad irreducibility 00:21:20.060 |
of all computations, but it would nevertheless 00:21:25.700 |
- Well, yeah, but to me, it's like, in a sense, 00:21:30.540 |
establishing principle of computational equivalence, 00:21:33.420 |
it's a little bit like doing inductive science anywhere. 00:21:39.220 |
the more convinced you are that it's generally true. 00:21:41.860 |
I mean, we don't get to, whenever we do natural science, 00:21:45.380 |
we say, well, it's true here that this or that happens. 00:21:49.300 |
Can we prove that it's true everywhere in the universe? 00:21:57.860 |
We're establishing facts in the computational universe.