Every star in the sky probably has planets, and life is probably emerging on these planets. But I think the commentarial space associated to these planets is so different. Our causal cones are never going to overlap, or not easily. And this is the thing that makes me sad about alien life, why it's why we have to create alien life in the lab as quickly as possible, because I don't know if we are going to be able to be able to build architectures that will intersect with alien intelligence architectures.
And intersect, you don't mean in time or space? Time and the ability to communicate. The ability to communicate. Yeah, my biggest fear in a way is that life is everywhere, but we become infinitely more lonely because of our scaffolding in that commentarial space. - The following is a conversation with Lee Cronin, his third time on this podcast.
He is a chemist from University of Glasgow, who is one of the most fascinating, brilliant, and fun to talk to scientists I've ever had the pleasure of getting to know. This is Alex Friedman Podcast. To support it, please check out our sponsors in the description. And now, dear friends, here's Lee Cronin.
- So your big assembly theory paper was published in Nature. Congratulations. - Thanks. - It created, I think it's fair to say, a lot of controversy, but also a lot of interesting discussion. So maybe I can try to summarize assembly theory, and you tell me if I'm wrong. - Go for it.
- So assembly theory says that if we look at any object in the universe, any object, that we can quantify how complex it is by trying to find the number of steps it took to create it, and also we can determine if it was built by a process akin to evolution by looking at how many copies of the object there are.
- Yeah, that's spot on. - Spot on. I was not expecting that. Okay, so let's go through definitions. So there's a central equation I'd love to talk about, but definition-wise, what is an object? - Yeah, an object, so if I'm going to try to be as meticulous as possible, objects need to be finite and they need to be decomposable into subunits.
All human-made artifacts are objects. Is a planet an object? Probably yes, if you scale out. So an object is finite and countable and decomposable, I suppose mathematically. But yeah, I still wake up some days and go, think to myself, what is an object? Because it's a non-trivial question. - Persists over time.
I'm quoting from the paper here. An object that's finite is distinguishable. So that's a weird adjective, distinguishable. - We've had so many people help offering to rewrite the paper after it came out, you wouldn't believe it's so funny. - Persists over time and is breakable such that the set of constraints to construct it from elementary building blocks is quantifiable.
Such that the set of constraints to construct it from elementary building blocks is quantifiable. - The history is in the objects. It's kind of cool, right? - So what defines the object is its history or memory, whichever is the sexier word. - I'm happy with both depending on the day.
- Okay. So the set of steps it took to create the object. So there's a sense in which every object in the universe has a history. And that is part of the thing that is used to describe its complexity. How complicated it is. Okay. What is an assembly index?
- So the assembly index, if you're to take the object apart and be super lazy about it or minimal, it's like you've got a really short term memory. So what you do is you lay all the parts on the path and you find the minimum number of steps you take on the path to add the parts together to reproduce the object.
And that minimum number is the assembly index. It's a minimum bound. And it was always my intuition the minimum bound in assembly theory was really important. I only worked out why a few weeks ago, which was kind of funny because I was just like, no, this is sacrosanct. I don't know why.
It will come to me one day. And then when I was pushed by a bunch of mathematicians, we came up with the correct physical explanation, which I can get to, but it's the minimum and it's really important. It's the minimum. And the reason I knew the minimum was right is because we could measure it.
So almost before this paper came out, we've published papers, explain how you can measure the assembly index of molecules. - Okay. So that's not so trivial to figure out. So when you look at an object, we can say a molecule, we can say object more generally to figure out the minimum number of steps it takes to create that object.
That doesn't seem like a trivial thing to do. - So with molecules, it's not trivial, but it is possible because what you can do, and because I'm a chemist, so I'm kind of like, I see the lens of the world through just chemistry. I break the molecule apart and break bonds.
And if you break up, if you take a molecule and you break it all apart, you have a bunch of atoms. And then you can say, okay, I'm going to then form bond, take the atoms and form bonds and go up the chain of events to make the molecule.
And that's what made me realize, take a toy example, literally toy example, take a Lego object, which is broken up of Lego blocks. So you could do exactly the same thing. In this case, the Lego blocks are naturally the smallest. They're the atoms in the actual composite Lego architecture.
But then if you maybe take a couple of blocks and put them together in a certain way, maybe they're offset in some way, that offset is on the memory. You can use that offset again with only a penalty of one, and you can then make a square triangle and keep going.
And you remember those motifs on the chain. So you can then leap from the start with all the Lego blocks or atoms just laid out in front of you and say, right, I'll take you, you, you, connect and do the least amount of work. So it's really like the smallest steps you can take on the graph to make the object.
And so for molecules, it came relatively intuitively. And then we started to apply it to language. We've even started to apply it to mathematical theorems. I'm so well out of my depth, but it looks like you can take minimum set of axioms and then start to build up mathematical architectures in the same way.
And then the shortest path to get there is something interesting that I don't yet understand. - So what's the computational complexity of figuring out the shortest path with molecules, with language, with mathematical theorems? It seems like once you have the fully constructed Lego castle, or whatever your favorite Lego world is, figuring out how to get there from the basic building blocks, is that an NP hard problem?
It's a hard problem. - It's a hard problem, but actually, if you look at it, so the best way to look at it, let's take a molecule. So if the molecule has 13 bonds, first of all, take 13 copies of the molecule and just cut all the bonds. So take cut 12 bonds, and then you just put them in order.
And then that's how it works. So, and you keep looking for symmetry or copies, so you can then shorten it as you go down. And that becomes combinatorially quite hard. For some natural product molecules, it becomes very hard. It's not impossible, but we're looking at the bounds on that at the moment.
But as the object gets bigger, it becomes really hard. But that's the bad news, but the good news is there are shortcuts. And we might even be able to physically measure the complexity without computationally calculating it, which is kind of insane. - Wait, how would you do that? - Well, in the case of molecule, so if you shine light on a molecule, let's take an infrared, the molecule has each of the bonds absorbs the infrared differently in what we call the fingerprint region.
And so it's a bit like, and because it's quantized as well, you have all these discrete kind of absorbances. And my intuition after we realized we could cut molecules up in mass spec, that was the first go at this. We did it with using infrared and the infrared gave us an even better correlation assembly index.
And we used another technique as well, in addition to infrared called NMR, nuclear magnetic resonance, which tells you about the number of different magnetic environments in a molecule. And that also worked out. So we have three techniques, which each of them independently gives us the same or tending towards the same assembly index for molecule that we can calculate mathematically.
- Okay, so these are all methods of mass spectrometry, mass spec, you scan a molecule, it gives you data in the form of a mass spectrum, and you're saying that the data correlates to the assembly index. - Yeah. - How generalizable is that shortcut, first of all, to chemistry, and second of all, beyond that?
'Cause that seems like a nice hack and you're extremely knowledgeable about various aspects of chemistry, so you can say, "Okay, it kind of correlates." But the whole idea behind assembly theory paper, and perhaps why it's so controversial, is that it reaches bigger. It reaches for the bigger general theory of objects in the universe.
- Yeah, I'd say so, I'd agree. So I've started assembly theory of emoticons with my lab, believe it or not. So we take emojis, pixelate them, and work out the assembly index of the emoji, and then work out how many emojis you can make on the path of emojis.
So there's the uber emoji from which all other emojis emerge, and then you can, so you can then take a photograph, and by looking at the shortest path, by reproducing the pixels to make the image you want, you can measure that. So then you start to be able to take spatial data.
Now there's some problems there. What is then the definition of the object? How many pixels? How do you break it down? And so we're just learning all this right now. - So how do you compute the, how would you begin to compute the assembly index of a graphical, like, a set of pixels on a 2D plane that form a thing?
- So you would, first of all, determine the resolution. So then what is your x, y, and what number on the x and y plane? And then look at the surface area, and then you take all your emojis and make sure they're all looked at the same resolution. - Yes.
- And then we would basically then do the exactly the same thing we would do for cutting the bonds. You'd cut bits out of the emoji, and look at the, you'd have a bag of pixels, so, and you would then add those pixels together to make the overall emoji.
- Wait a minute, but, like, first of all, not every pixel's, I mean, this is at the core, sort of, machine learning, computer vision, not every pixel is that important, and there's, like, macro features, there's micro features, and all that kind of stuff. - Exactly. - Like, you know, the eyes appear in a lot of them, the smile appears in a lot of them.
- So in the same way in chemistry we assume the bond is fundamental, what we do in there here is we assume the resolution at the scale at which we do it is fundamental, and we're just working that out, and that, you're right, that will change, right? Because as you take your lens out a bit, you, it will change dramatically, but it, but it's just a new way of looking at not just compression, what we do right now in computer science and data, one big, kind of, kind of, misunderstanding is assembly theory is telling you about how compressed the object is, that's not right, it's a how much information is required on a chain of events, because the nice thing is if, when you do compression in computer science, we're wandering a bit here, but it's, kind of, worth wandering, I think, and you, you assume you have instantaneous access to all the information in the memory.
- Yeah. - In assembly theory, you say, no, you don't get access to that memory until you've done the work, and then when you've done access to that memory, you can have access, but not to the next one, and this is how, in assembly theory, we talk about the four universes, the assembly universe, the assembly possible, and the assembly contingent, and then the assembly observed, and they're all, all scales in this combinatorial universe.
- Yeah, can you explain each one of them? - Yep, so the assembly universe is like anything goes, just, it's just combinatorial, kind of, explosion in everything. - So that's the biggest one? - That's the biggest one, it's massive. - Assembly universe, assembly possible, assembly contingent, assembly observed, and on the y-axis is assembly steps in time, and, you know, in the x-axis, as the thing expands through time, more and more unique objects appear.
- So, yeah, so assembly universe, everything goes. - Yep. - Assembly possible, laws of physics come in, in this case, in chemistry bonds. In assembly, so that means... - Those are actually constraints, I guess? - Yes, and they're the only constraints, they're the constraints of the base, so the way to look at it, you've got all your atoms, they're quantized, you can just bung them together, so then you can become a, kind of, so, in the way, in computer science speak, I suppose, the assembly universe is just, like, no laws of physics, things can fly through mountains, beyond the speed of light.
In the assembly possible, you have to apply the laws of physics, but you can get access to all the motifs instantaneously, with no effort, so that means you could make anything. Then the assembly contingent says, no, you can't have access to the highly assembled object in the future, until you've done the work in the past, on the causal chain, and that's really, the really interesting shift, where you go from assembly possible, to assembly contingent.
That is really the key thing in assembly theory, that says you cannot just have instantaneous access to all those memories, you have to have done the work somehow, the universe has to have somehow built a system that allows you to select that path, rather than other paths, and then the final thing, the assembly observed, is basically us saying, oh, these are the things we actually see, we can go backwards now, and understand that they have been created by this causal process.
- Wait a minute, so when you say the universe has to construct the system, that does the work, is that like the environment that allows for like selection? - Yeah, yeah, yeah. - That's the thing that does the selection? - You could think about in terms of a von Neumann constructor, first it's a selection, a ribosome, Tesla plant, assembling Teslas, you know, the difference between the assembly universe, in Tesla land, and the Tesla factory is, everyone says, no, Teslas are just easy, they just spring out, you know how to make them all, in a Tesla factory, you have to put things in sequence, and out comes a Tesla.
- So you're talking about the factory? - Yes, this is really nice, super important point, is that when I talk about the universe having a memory, or there's some magic, it's not that, it's that tells you that there must be a process encoded somewhere in physical reality, be it a cell, a Tesla factory, or something else that is making that object, I'm not saying there's some kind of woo-woo memory in the universe, you know, morphic resonance or something, I'm saying that there is an actual causal process that is being directed, constrained in some way, so it's not kind of just making everything.
- Yeah, but Lee, what's the factory that made the factory? So what is the, so first of all, you assume the laws of physics has just sprung to existence at the beginning, those are constraints, but what makes the factory the environment that does the selection? - This is the question of, well, it's the first interesting question that I want to answer, out of four, I think the factory emerges in the interplay between the environment and the objects that are being built, and here, let me, I'll have a go at explaining to you the shortest path.
So why is the shortest path important? Imagine you've got, I'm gonna have to go chemistry for a moment and then abstract it, so imagine you've got a given environment that you have a budget of atoms, you're just flinging together, and the objective of those atoms that are being flung together in, say, molecule A, have to make, they decompose, so molecules decompose over time, so the molecules in this environment, in this magic environment, have to not die, but they do die, there's a, they have a half-life, so the only way the molecules can get through that environment out the other side, let's pretend the environment is a box, you can go in and out without dying, and there's a, there's just an infinite supply of atoms coming, or a, well, a large supply, the molecule gets built, but the molecule that is able to template itself being built, and survives in the environment, will basically reign supreme.
Now, let's say that molecule takes 10 steps, now, and it's using a finite set of atoms, right, or now let's say another molecule, smart-ass molecule we'll call it, comes in, and can survive in that environment, and can copy itself, but it only needs five steps. The molecule that only needs five steps, because it's continue, both molecules are being destroyed, but they're creating themselves faster, they can be destroyed, you can see that the shortest path reigns supreme.
So, the shortest path tells us something super interesting about the minimal amount of information required to propagate that motif in time and space, and it's just like a kind of, it seems to be like some kind of conservation law. - So, one of the intuitions you have is the propagation of motifs in time will be done by the things that can construct themselves in the shortest path.
- Yeah. - So, like, you can assume that most of the objects in the universe are built in the shortest, in the most efficient way. - The, so... - Big loop I just took there. - Yeah, no, yes and no, because there are other things. So, in the limit, yes, because you want to tell the difference between things that have required a factory to build them and just random processes, but you can find instances where the shortest path isn't taken for an individual object, individual function, and people go, "Ah, that means the shortest path isn't right." And then I say, "Well, I don't know, I think it's right still." Because, so, of course, because there are other driving forces, it's not just one molecule.
Now, when you start to, now you start to consider two objects, you have a joint assembly space, and it's not, now it's a compromise between not just making A and B in the shortest path, you want to make A and B in the shortest path, which might mean that A is slightly longer, you have a compromise.
So, when you see slightly more nesting in the construction, when you take a given object, that can look longer, but that's because the overall function is the object is still trying to be efficient. And this is still very hand-wavy, and maybe having no legs to stand on, but we think we're getting somewhere with that.
- And there's probably some parallelization, right? So, this is all, this is not sequential, the building is, I guess, when you're talking about complex objects, you don't have to work sequentially, you can work in parallel, you can get your friends together, and they can... - Yeah, and the thing we're working on right now is how to understand these parallel processes.
Now there's a new thing we've introduced called assembly depth, and assembly depth can be lower than the assembly index for a molecule when they're cooperating together, because exactly this parallel processing is going on. And my team have been working this out in the last few weeks, because we're looking at what compromises does nature need to make when it's making molecules in the cell.
And I wonder if, you know, I'm maybe like, well, I'm always leaping out of my competence, but in economics, I'm just wondering if you could apply this in economic processes. It seems like capitalism is very good at finding shortest path, you know, every time, but there are ludicrous things that happen because actually the cost function has been minimized.
And so I keep seeing parallels everywhere where there are complex nested systems, where if you give it enough time, and you introduce a bit of heterogeneity, the system readjusts and finds a new shortest path. But the shortest path isn't fixed on just one molecule now, it's in the actual existence of the object over time.
And that object could be a city, it could be a cell, it could be a factory, but I think we're going way beyond molecules, and my competence probably should go back to molecules, but hey. - All right, before we get too far, let's talk about the assembly equation. Okay, how should we do this?
Now, let me just even read that part of the paper. We define assembly as the total amount of selection necessary to produce an ensemble of observed objects, quantified using equation one. The equation basically has A on one side, which is the assembly of the ensemble, and then a sum from one to N, where N is the total number of unique objects, and then there is a few variables in there that include the assembly index, the copy number, which we'll talk about.
That's an interesting, I don't remember you talking about that. That's an interesting addition, and I think a powerful one. It has to do with what? That you can create pretty complex objects randomly, and in order to know that they're not random, that there's a factory involved, you need to see a bunch of them.
That's the intuition there. It's an interesting intuition, and then some normalization. What else is it? - N minus one, just to make sure that more than one object, one object could be a one-off and random, and then you have more than one identical object. That's interesting. - When there's two of a thing.
- Two of a thing is super important, especially if the assembly index is high. - We could say several questions here. One, let's talk about selection. What is this term selection? What is this term evolution that we're referring to? Which aspect of Darwinian evolution are we referring to that's interesting here?
- This is probably what the paper, we should talk about the paper for a second. What it did is it kind of annoyed, we didn't know it. I mean, it got attention, and obviously the angry people were annoyed. - There's angry people in the world. That's good. - So what happened is the evolutionary biologists got angry.
We were not expecting that, because we thought evolutionary biologists would be cool. I knew that some, not many, computational complexity people would get angry, because I'd kind of been poking them, and maybe I deserved it, but I was trying to poke them in a productive way, and then the physicists kind of got grumpy, because the initial conditions tell everything.
The prebiotic chemists got slightly grumpy, because there's not enough chemistry in there, and then finally, when the creationists said it wasn't creationist enough, I was like, I've done my job. - Well, you say in the physics, they say, because you're basically saying that physics is not enough to tell the story of how biology emerges.
- I think so. - And then they said, a few physics is the beginning and the end of the story. - Yeah. So what happened is the reason why people put the phone down on the call, the paper, if you're reading the paper like a phone call, they got to the abstract, and in the abstract-- - The first sentence is pretty-- - The first two sentences caused everybody-- - Scientists have grappled with reconciling biological evolution with the immutable laws of the universe defined by physics.
- True, right? There's nothing wrong with that statement, totally true. - Yeah. "These laws underpin life's origin, evolution and the development of human culture and technology, yet they do not predict the emergence of these phenomena." Wow. First of all, we should say the title of the paper, this paper was accepted and published in Nature.
The title is "Assembly Theory Explains and Quantifies Selection and Evolution." Very humble title. And the entirety of the paper, I think, presents interesting ideas but reaches high. - I am not, I would do it all again. This paper was actually on the pre-print server for over a year. - You regret nothing.
- Yeah, I think, yeah, I don't regret anything. - You and Frank Sinatra did it your way. - What I love about being a scientist is kind of sometimes, because I'm a bit dim, I'm like, and I don't understand what people are telling me, I want to get to the point.
This paper says, "Hey, laws of physics are really cool, the universe is great, but they don't really, it's not intuitive that you just run the standard model and get life out." I think most physicists might go, "Yeah, there's, you know, it's not just, we can't just go back and say that's what happened because physics can't explain the origin of life yet." It doesn't mean it won't or can't, okay, just to be clear.
Sorry, intelligent designers, we are going to get there. Second point, we say that evolution works but we don't know how evolution got going, so biological evolution and biological selection. So for me, this seems like a simple continuum. So when I mentioned selection and evolution in the title, I think, and in the abstract, we should have maybe prefaced that and said non-biological selection and non-biological evolution.
And then that might have made it even more crystal clear, but I didn't think that biology, evolutionary biology, should be so bold to claim ownership of selection and evolution. And secondly, a lot of evolutionary biologists seem to dismiss the origin of life question, just say it's obvious. And that causes a real problem scientifically because when two different, when the physicists are like, "We own the universe, the universe is good, we explain all of it, look at us." And even biologists say, "We can explain biology." And the poor chemist in the middle going, "But hang on." And this paper kind of says, "Hey, there is an interesting disconnect between physics and biology, and that's at the point at which memories get made in chemistry through bonds.
And hey, let's look at this closely and see if we can quantify it." So yeah, I mean, I never expected the paper to kind of get that much interest. And still, I mean, it's only been published just over a month ago now. - So just to linger on the selection, what is the broader sense of what selection means?
- Yeah, that's a really, good. For selection, selection, so I think for selection you need, so this is where for me, the concept of an object is something that can persist in time and not die, but basically can be broken up. So if I was going to kind of bolster the definition of an object, so if something can form and persist for a long period of time under an existing environment that could destroy other, and I'm going to use anthropomorphic terms, I apologise, but weaker objects or less robust, then the environment could have selected that.
So good chemistry examples, if you took some carbon and you made a chain of carbon atoms, whereas if you took some, I don't know, some carbon, nitrogen and oxygen and made chains from those, you'd start to get different reactions and rearrangements. So a chain of carbon atoms might be more resistant to falling apart under acidic or basic conditions versus another set of molecules.
So it survives in that environment, so the acid pond, the resistant molecule can get through, and then that molecule goes into another environment, so that environment now maybe being an acid pond is a basic pond, or maybe it's an oxidising pond, and so if you've got carbon and it goes in an oxidising pond, maybe the carbon starts to oxidise and break apart.
So you go through all these kind of obstacle courses, if you like, given by reality. So selection is the ability that happens when an object survives in an environment for some time, but, and this is the thing that's super subtle, the object has to be continually being destroyed and made by process.
So it's not just about the object now, it's about the process and time that makes it, because a rock could just stand on the mountainside for four billion years and nothing happened to it, and that's not necessarily really advanced selection. So for selection to get really interesting, you need to have a turnover in time, you need to be continually creating objects, producing them, what we call discovery time.
So there's a discovery time for an object, when that object is discovered, if it's say a molecule that can then act on itself, or the chain of events that caused itself to bolster its formation, then you go from discovery time to production time, and suddenly you have more of it in the universe.
So it could be a self-replicating molecule, and the interaction of the molecule in the environment, in the warm little pond, or in the sea, or wherever, in the bubble, could then start to build a proto-factory, the environment. So really, to answer your question, what the factory is, the factory is the environment, but it's not very autonomous, it's not very redundant, there's lots of things that could go wrong.
So once you get high enough up the hierarchy of networks of interactions, something needs to happen, that needs to be compressed into a smaller volume and made resistant and robust. Because in biology, selection and evolution is robust. You have error correction built in, you have really, you know, there's good ways of basically making sure propagation goes on.
So really the difference between inorganic, abiotic selection and evolution, and evolution and stuff in biology is robustness. The ability to kind of propagate over, the ability to survive in lots of different environments. Whereas our poor little inorganic soul molecule, whatever, just dies in lots of different environments. So there's something super special that happens from the inorganic molecule in the environment that kills it, to where you've got evolution and cells can survive everywhere.
- How special is that? How do you know those kinds of evolution factors are everywhere in the universe? - I don't, and I'm excited because I think selection isn't special at all. I think what is special is the history of the environments on Earth that gave rise to the first cell, that now has, you know, has taken all those environments and is now more autonomous.
And I would like to think that, you know, this paper could be very wrong, but I don't think it's very wrong. It's certainly wrong, but it's less wrong than some other ideas, I know, right? And if this allows, inspires us to go and look for selection in the universe, because we now have an equation where we can say, we can look for selection going on and say, "Oh, that's interesting.
We seem to have a process that's giving us high copy number objects that also are highly complex, but that doesn't look like life as we know it." And we use that and say, "Oh, there's a hydrothermal vent. Oh, there's a process going on. There's molecular networks," because the assembly equation is not only meant to identify at the higher end advanced selection, what you get, I would call it in biology, you super advanced selection.
And even, I mean, you could use the assembly equation to look for technology and God forbid, we could talk about consciousness and abstraction, but let's keep it primitive, molecules and biology. So I think the real power of the assembly equation is to say how much selection is going on in this space.
And there's a really simple thought experiment I could do. If you have a little Petri dish, and on that Petri dish, you put some simple food. So the assembly index of all the sugars and everything is quite low. And you put a single cell of E. coli cell. And then you say, "I'm going to measure the assembly in this amount of assembly in the box." So it's quite low, but the rate of change of assembly dA/dt will go voom sigmoidal as it eats all the food.
And the number of E. coli cells will replicate because they take all the food, they can copy themselves. The assembly index of all the molecules goes up, up, up and up until the food is exhausted in the box. So now the E. coli stop... I mean, dying is probably a strong word.
They stop respiring because all the food is gone. But suddenly the amount of assembly in the box has gone up gigantically because of that one E. coli factory has just eaten through, milled lots of other E. coli factories, run out of food and stopped. And so in the initial box, although the amount of assembly was really small, it was able to replicate and use all the food and go up.
And that's what we're trying to do in the lab actually, is kind of make those kinds of experiments and see if we can spot the emergence of molecular networks that are producing complexity as we feed in raw materials and we feed a challenge, an environment. We try and kill the molecules.
And really, that's the main kind of idea for the entire paper. - Yeah, and see if you can measure the changes in the assembly index throughout the whole system. Okay, what about if I show up to a new planet, we'll go to Mars or some other planet from a different solar system, and how do we use assembly index there to discover alien life?
- Very simply, actually. Let's say we'll go to Mars with a mass spectrometer with a sufficiently high resolution. So what you have to be able to do... So a good thing about mass spec is that you can select a molecule from the mass, and then if it's high enough resolution, you can be more and more sure that you're just seeing identical copies.
You can count them. And then you fragment them and you count the number of fragments and look at the molecular weight. And the higher the molecular weight and the higher the number of the fragments, the higher the assembly index. So if you go to Mars and you take a mass spec or high enough resolution, and you can find molecules...
I'll give a guide on Earth. If you could find molecules, say, greater than 350 molecular weight with more than 15 fragments, you have found artefacts that can only be produced, at least on Earth, by life. Now you would say, "Oh, maybe the geological process." I would argue very vehemently that that is not the case.
But we can say, "Look, if you don't like the cutoff on Earth, go up higher, 30, 100," right? Because there's going to be a point where you'll find a molecule with so many different parts, the chances of you getting a molecule that has 100 different parts and finding a million identical copies, you know, that's just impossible.
That could never happen in an infinite set of universes. - Can you just linger on this copy number thing? A million different copies. What do you mean by copies and why is the number of copies important? - Yeah, that was so interesting. And I always understood the copy number is really important, but I never explained it properly for ages.
And I kept having this... It goes back to this, if I give you a, I don't know, a really complicated molecule and I say, "It's complicated," you could say, "Hey, that's really complicated, but is it just really random?" And so I realized that ultimate randomness and ultimate complexity are indistinguishable until you can see a structure in the randomness.
So you can see copies. - So copies implies structure. - Yeah, the factory. - I mean, there's a deep, profound thing in there. 'Cause if you just have a random process, you're going to get a lot of complex, beautiful, sophisticated things. What makes them complex in the way we think life is complex or, yeah, something like a factory that's operating under a selection process is there should be copies.
Is there some looseness about copies? What does it mean for two objects to be equal? - It's all to do with the telescope or the microscope you're using. And so at the maximum resolution... So the nice thing about chemists is they have this concept of the molecule and they're all familiar with the molecule.
And molecules you can hold in your hand, lots of them, identical copies. A molecule is actually a super important thing in chemistry to say, "Look, you can have a mole of a molecule, an Avogadro's number of molecules, and they're identical." What does that mean? That means that the molecular composition, the bonding and so on, the configuration is indistinguishable.
You can hold them together, you can overlay them. So the way I do it is if I say, "Here's a bag of 10 identical molecules, let's prove they're identical." You pick one out of the bag and you basically observe it using some technique and then you take it away and then you take another one out.
If you observe it using technique, you can see no differences, they're identical. It's really interesting to get right, because if you take, say, two molecules, molecules can be in different vibrational and rotational states, they're moving all the time. So with this respect, identical molecules have identical bonding. In this case, we don't even talk about chirality because we don't have a chirality detector.
So two identical molecules in one conception, assembly theory, basically considers both hands as being the same. But of course, they're not, they're different. As soon as you have a chiral distinguisher to detect the left and the right hand, they become different. And so it's to do with the detection system that you have and the resolution.
- So I wonder if there's an art and science to which detection system is used when you show up to a new planet. - Yeah, yeah, yeah. - So you're talking about chemistry a lot today. We have kind of standardized detection systems, right, of how to compare molecules. So when you start to talk about emojis and language and mathematical theorems and, I don't know, more sophisticated things at a different scale, at a smaller scale than molecules, at a larger scale than molecules, like what detection, like if we look at the difference between you and me, Lex and Lee, are we the same?
Are we different? - Sure. I mean, of course we're different close up, but if you zoom out a little bit, we'll morphologically look the same. You know, height and characteristics, hair length, stuff like that. - Well, also like the species. - Yeah, yeah, yeah. - And also there's a sense why we're both from Earth.
- Yeah, I agree. I mean, this is the power of assembly theory in that regard. So the way to look at it, if you have a box of objects, if they're all indistinguishable then using your technique, what you then do is you then look at the assembly index. Now, if the assembly index of them is really low, right, and they're all indistinguishable, then it's telling you that you have to go to another resolution.
So that would be, you know, it's kind of a sliding scale. It's kind of nice. - Got it. So those two kind of are intentional with each other. - Yeah. - The number of copies in the assembly index. - Yeah. - That's really, really interesting. So, okay, so you show up to a new planet, you'll be doing what?
- I would do mass spec. - On a sample of what? Like, first of all, like how big of a scoop do you take? Do you just take the scoop? Like what? So we're looking for primitive life. - I would look, yeah, so if you're just going to Mars or Titan or Enceladus or somewhere, so a number of ways of doing it.
So you could take a large scoop or you go for the atmosphere and detect stuff. So you could make a life meter, right? So one of Sarah's colleagues at ASU, Paul Davis, keeps calling it a life meter, which is quite a nice idea because you think about it, if you've got a living system that's producing these highly complex molecules and they drift away and they're in a highly kind of demanding environment, they could be burnt, right?
So they could just be falling apart. So you want to sniff a little bit of complexity and say warmer, warmer, warmer. Oh, we found life. We found the alien. We found the alien Elon Musk smoking a joint in the bottom of the cave on Mars or Elon himself, whatever, right?
And you say, okay, found it. So what you can do is a mass spectrometer, you could just look for things in the gas phase, or you go on the surface, drill down because you want to find molecules that are, you've either got to find the source living system because the problem with just looking for complexity is it gets burnt away.
So in a harsh environment on say on the surface of Mars, there's a very low probability that you're going to find really complex molecules because of all the radiation and so on. If you drill down a little bit, you could drill down a bit into soil that's billions of years old.
Then I would put in some solvent, water, alcohol or something, or take a scoop, make it volatile, put it into the mass spectrometer and just try and detect high complexity, high abundant molecules. And if you get them, hey, presto, you can have evidence of life. Wouldn't that then be great if you could say, okay, we've found evidence of life.
Now we want to keep the life meter, keep searching for more and more complexity until you actually find living cells. You can get those new living cells and then you could bring them back to earth, or you could try and sequence them. You could see that they have different DNA and proteins.
- Go along the gradient of the life meter. How would you build a life meter? Let's say we're together starting a new company launching a life meter. - Mass spectrometer would be the first way of doing it. - No, no, no. That's one of the major components of it.
I'm talking about if it's a device, we've got a branding logo, we're going to talk about that later. What's the input? How do you get a metered output? - I would take my life meter, our life meter, there you go. - Thank you. - Yeah, you're welcome. It would have both infrared and mass spec.
It would have two ports so it could shine a light. What it would do is you would have a vacuum chamber and you would have an electrostatic analyzer and you'd have a monochromator to producing infrared. You'd take a scoop of the sample, put it in the life meter. It would then add a solvent or heat up the sample so some volatiles come off.
The volatiles would then be put into the mass spectrometer, into electrostatic trap and you'd weigh the molecules and fragment them. Alternatively, you'd shine infrared light on them, you'd count the number of bands, but you'd have to, in that case, do some separation because you want to separate. In mass spec, it's really nice and convenient because you can separate electrostatically, but you need to have that.
- Can you do it in real time? - Yeah, pretty much. Let's go all the way back. Okay, we're really going to get this. Lex's life meter, Lex and Lee's life meter. - Excellent. It's a good ring to it. - All right. You have a vacuum chamber, you have a little nose.
The nose would have a packing material. You would take your sample, add it onto the nose, add a solvent or a gas. It would then be sucked up the nose and that would be separated using what we call chromatography. Then as each band comes off the nose, we would then do mass spec and infrared.
In the case of the infrared, count the number of bands. In the case of mass spec, count the number of fragments and weigh it. Then the further up in molecular weight range for the mass spec and the number of bands, you go up and up and up from the dead, interesting, interesting, over the threshold, oh my gosh, earth life.
Then right up to the batshit crazy, this is definitely alien intelligence that's made this life. You could almost go all the way there, same in the infrared. It's pretty simple. The thing that is really problematical is that for many years, decades, what people have done, and I can't blame them, is they've been obsessing about small biomarkers that we find on earth, amino acids, like single amino acids or evidence of small molecules and these things.
Looking for those, looking for complexity. The beautiful thing about this is you can look for complexity without earth chemistry bias or earth biology bias. Assembly theory is just a way of saying, hey, complexity and abundance is evidence of selection. That's how our universal life meter will work. - Complexity in abundance is evidence of selection.
Okay, so let's apply our life meter to earth. So if we were just to apply assembly index measurements to earth, what kind of stuff are going to get? What's impressive about some of the complexity on earth? - So we did this a few years ago when I was trying to convince NASA and colleagues that this technique could work.
Honestly, it's so funny because everyone's like, no, it ain't going to work. And it was just like, because the chemists were saying, of course there are complicated molecules out there you can detect that just form randomly. I was like, really? That was a bit like, I don't know, someone saying, of course Darwin's textbook was just written randomly by some monkeys and a typewriter.
Just for me, it was like, really? And I've pushed a lot on the chemists now, and I think most of them are on board, but not totally. I really had some big arguments, but the copy number caught there because I think I confused the chemists by saying one off.
And then when I made clear about the copy number, I think that made it a little bit easier. - Just to clarify, chemists might say that, of course, out there outside of earth, there's complex molecules. - Yes. - Okay, and then you're saying, wait a minute, that's like saying, of course, there's aliens out there.
- Yeah, exactly that. - Okay, but you're saying, you clarify that that's actually a very interesting question, and we should be looking for complex molecules of which the copy number is two or greater. - Yeah, exactly. So on earth, so coming back to earth, what we did is we took a whole bunch of samples, and we were running prebiotic chemistry experiments in the lab.
We took various inorganic minerals and extracted them, look at the volatile, because there's a special way of treating minerals and polymers in assembly theory. In our life machine, we're looking at molecules. We don't care about polymers because they're not volatile, you can't hold them. If you can't ascern that they're identical, then it's very difficult for you to work out if there's undergone selection or they're just a random mess.
Same with some minerals, but we can come back to that. So basically what you do, we got a whole load of samples, inorganic ones, we got a load of, we got Scotch whiskey, and also took a Ardberg, which is one of my favorite whiskies, which is very peaty. - What does peaty mean?
- So the way that in Scotland, in Islay, which is a little island, the Scotch, the whiskey is let to mature in barrels, and it's said that the complex molecules in the peat might find their way through into the whiskey, and that's what gives it this intense brown color and really complex flavor.
It's literally molecular complexity that does that. So vodka is the complete opposite, it's just pure. - So the better the whiskey, the higher the assembly index, or the higher the assembly index, the better the whiskey. - That's what I mean, I really love deep, peaty Scottish whiskeys. Near my house there is one of the lowland distilleries called Glengoyne, still beautiful whiskey, but not as complex.
So for fun, I took some Glengoyne whiskey in Ardberg and put them into the mass spec and measured the assembly index. I also got E. coli, so the way we do it, take the E. coli, break the cell apart, take it all apart, and also got some beer. And people were ridiculing us, saying, "Oh, beer is evidence of complexity." One of the computational complexity people was just throwing, yeah, kind of he's very vigorous in his disagreement of assembly theory, was just saying, "You don't know what you're doing, even beer is more complicated than human." What we didn't realize is that it's not beer per se, it's taking the yeast extract, taking the extract, breaking the cells, extracting the molecules, and just looking at the profile of the molecules to see if there's anything over the threshold.
And we also put in a really complex molecule taxol. So we took all of these, but also NASA gave us, I think, five samples, and they wouldn't tell us what they are. They said, "No, we don't believe you can get this to work." And they gave us some super complex samples.
And they gave us two fossils, one that was a million years old, and one was at 10,000 years old, something from Antarctica, seabed. They gave us the Murchison meteorite and a few others, put them through the system. So we took all the samples, treat them all identically, put them into mass spec, fragmented them, counted.
And in this case, implicit in the measurement was, in mass spec, you only detect peaks when you've got more than, say, let's say 10,000 identical molecules. So the copy number's already baked in. It wasn't quantified, which is super important there. This was in the first paper, because I guess it's abundant, of course.
And when you then took it all out, we found that the biological samples gave you molecules that had an assembly index greater than 15, and all the abiotic samples were less than 15. And then we took the NASA samples, and we looked at the ones that were more than 15 and less than 15, and we gave them back to NASA.
They're like, "Oh, gosh. Yep, dead, living, dead, living. You got it." And that's what we found on Earth. - That's a success. - Yeah. Oh, yeah. Resounding success. - Can you just go back to the beer and the E. coli? So what's the sum index on those? - So what you were able to do is, like, the assembly index of...
We found high assembly index molecules originating from the beer sample and the E. coli sample. - The yeast and the beer. - I mean, I didn't know which one was higher. We didn't really do any detail there, because now we are doing that, because one of the things we've done...
It's a secret, but I can tell you. - Nobody's listening. - Well, is that we've just mapped the tree of life using assembly theory, because everyone said, "Oh, you can't do it from biology." And what we're able to do is... So I think there's three ways... Well, two ways of doing tree of life...
Well, three ways, actually. - What's the tree of life? - So the tree of life is basically tracing back the history of life on Earth for all the different species, going back who evolved from what. And it all goes all the way back to the first kind of life forms, and they branch off.
And you have plant kingdom, the animal kingdom, the fungi kingdom, and different branches all the way up. And the way this was classically done... And I'm no evolutionary biologist. Evolutionary biologists are very... Tell me. Every day, at least 10 times. I want to be one, though. I kind of like biology.
It's kind of cool. - Yeah, it's very cool. Evolutionary. - But basically, what Darwin and Mendeleev and all these people do is just they draw pictures, right? And they taxa. They were able to draw pictures and say, "Oh, these look like common classes." - Yeah. - Then... - They're artists, really.
They're just, you know... - But they were able to find out a lot, right, in looking at verbrates and verbrates, camera and explosion, all this stuff. And then came the genomic revolution, and suddenly everyone used gene sequencing. And Craig Venter's a good example. I think he's gone around the world in his yacht just picking up samples, looking for new species, where he's just found new species of life just from sequencing.
It's amazing. So you have taxonomy, you have sequencing, and then you can also do a little bit of molecular archaeology, like measure the samples and kind of form some inference. What we did is we were able to fingerprint... So we took a load of random samples from all of biology, and we used mass spectrometry.
And what we did now is not just look for individual molecules, but we looked for coexisting molecules where they had to look at their joint assembly space, and where we were able to cut them apart and undergo recursion in the mass spec and infer some relationships. And we were able to recapitulate the tree of life using mass spectroscopy, no sequencing and no drawing.
- All right, can you try to say that again, but a little more detail? So recreating, what does it take to recreate the tree of life? What does the reverse engineering process look like here? - So what you do is you take an unknown sample, you pung it into the mass spec, you get a...
'Cause this comes from what you're asking, like what do you see in E. coli? And so in E. coli, you don't just see... It's not the most sophisticated cells on Earth make the most sophisticated molecules. It is the coexistence of lots of complex molecules above a threshold. And so what we realized is you could fingerprint different life forms.
So fungi make really complicated molecules. Why? Because they can't move. They have to make everything on site. Whereas some animals are lazy. They can just go eat the fungi. They don't need to make very much. And so what you do is you look at the... So you take, I don't know, the fingerprint, maybe the top number of high molecular weight molecules you find in the sample.
You fragment them to get their assembly indices. And then what you can do is you can infer common origins of molecules. You can do a kind of molecular... When the reverse engineering of the assembly space, you can infer common roots and look at what's called the joint assembly space.
But let's translate that into the experiment. Take a sample, bung it in the mass spec, take the top, say, 10 molecules, fragment them, and that gives you one fingerprint. Then you do it for another sample, you get another fingerprint. Now the question is you say, "Hey, are these samples the same or different?" And that's what we've been able to do.
And by basically looking at the assembly space that these molecules create. Without any knowledge of assembly theory, you are unable to do it. With a knowledge of assembly theory, you can reconstruct the tree. - How does knowing if they're the same or different give you the tree? - Let's go to two leaves on different branches on the tree, right?
What you can do by counting the number of differences, you can estimate how far away their origin was. - Got it. - And that's all we do. And it just works. But when we realized you could even use assembly theory to recapitulate the tree of life with no gene sequencing, we were like, "Huh." - So this is looking at samples that exist today in the world.
What about things that are no longer exist... I mean, the tree contains information about the past. Some of it is gone. - Yeah, absolutely. I would love to get old fossil samples and apply assembly theory, mass spec, and see if we can find new forms of life that are no longer amenable to gene sequencing because the DNA is all gone.
Because DNA and RNA is quite unstable, but some of the more complex molecules might be there and might give you a hint of something new. Or wouldn't it be great if you find a sample that's worth really persevering and doing the proper extraction to PCR and so on, and then sequence it, and then put it together?
- So when a thing dies, you can still get some information about its complexity. - Yeah. And it appears that you can do some dating. Now, there are really good techniques. There's radiocarbon dating. There is longer dating, going looking at radioactive minerals, and so on. And you can also, in bone, you can look at what happens after something dies.
You get what's called racemization, where the chirality in the polymers basically changes, and you get decomposition. And the deviation from the pure enantiomer to the mixture, gives you a time scale on it, a half-life. So you can date when it died. I want to use assembly theory to see if I can use it, date death and things, and trace the tree of life, and also decomposition of molecules.
- You think it's possible? - Oh yeah, without a doubt. It may not be better than what, because I was just at a conference where some brilliant people were looking at isotope enrichment, and looking at how life enriches isotopes, and they're really sophisticated stuff that they're doing. But I think there's some fun to be had there, because it gives you another dimension of dating.
How old is this molecule? In terms of, or more importantly, how long ago was this molecule produced by life? The more complex the molecule, the more prospect for decomposition, oxidation, reorganization, loss of chirality, and all that jazz. But what life also does is it enriches. As you get older, the amount of carbon-13 in you goes up, because of the way the bonding is in carbon-13.
So it has a slightly different bond strength than you. It's called a kinetic isotope effect. So you can literally date how old you are, or when you stop metabolizing. So you could date someone's debt, how old they are, I think. I'm making this up, this might be right. But I think it's roughly right.
The amount of carbon-13 you have in you, you can kind of estimate how old you are. - How old living organs, humans are? - Yeah, yeah. You could say, oh, this person is 10 years old, and this person's 30 years old, because they've been metabolizing more carbon, and they've accumulated it.
That's the basic idea. It's probably completely wrong timescale. - Signatures of chemistry are fascinating. So you've been saying a lot of chemistry examples for assembly theory. What if we zoom out and look at a bigger scale of an object? Like really complex objects, like humans, or living organisms that are made up of millions or billions of other organisms.
How do you try to apply assembly theory to that? - At the moment, we should be able to do this to morphology in cells. So we're looking at cell surfaces, and really I'm trying to extend further. It's just that we work so hard to get this paper out, and people to start discussing the ideas.
But it's kind of funny, because I think the penny is falling on this. - What does it mean for a penny to be- - I mean, the penny's dropped, right? Because a lot of people are like, "It's rubbish. It's rubbish. You've insulted me. It's wrong." The paper got published on the 4th of October.
It had 2.3 million engagements on Twitter, and it's been downloaded over a few hundred thousand times. Someone actually wrote to me and said, "This is an example of really bad writing, and what not to do." I was like, "If all of my papers got read this much, because that's the objective, if I have a publishing paper and people want to read it, I want to write that badly again." - Yeah.
I don't know what's the deep insight here about the negativity in the space. I think it's probably the immune system of the scientific community making sure that there's no bullshit that gets published. And then it can overfire, it can do a lot of damage, it can shut down conversations in a way that's not productive.
- I'll answer your question about the hierarchy and assembly, but let's go back to the perception. People saying the paper was badly written, I mean, of course we could improve it. We could always improve the clarity. - Let's go there before we go to the hierarchy. It has been criticized quite a bit, the paper.
What has been some criticism that you've found most powerful, that you can understand, and can you explain it? - Yes. The most exciting criticism came from the evolutionary biologists telling me that they thought that origin of life was a solved problem. And I was like, "Whoa, we're really onto something, because it's clearly not." And when you poked them on that, they just said, "No, you don't understand evolution." And I said, "No, no, I don't think you understand that evolution had to occur before biology, and there's a gap." That was really, for me, that misunderstanding, and that did cause an immune response, which was really interesting.
The second thing was the fact that physicists, well, the physicists were actually really polite, right? Really nice about it. But they just said, "We're not really sure about the initial conditions thing, but this is a really big debate that we should certainly get into, because the emergence of life was not encoded in the initial conditions of the universe." And I think assembly theory shows why it can't be.
Okay, sure, if you could say that again. The emergence of life was not and cannot, in principle, be encoded in the initial conditions of the universe. Just to clarify what I mean by life is like what, high assembly index objects? Yeah. And this goes back to your favorite subject.
What's that? Time. Right, so why? What does time have to do with it? Probably we can come back to it later, but I think it might be if we have time. But I think I now understand how to explain how lots of people got angry with the assembly paper, but also the ramifications of this is how time is fundamental in the universe, and this notion of commentarial spaces.
And there are so many layers on this, but I think you have to become an intuitionist mathematician, and you have to abandon platonic mathematics, and also platonic mathematics has left physics astray, but there's a lot back there. So we can go to the… Platonic mathematics, okay, it's okay. Evolutionary biologists criticize because the origin of life is understood, and not, it doesn't require an explanation that involves physics.
That's their statement. Well, I mean, they said lots of confusing statements. Basically, I realized the evolutionary biology community that were vocal, and some of them were really rude, really spiteful, and needlessly so, right? Because look, people misunderstand publication as well. Some of the people have said, "How dare this be published in Nature?
What a terrible journal." And it really, and I've said to people, "Look, this is a brand new idea that's not only potentially going to change the way we look at biology, it's going to change the way we look at the universe." And everyone's saying, "How dare you? How dare you be so grandiose?" I'm like, "No, no, no, this is not hype.
We're not saying we've invented some, I don't know, we've discovered an alien in a closet somewhere just for hype. We genuinely mean this to genuinely have the impact or ask the question." And the way people jumped on that was a really bad precedent for young people who want to actually do something new because this makes a bold claim.
And the chances are that it's not correct. But what I wanted to do is a couple of things. I wanted to make a bold claim that was precise and testable and correctable. Not another woolly information in biology argument, information Turing machine, blah, blah, blah, blah, blah. A concrete series of statements that can be falsified and explored and either the theory could be destroyed or built upon.
- Well, what about the criticism of you're just putting a bunch of sexy names on something that's already obvious? - Yeah, that's really good. So, the assembly index of a molecule is not obvious, no one had measured it before. And no one has thought to quantify selection, complexity and copy number before in such a primitive, quantifiable way.
I think the nice thing about this paper, this paper is a tribute to all the people that understand that biology does something very interesting. Some people call it negentropy, some people call it, think about organizational principles, that lots of people were not shocked by the paper because they'd done it before.
A lot of the arguments we got, some people said, "Oh, it's rubbish. Oh, by the way, I had this idea 20 years before." I was like, which one? Is it the rubbish part or the really revolutionary part? So, this kind of plucked two strings at once. It plucked the, there is something interesting that biology is as we can see around this, but we haven't quantified yet.
And what this is a first stab at quantifying that. So, the fact that people said, "This is obvious, but it's also," so if it's obvious, why have you not done it? - Sure, but there's a few things to say there. One is, this is in part of a philosophical framework because it's not like you can apply this generally to any object in the universe.
It's very chemistry focused. - Yeah, well, I think you will be able to, we just haven't got there robustly. So, we can say, how can we, let's go up a level. So, if we go up from level, let's go up from molecules to cells because you would jump to people and I jump to emoticons and both are good and they will be assembled.
- Let's stick with cells, yeah. - If we go from, so if we go from molecules to assemblies and let's take a cellular assembly, a nice thing about a cell is you can tell the difference between a eukaryote and a prokaryote, right? The organelles are specialized differently. We then look at the cell surface and the cell surface has different glycosylation patterns and these cells will stick together.
Now, let's go up a level with multicellular creatures. You have cellular differentiation. Now, if you think about how embryos develop, you go all the way back, those cells undergo differentiation in a causal way that's biomechanically a feedback between the genetics and biomechanics. I think we can use assembly theory to apply to tissue types.
We can even apply it to different cell disease types. So, that's what we're doing next but we're trying to walk, you know, the thing is I'm trying to leap ahead. I want to leap ahead to go, well, we apply it to culture. Clearly, you can apply it to memes and culture and we've also applied assembly theory to CAs and not as you think.
- Cellular automata, better. - Yeah, yeah, to cellular automata, not just as you think. Different CA rules were invented by different people at different times and one of my co-workers, very talented chap, basically was like, oh, I can realize that different people had different ideas or different rules and they copied each other and made slightly different bit but different cellular automata rules and looked at them online and so he was able to infer an assembly index and copy number of rule whatever doing this thing but I digress.
But it does show you can apply it at a higher scale. So, what do we need to do to apply assembly theory to things? We need to agree there's a common set of building blocks. So, in a cell, well, in a multicellular creature, you need to look back in time.
So, there is the initial cell which the creature is fertilized and then starts to grow and then there is cell differentiation and you have to then make that causal chain both on those. That requires development of the organism in time or if you look at the cell surfaces and the cell types, they've got different features on the cell, the walls and inside the cell.
So, we're building up but obviously, I want a leap to things like emoticons, language, mathematical theorem. - But that's a very large number of steps to get from a molecule to the human brain. - Yeah, and I think they are related but in hierarchies of emergence, right? So, you shouldn't compare them.
I mean, the assembly index of a human brain, what does that even mean? Well, maybe we can look at the morphology of the human brain. Say, all human brains have these number of features in common. If they have those number of and then let's look at a brain in a whale or a dolphin or a chimpanzee or a bird and say, "Okay, let's look at the assembly indices number of features in these," and now the copy number is just a number of how many birds are there, how many chimpanzees are there, how many humans are there.
- But then you have to discover for that the features that you would be looking for. - Yeah, and that means you need to have some idea of the anatomy. - But is there an automated way to discover features? - I guess so. I mean, and I think this is a good way to apply machine learning and image recognition just to basically characterize things.
- So apply compression to it to see what emerges and then use the thing, the features used as part of the compression as the measurement of, as the thing that is searched for when you're measuring assembly index and copy number. - And the compression has to be, remember, the assembly universe, which is you have to go from assembly possible to assembly contingent and that jump from, because assembly possible, all possible brains, all possible features all the time.
But we know that on the tree of life and also on the lineage of life, going back to Luca, the human brain just didn't spring into existence yesterday. It is a long lineage of brains going all the way back. And so if we could do assembly theory to understand the development, not just in evolutionary history, but in biological development as you grow, we are going to learn something more.
- What would be amazing is if you can use assembly theory, this framework to show the increase in the assembly index associated with, I don't know, cultures or pieces of text like language or images and so on, and illustrate without knowing the data ahead of time, just kind of like you did with NASA, that you were able to demonstrate that it applies in those other contexts.
I mean, and that, you know, probably wouldn't at first, and you have to evolve the theory somehow, you have to change it, you have to expand it, you know. - I think so. - But like that, I guess this is as a paper, a first step in saying, okay, can we create a general framework for measuring complexity of objects, for measuring life, the complexity of living organisms?
- Yeah. - That's what this is reaching for. - That is the first step, and also to say, look, we have a way of quantifying selection and evolution in a fairly, not mundane, but a fairly mechanical way. Because before now, it wasn't very, the ground truth for it was very subjective, whereas here we're talking about clean observables, and there's gonna be layers on that.
I mean, with collaborators right now, we already think we can do assembly theory on language, and not only that, wouldn't it be great if we can, so the, if we can figure out how under pressure language is gonna evolve and be more efficient, 'cause you're gonna wanna transmit things, and again, it's not just about compression, it is about understanding how you can make the most of the architecture you've already built.
And I think this is something beautiful that evolution does, we're reusing those architectures, we can't just abandon our evolutionary history, and if you don't wanna abandon your evolutionary history, and you know that evolution has been happening, then assembly theory works. And I think that's a key comment I wanna make, is that assembly theory is great for understanding where evolution has been used.
The next jump is when we go to technology, 'cause of course, if you take the M3 processor, I wanna buy, I haven't bought one yet, I can't justify it, but I want it at some point. The M3 processor arguably is, there's quite a lot of features, a quite large number, the M2 came before it, then the M1, all the way back, you can apply assembly theory to microprocessor architecture.
It doesn't take a huge leap to see that. I'm a Linux guy, by the way, so your examples go way over my head. Yeah, well, whatever. Is that, is that like a, is that a fruit company of some sort? I don't even know. Yeah, there's a lot of interesting stuff to ask about language, like you could look at, how would that work?
You could look at GPT-1, GPT-2, GPT-3, 3, 5, 4, and try to analyze the kind of language it produces. I mean, that's almost trying to look at assembly index of intelligent systems. Yeah, I mean, I think the thing about large language models, and this is a whole hobby horse I have at the moment, is that obviously they're all about the evidence of evolution in the large language model comes from all the people that produced all the language.
And that's really interesting, and all the corrections in the mechanical Turk, right? Sure. And, and so... That's the part of the history, part of the memory of the system. Exactly. So, can you, so, so it would be really interesting to basically use an assembly-based approach to making language in a hierarchy, right?
I think, my guess is that you could, we might be able to build a new type of large language model that uses assembly theory, that it has more understanding of the past and how things were created. Basically, the thing with LLMs is they're like everything, everywhere, all at once, splat, and make the user happy.
So, there's not much intelligence in the model. The model is how the human interacts with the model, but wouldn't it be great if we could understand how to embed more intelligence in the system? What do you mean by intelligence there? Like, you seem to associate intelligence with history. Yeah, well, I think selection produces intelligence.
You're almost implying that selection is intelligence. No. Yeah, kind of. I would go that, I would go out on a limb and say that, but I think it's a little bit more human beings have the ability to abstract, and they can break beyond selection. And this is what, like, Darwinian selection, because the human being doesn't have to basically do trial and error, but they can think about it and say, "Oh, that's a bad idea.
I won't do that," and then technologies and so on. So, we escaped Darwinian evolution, and now we're onto some other kind of evolution, I guess, higher level evolution. And assembly theory will measure that as well, right? Because it's all a lineage. Okay, another piece of criticism, or by way of question, is how is assembly theory, or maybe assembly index, different from Kolmogorov complexity?
So, for people who don't know, Kolmogorov complexity of an object is the length of a shortest computer program that produces the object as output. Yeah, I seem to, there seems to be a disconnect between the computational approach. So, yeah, so Kolmogorov measure requires a Turing machine, requires a computer, and that's one thing.
And the other thing is, assembly theory is supposed to trace the process by which life evolution emerged, right? That's the main thing there. There are lots of other layers. So, Kolmogorov complexity, you can approximate Kolmogorov complexity, but it's not really telling you very much about the actual, it's really telling you about like your data set, compression of your data set.
And so, that doesn't really help you identify the turtle, in this case, is the computer. And so, what assembly theory does is, I'm going to say, this is a trigger warning for anyone listening who loves complexity theory, I think that we're going to show that AIT is a very important subset of assembly theory, because here's what happens.
I think that assembly theory allows us to build, understand when were selections occurring, selection produces factories and things, factories in the end produce computers, and you can get an algorithmic information theory comes out of that. The frustration I've had with looking at life through this kind of information theory is it doesn't take into account causation.
So, the main difference between assembly theory and all these complexity measures is there's no cause or chain. And I think that's the main- That's the causal change at the core of assembly theory. Exactly. And if you've got all your data in a computer memory, all the data is the same, you can access it in the same way, you don't care, you just compress it, and you either look at a program runtime or the shortest program.
And that, for me, is absolutely not capturing what it is, what its selection does. But assembly theory looks at objects, it doesn't have information about the object history, it's going to try to infer that history by looking for the shortest history, right? The object doesn't have a Wikipedia page that goes with it, about its history.
I would say it does in a way, and it is fascinating to look at. So, you've just got the object, and you have no other information about the object. What assembly theory allows you to do just with the object is to- and the word "infer" is correct, I agree, "infer".
You say, "Well, that's not the history." But something really interesting comes from this. The shortest path is inferred from the object. That is the worst-case scenario if you have no machine to make it. So, that tells you about the depth of that object in time. And so, what assembly theory allows you to do is, without considering any other circumstances, to say from this object, "How deep is this object in time?" If we just treat the object as itself, without any other constraints.
And that's super powerful, because the shortest path then says, allows you to say, "Oh, this object wasn't just created randomly, there was a process." And so, assembly theory is not meant to, you know, one-up AIT, or to ignore the factory. It's just to say, "Hey, there was a factory.
How big was that factory, and how deep in time is it?" - But it's still computationally very difficult to compute that history, right, for complex objects. - It is, it becomes harder. But one of the things that's super nice is that it constrains your initial conditions, right? It constrains where you're going to be.
So, if you take, say, imagine, so one of the things we're doing right now is applying assembly theory to drug discovery. Now, what everyone's doing right now is taking all the proteins, and looking at the proteins, and looking at molecules docked with proteins. Why not instead look at the molecules that are involved in interacting with the receptors over time, rather than thinking about, and use the molecules that evolve over time as a proxy for how the proteins evolved over time, and then use that to constrain your drug discovery process.
You flip the problem 180, and focus on the molecule evolution, rather than the protein. And so, you can guess in the future what might happen. So, rather than having to consider all possible molecules, you know where to focus. And that's the same thing if you're looking at an assembly spaces for an object where you don't know the entire history, but you know that in the history of this object, it's not going to have some other motif there that it doesn't appear in the past.
But just even for the drug discovery point you made, don't you have to simulate all of chemistry to figure out how to come up with constraints? No. In the molecules? No. I mean, I don't know enough about protein. This is another thing that I think causes, because this paper goes across so many boundaries.
So, chemists have looked at this and said, "This is not correct reaction." I was like, "No, it's a graph." Sure, there's assembly index and shortest path examples here on chemistry. Yeah. And so, what you do is you look at the minimal constraints on that graph. Of course, it has some mapping to the synthesis, but actually, you don't have to know all of chemistry.
You can build up the constraint space rather nicely. But this is just at the beginning, right? There are so many directions this could go in. And as I said, it could all be wrong, but hopefully it's less wrong. What about the little criticism I saw of, by way of question, do you consider the different probabilities of each reaction in the chain?
So, that there could be different... When you look at a chain of events that led up to the creation of an object, doesn't it matter that some parts in the chain are less likely than others? No. It doesn't matter? No, no. Well, let's go back. So, no, not less likely, but react...
So, no. So, let's go back to what we're looking at here. So, the assembly index is the minimal path that could have created that object probabilistically. So, imagine you have all your atoms in a plasma, you've got enough energy, you've got enough... There's collisions. What is the quickest way you could zip out that molecule with no reaction constraints?
How do you define quickest there, then? It's just basically a walk on a random graph. So, we make an assumption that basically, the timescale for forming the bonds... So, no, I don't want to say that, because then it's going to have people getting obsessing about this point, and your criticism is a really good one.
What we're trying to say is like, this puts a lower bound on something. Of course, some reactions are less possible than others, but actually, I don't think chemical reactions exist. Oh, boy. What does that mean? Why don't chemical reactions exist? I'm writing a paper right now that I keep being told I have to finish, and it's called "The Origin of Chemical Reactions", and it merely says that reactivity exists as controlled by the laws of quantum mechanics, and reactions...
Chemists put names on reactions. So, you could have like, I don't know, the Wittig reaction, which is by Wittig. You could have the Suzuki reaction, which is by Suzuki. Now, what are these reactions? So, these reactions are constrained by the following. They're constrained by the fact they're on planet Earth, 1G, 298 Kelvin, 1 bar.
So, these are constraints. They're also constrained by the chemical composition of Earth, oxygen, availability, all this stuff, and that then allows us to focus in our chemistry. So, when a chemist does a reaction, that's a really nice compressed shorthand for constraint application. Glass flask, pure reagent, temperature, pressure, bom-bom-bom-bom-bom, control-control-control-control-control.
So, of course, we have bond energies. So, the bond energies are kind of intrinsic in a vacuum, if you say that. So, the bond energy, you have to have a bond. And so, for assembly theory to work, you have to have a bond, which means that bond has to give the molecule a certain half-life.
So, you're probably going to find later on that some bonds are weaker and that you are going to miss in mass spectra. When you count, look at the assembly of some molecules, you're going to miscount the assembly of the molecule because it falls apart too quickly because the bonds just form.
But you can solve that by looking at infrared. So, when people think about the probability, they're kind of misunderstanding. Assembly theory says nothing about the chemistry because chemistry is chemistry and the constraints are put in by biology. There was no chemist on the origin of life, unless you believe in the chemist in the sky and they were, you know, it's like Santa Claus, they had a lot of work to do.
But chemical reactions do not exist in the constraints that allow chemical transformations to occur, do exist. - Okay, okay. So, it's constrained to applicate, so there's no chemical reactions, it's all constraint application, which enables the emergence of, what's a different word for chemical reaction? - Transformation. - Transformation. - Yeah, like a function, it's a function.
But no, I love chemical reactions as a shorthand and so the chemists don't all go mad. I mean, of course chemical reactions exist on Earth. - It's a shorthand. - It's a shorthand for these constraints. - Right. So, assuming all these constraints that we've been using for so long, we just assume that that's always the case in natural language conversation.
- Exactly. The grammar of chemistry, of course, emerges in reactions and we can use them reliably, but I do not think the Wittig reaction is accessible on Venus. - Right, and this is useful to remember, you know, to frame it as constraint application is useful for when you zoom out to the bigger picture of the universe and looking at the chemistry of the universe and then starting to apply assembly theory.
That's interesting, that's really interesting. But we've also pissed off the chemists now. - Oh, they're pretty happy, but, well, most of them. - No, everybody, everybody deep down is happy, I think. They're just sometimes feisty, that's how they show, that's how they have fun. - Everyone is grumpy on some days when you challenge.
The problem with this paper is you, what it's like, it's almost like I went to a party, it's like you, I used to do this occasionally when I was young, is go to a meeting and just find a way to offend everyone at the meeting simultaneously. Even the factions that don't like each other, they're all unified in their hatred of you just offending them.
This paper, it feels like the person that went to the party and offended everyone simultaneously, so they stopped fighting with themselves and just focused on this paper. - Maybe just a little insider interesting information, what were the editors of Nature, the reviews and so on, how difficult was that process?
Because this is a pretty big paper. - Yeah, I mean, so when we originally sent the paper, we sent the paper and the editor said, like, this is quite a long process. We sent the paper and the editor gave us some feedback. And said, you know, I don't think it's that interesting, or it's hard, it's a hard concept.
And we asked, and the editor gave us some feedback. And Sarah and I took a year to rewrite the paper. - Was the nature of the feedback very specific on, like, this part, this part? Or was it like, what are you guys smoking, what kind of? - Yeah, it was kind of the latter, what are you smoking?
- Okay. - And, you know. - But polite and there's promise. - Yeah, well, the thing is, the editor was really critical, but in a really professional way. And I mean, for me, this was the way science should happen. So when it came back, you know, we had too many equations in the paper.
If you look at the preprint, they're just equations everywhere, like 23 equations. And when I said to Abhishek, who was the first author, we got to remove all the equations. But my assembly equations thing, Abhishek was like, you know, no, we can't. I said, well, look, if we want to explain this to people, it's a real challenge.
And so Sarah and I went through the, I think it was actually 160 versions of the paper, but we basically, we got to version 40 or something. We said, right, zero, let's start again. So we wrote the whole paper again. We knew the entire- - Amazing. - And we just went bit by bit by bit and said, what is it we want to say?
And then we sent the paper in and to our, we expected it to be rejected and not even go to review. And then we got notification back, it had gone to review and we were like, oh my God, it's so going to get rejected. How's it going to get rejected?
Because the first assembly paper that on the mass spec we sent to nature, went through six rounds of review and were rejected, right? And this biochemist just said, I don't believe you, you must be committing fraud. And a long story, probably a boring story, but in this case, it went out to review, the comments came back and the comments were incredibly, they were very deep comments from all the reviewers.
But the nice thing was the reviewers were kind of very critical, but not dismissive. They were like, oh really? Explain this, explain this, explain this, explain this. Are you sure it's not comical or off? Are you sure it's not this? And we went through, I think three rounds of review, pretty quick.
And the editor went, yeah, it's in. - Maybe you could just comment on the whole process. You've published some pretty huge papers on all kinds of topics within chemistry and beyond. Some of them have some little spice in them, a little spice of crazy. Like Tom Waits says, I like my town with a little drop of poison.
It's not a mundane paper. So what's it like psychologically to go through all this process, to keep getting rejected, to get reviews from people that don't get the paper or all that kind of stuff? Just from a question of a scientist, what is that like? - I think it's, I mean, this paper for me kind of, because this wasn't the first time we tried to publish assembly theory at the highest level.
The nature communications paper on the mass spec, on the idea, went through, went to nature and got rejected, went through six rounds of review and got rejected. And I just was so confused when the chemist said, this can't be possible. I do not believe you can measure complexity using mass spec.
And also, by the way, molecules, complex molecules can randomly form. And we're like, but look at the data, the data says. And they said, no, no, we don't believe you. And we went, and I just wouldn't give up. And the editor in the end was just like, the different editors actually, right?
- What's behind that never giving up? Is it like, when you're sitting there, 10 o'clock in the evening, there's a melancholy feeling that comes over you. And you're like, okay, this is rejection number five. Or it's not rejection, but maybe it feels like a rejection because the comments are, you totally don't get it.
Like, what gives you strength to keep going there? - I don't know. I don't normally get emotional about papers, but it's not about giving up because we want to get it published, because we want the glory or anything. It's just like, why don't you understand? And so, what I would just try to be as rational as possible and say, yeah, you didn't like it.
Tell me why. And then, sorry. Silly. Never get emotional about papers normally, but I think what we do, you just compress like five years of angst from this. - So, it's been rough. - It's not just rough. It's like, it happened, I came up with the assembly equation, remote from Sarah in Arizona and the people at SFI.
I felt like I was a mad person. Like, the guy depicted in A Beautiful Mind who was just like, not the actual genius part, but just the gibberish. Because I kept writing expanded and I have no mathematical ability at all. And I was making these mathematical expansions where I kept seeing the same motif again.
I was like, I think this is a copy number. The same string is coming again and again and again. I couldn't do the math. And then I realized the copy number fell out of the equation and everything collapsed down. I was like, oh, that works, kind of. So, we submitted the paper.
And then when it was almost accepted, the mass spec one, and it was astrobiologists said great, mass spectroscopists said great, and the chemists went, nonsense. Like, biggest pile of nonsense ever, fraud. And I was like, but why fraud? And they just said, just because. And I was like, well, and so, and I could not convince the editor in this case.
The editor was just so pissed off, because they see it as like a kind of, you know, you're wasting my time. And I would not give up. I wrote, I went and dissected, you know, all the parts. And I think, although, I mean, I got upset about it, you know, it was kind of embarrassing actually, but I guess.
But it was just trying to understand why they didn't like it. So, they were part of me was like, really devastated. And a part of me was super excited, because I'm like, huh, they can't tell me why I'm wrong. And this kind of goes back to, you know, when I was at school, I was in a kind of learning difficulties class.
And I kept going to the teacher and say, you know, how, what do I do today to prove I'm smart? And they were like, nothing, you can't. I was like, give me a job, you know, give me something to do. Give me a job to do something to do as we.
And I kind of felt like that a bit when I was arguing with the, and not arguing, there was no ad hominem, I wasn't telling the editor, they were idiots or anything like this, or the reviewers, I kept it strictly like factual. And all I did is I just kept knocking it down bit by bit by bit by bit by bit.
It was ultimately rejected, and it got published elsewhere. And then the actual experiment or data. So this is kind of the, in this paper, the experiment or justification was already published. So when we did this one, and we went through the versions, and then we sent it in, and in the end, it just got accepted.
We were like, well, that's kind of cool, right? This is kind of like, you know, some days you had, you know, the student, sorry, the first author was like, I can't believe it got accepted. Like, nor am I, but it's great. It's like, it's good. And then when the paper was published, I was not expecting the backlash.
I was expecting computational, well, no, actually, I was just expecting one person had been trolling me for a while about it, just to carry on trolling, but I didn't expect the backlash. And then I wrote to the editor and apologized. And the editor was like, what are you apologizing for?
It was a great paper. Of course it's going to get backlash. You said some controversial stuff, but it's awesome. - Well, I think it's a beautiful story of perseverance, and the backlash is just a negative word for discourse, which I think is beautiful. - I think you, as I said to, you know, when it got accepted, and people were saying, were kind of like hacking on it, and I was like, papers are not gold medals.
The reason I wanted to publish that paper in Nature is because it says, hey, there's something before biological evolution. You have to have that if you're not a creationist, by the way. This is an approach. First time someone has put a concrete mechanism, or sorry, a concrete quantification, and what comes next, you're pushing on, is a mechanism.
And that's what we need to get to, is an autocatalytic set, self-replicating molecules, some other features that come in. And the fact that this paper has been so discussed, for me, is a dream come true. Like, it doesn't get better than that. If you can't accept a few people hating it, and the nice thing is, the thing that really makes me happy, is that no one has attacked the actual physical content.
Like, you can measure the assembly index. You can measure selection now. So either that's right, or it's, well, either that's helpful or unhelpful. If it's unhelpful, this paper will sink down, and no one will use it again. If it's helpful, it'll help people build scaffold on it, and we'll start to converge to a new paradigm.
So I think that that's the thing that I wanted to see, you know, my colleagues, authors, collaborators, and people who were like, you've just published this paper, you're a chemist. Why have you done this? Like, who are you to be doing evolutionary theory? Like, well, I don't know. I mean, sorry, did I need to-- - Who is anyone to do anything?
Well, I'm glad you did. Let me just, before coming back to origin of life and these kinds of questions, you mentioned learning difficulties. I didn't know about this. So what was it like? - I wasn't very good at school, right? - This is when you were very young? - Yeah, yeah.
Well, but in primary school, my handwriting was really poor, and apparently I couldn't read, and my mathematics was very poor. So they just said, this is a problem. They identified it. My parents kind of at the time were confused because I was busy taking things apart, buying electronic junk from the shop, trying to build computers and things.
And then once I got out of, when I was, I think about the major transition in my stupidity, like, you know, everyone thought I wasn't that stupid when I was, basically everyone thought I was faking. I like stuff, and I was faking wanting to be it. So I always wanted to be a scientist.
So five, six, seven years, I'll be a scientist, take things apart. And everyone's like, yeah, this guy wants to be a scientist, but he's an idiot. And so everyone was really confused, I think, at first, that I wasn't smarter than I, you know, was claiming to be. And then I just basically didn't do well in any of the tests, and I went down and down and down and down.
And then, and I was kind of like, huh, this is really embarrassing. I really like maths, and everyone says I can't do it. I really like kind of, you know, physics and chemistry and all that in science. And people say, you know, you can't, you can't read and write.
And so I found myself in a learning difficulties class at the end of primary school and the beginning of secondary school. In the UK, secondary school is like 11, 12 years old. And I remember being put in the, in the remedial class. And the remedial class was basically full of, well, two types, three types of people.
There were people that had quite violent, right? And there were people who couldn't speak English, and there were people that really had learning difficulties. So the one thing I can objectively remember was, I mean, I could read. I like reading. I read a lot. But something in me, I was, I'm a bit of a rebel.
I refused to read what I was told to read. And I found it difficult to read individual words in the way they were told. But anyway, I got caught one day teaching someone else to read. And they said, okay, we don't understand this. I always knew I wanted to be a scientist, but I didn't really know what that meant.
And I realized you have to go to university. And I thought, I can just go to university. It's like curious people, like, no, no, no, you need to have these, you have to be able to enter these exams to get this grade point average. And the fact is, the exams you've been entered into, you're just going to get C, D, or E.
You can't even get A, B, or C, right? These are the UK GCSEs. I was like, oh, shit. And I said, can you just put me into the higher exams? They said, no, no, you're going to fail. There's no chance. So my father kind of intervened and said, you know, just let him go in the exams.
And they said, he's definitely going to fail. It's a waste of time, waste of money. And he said, well, what if we paid? So they said, well, okay. So you didn't actually have to pay. You didn't have to pay if I failed. So I took the exams and passed them, fortunately.
I didn't get the top grades, but I, you know, I got into A-levels. But then that also kind of limited what I could do at A-levels. I wasn't allowed to do A-level maths. - What do you mean you weren't allowed to? - Because I had such a bad math grade from my GCSE, I only had a C.
But they wouldn't let me go into the ABC for maths because of some kind of coursework requirement back then. So the top grade I could have got was a C. So C, D, or E. So I got a C. And they let me do kind of AS-level maths, which is this half intermediate, but go to university.
But in the end, I liked chemistry. I had a good chemistry teacher. So in the end, I got to university to do chemistry. - So through that kind of process, I think for kids in that situation, it's easy to start believing that you're not, well, how do I put it?
That you're stupid. And basically give up that you're just not good at math, you're not good at school. So this is by way of advice for people, for interesting people, for interesting young kids right now experiencing the same thing. Where was the place, what was the source of you not giving up there?
- I have no idea other than I was really, I really like not understanding stuff. For me, when I not understand something, I didn't understand, I feel like I don't understand anything now. But back then I was so, I remember when I was like, I don't know, I tried to build a laser when I was like eight.
And I thought, how hard could it be? And I basically, I was gonna build a CO2 laser. I was like, right, I think I need some partially coated mirrors, I need some carbon dioxide, and I need a high voltage. So I kind of, and I was like, I didn't have, and I was so stupid, right?
I was kind of so embarrassed. I had to make enough CO2, I actually set a fire and try to filter the flame. - Oh, nice. - To crap enough CO2. And I was like, completely failed, and I burnt half the garage down. So my parents were not very happy about that.
So that was one thing, I was like, I really like first principle thinking. And so, I remember being super curious and being determined to find answers. And so the kind of, when people do give advice about this, well, I ask for advice about this, I don't really have that much advice other than don't give up.
And one of the things I try to do as a chemistry professor in my group, is I hire people that I think that, you know, I'm kind of, who am I, if they're persistent enough, who am I to deny them the chance? Because, you know, people gave me a chance and I was able to do stuff.
- Do you believe in yourself, essentially? - I like, so I love being around smart people, and I love confusing smart people. And when I'm confusing smart people, you know, not by stealing their wallets and hiding it somewhere, but if I can confuse smart people, that is the one piece of hope that I might be doing something interesting.
- Wow, that's quite brilliant. Like as a gradient to optimize. - Yeah. - Hang out with smart people and confuse them. - Yeah. - And the more confusing it is, the more there's something there. And as long as they're not telling you just a complete idiot and they give you different reasons.
- Yeah. - And I mean, I'm, you know, if everyone, it's like with assembly theory and people said, "Oh, it's wrong." And I was like, "Why?" And they're like, "And no one could give me a consistent reason." They said, "Oh, because it's been done before, or it's just Komagolov, or it's just that and the other." So I think the thing that I like to do is, and in academia, it's hard, right?
Because people are critical, but I mean, you know, the criticism, I mean, although I got kind of upset about it earlier, which is kind of silly, but not silly, because obviously it's hard work being on your own or with a team spatially separated, like during lockdown, and try to keep everyone on board and have some faith that I've always wanted to have a new idea.
And so, you know, I like a new idea and I want to nurture it as long as possible. And if someone can give me actionable criticism, that's why I think I was trying to say earlier, when I was kind of like stuck for words, give me actionable criticism. You know, it's wrong.
Okay, why is it wrong? You say, "Oh, your equation's incorrect for this," or "Your method is wrong." And so what I try and do is get enough criticism from people to then triangulate and go back. And I've been very fortunate in my life that I've got great colleagues, great collaborators, funders, mentors, and people that will take the time to say, "You're wrong because..." And then what I have to do is integrate the wrongness and go, "Oh, cool.
Maybe I can fix that." And I think criticism is really good. People have a go at me because I'm really critical. But I'm not criticizing you as a person. I'm just criticizing the idea and trying to make it better and say, "Well, what about this?" And sometimes I'm kind of, you know, my filters are kind of truncated in some ways.
I'm just like, "That's wrong. That's wrong. That's wrong. I want to do this." And people are like, "Oh my God, you just told me you destroyed my life's work." I'm like, "Relax. No, I'm just like, let's make it better." And I think that we don't do that enough because we're either personally critical, which isn't helpful, or we don't give any criticism at all because we're too scared.
Yeah, I've seen you be pretty aggressively critical, but every time I've seen it, it's the idea, not the person. I'm sure I make mistakes on that. I mean, I argue lots with Sarah, and she's kind of shocked. I've argued with Yasha in the past, and he's like, "You're just making it up." I'm like, "No, not quite, but kind of." I had a big argument with Sarah about time.
She's like, "No, time doesn't exist." I'm like, "No, no, time does exist." And as she realized that her conception of assembly theory and my conception of assembly theory were the same thing, necessitated us to abandon the fact that time is eternal, to actually really fundamentally question how the universe produces combinatorial novelty.
- So time is fundamental for assembly theory? I'm just trying to figure out where you and Sarah converge. - I think assembly theory is fine in this time right now, but I think it helps us understand that something interesting is going on. I've been really inspired by a guy called Nick Gizen.
I'm going to butcher his argument, but I love his argument a lot, so I hope he forgives me if he hears about it. Basically, if you want free will, time has to be fundamental, and if you want time to be fundamental, you have to give up on platonic mathematics, and you have to use intuition as mathematics, by the way.
Again, I'm going to butcher this, but basically, Hilbert said that infinite numbers are allowed, and I think it was Brouwer who said, "No, all numbers are finite." So let's go back a step, because people are going to say, "Assembly theory seems to explain that large combinatorial space allows you to produce things like life and technology, and that large combinatorial space is so big, it's not even accessible to a Sean Carroll, David Deutch multiverse, that physicists saying that all of the universe already exists in time is probably, provably - that's a strong word - not correct.
That we are going to know that the universe as it stands, the present, the way the present builds the future, so big, the universe can't ever contain the future. And this is a really interesting thing. I think Max Tegmark has this mathematical universe, which says, you know, the universe is kind of like a block universe, and I apologize to Max if I'm getting it wrong, but people think you can just move - you have the initial conditions, and you can run the universe, and right to the end, and go backwards and forwards in that universe.
That is not correct. - Yeah, let me load that in. The universe is not big enough to contain the future. - Yeah, that's why. - That's another, that's a beautiful way of saying that time is fundamental. - Yes, and that you can have, and that's what, this is why the law of the excluded middle, something is true or false, only works in the past.
Is it going to snow in New York next week, or in Austin? You might in Austin say probably not, in New York you might say yeah. If you go forward to next week and say, did it snow in New York last week, true or false, you can answer that question.
The fact that the law of the excluded middle cannot apply to the future explains why time is fundamental. - Well, I mean, that's a good example, intuitive example, but it's possible that we might be able to predict, you know, whether it's gonna snow if we had perfect information. - I think we-- - You're saying not.
- Impossible. Impossible. So here's why. I'll make a really quick argument, and this argument isn't mine, it's Nick's and a few other people. - Can you explain his view on fundamental, on time being fundamental? - Yeah, so I'll give my view, which kind of resonates with his, but basically, it's very simple, actually.
He would say that free will, your ability to design and do an experiment is exercising free will. So he used that thought process. I never really thought about it that way, and that you actively make decisions. I do think that, I used to think that free will was a kind of consequence of just selection, but I'm kind of understanding that human free will is something really interesting, and he very much inspired me.
But I think that what Sarah Walker said that inspired me as well, that these will converge, is that I think that the universe, and the universe is very big, huge, but actually, the place that is largest in the universe right now, the largest place in the universe is Earth.
- Yeah, I've seen you say that, and boy does that, that's an interesting one to process. What do you mean by that, Earth is the biggest place in the universe? - Because we have this combinatorial scaffolding going all the way back from Luca, so you've got cells that can self-replicate, and then you go all the way to terraforming the Earth, you've got all these architectures, the amount of selection that's going on, biological selection, just to be clear, biological evolution, and then you have multicellularity, then animals, and abstraction, and with abstraction, there was another kick, because you can then build architectures, and computers, and cultures, and language, and these things are the biggest things that exist in the universe, because we can just build architectures that couldn't naturally arise anywhere, and the further that distance goes in time, and it's gigantic, and-- - From a complexity perspective.
- Yeah. - Okay, wait a minute, but, I mean, I know you're being poetic, but how do you know there's not other Earth-like, like, how do you know, you're basically saying Earth is really special, it's awesome stuff as far as we look out, there's nothing like it going on, but how do you know there's not nearly infinite number of places where cool stuff like this is going on?
- I agree, and I would say, I'll say again that Earth is the most gigantic thing we know in the universe, commentarily, we know. - We know. - Now, now, I guess, this is just purely a guess, I have no data, but other than hope, well, maybe not hope, maybe, no, I have some data, that every star in the sky probably has planets, and life is probably emerging on these planets, but the amount of contingency that is associated with life is, I think, the commentarial space associated with these planets is so different, we're never gonna, our causal cones are never gonna overlap, or not easily, and this is the thing that makes me sad about alien life, why it's why we have to create alien life in the lab as quickly as possible, because I don't know if we are gonna be able to, be able to build architectures that will intersect with alien intelligence and architectures.
- Intersect, you don't mean in time or space? - Time and the ability to communicate. - The ability to communicate. - Yeah, my biggest fear, in a way, is that life is everywhere, but we become infinitely more lonely because of our scaffolding in that commentarial space, because it's so big, and-- - So you're saying the constraints created by the environment that led to the factory of Darwinian evolution are just like this little tiny cone in a nearly infinite commentarial space.
- Exactly. - And so there's other cones like it, and why can't we communicate with other, just because we can't create it, doesn't mean we can't appreciate the creation, right, sorry, detect the creation. - I truly don't know, but it's an excuse for me to ask for people to give me money to make a planet simulator.
- Yeah, right. - If I can make-- - With a different-- - Like another shameless say, it's like, give me money, I need money. - This was all a long plug for a planet simulator. - It's like, you know-- - Hey, I'll be the first in line to donate.
- My Rick garage has run out of room, you know? - Yeah. - No, um-- - And this is a planet simulator, you mean like a different kind of planet? - Yeah. - With different sets of environments and pressures. - Exactly, if we could basically recreate the selection before biology, as we know it, that gives rise to a different biology, we should be able to put the constraints on where I look in the universe.
So here's the thing, here's my dream. My dream is that by creating life in the lab, and based upon constraints we understand, so let's go for Venus-type life or Earth-type life or something, again, do Earth 2.0, screw it, let's do Earth 2.0. And Earth 2.0 has a different genetic alphabet, fine, that's fine, different protein alphabet, fine, have cells and evolution, all that stuff.
We will then be able to say, okay, life is a more general phenomena, selection is more general than what we think is the chemical constraints on life, and we can point the Jane's Web and other telescopes at other planets that we are in that zone, we are most likely to concomitantly overlap with, right?
So there are chemistry-- - You're looking for some overlap. - And then we can then basically shine light on them literally, and look at light coming back, and apply advanced assembly theory to general theory of language that we will get, and say, huh, in that signal, it looks random, but there's a copy number.
Oh, this random set of things that shouldn't be, that looks like a true random number generator has structure as a, not Komagolov, AIT-type structure, but evolutionary structure, given by assembly theory, and we start to, but I would say that, 'cause I'm a shameless assembly theorist. - Yeah, it just feels like the cone, and I might be misusing the word cone here, but the width of the cone is growing faster, is growing really fast to where eventually all the cones overlap, even in a very, very, very large combinatorial space.
It just, but then again, if you're saying the universe is also growing very quickly in terms of possibilities. - I hope that as we build abstractions, the main, I mean, one idea is that as we go to intelligence, intelligence allows us to look at the regularities around us in the universe, and that gives us some common grounding to discuss with aliens, and you might be right, that we will overlap there, even though we have completely different chemistry, literally completely different chemistry, that we will be at a past information from one another, but it's not a given, and I have to kind of try and divorce hope and emotion away from what I can logically justify.
- But it's just hard to intuit a world, a universe, where there's nearly infinite complexity objects, and they somehow can't detect each other. - But the universe is expanding, but the nice thing is, I would say, I would look, you see, I think Carl Sagan did the wrong thing, well, not the wrong thing, he flicked the Voyager probe around a pale blue dot and said, "Look how big the universe is." I would have done it the other way around and said, "Look at the Voyager probe that came from the planet Earth, that came from Luca, look at how big Earth is." - Then it produced that.
- It produced that. - Yeah. - And that, I think, is completely amazing, and then that should allow people on Earth to think about, well, probably we should try and get causal chains off Earth onto Mars, onto the Moon, wherever, whether it's human life or Martian life that we create, it doesn't matter.
But I think this commentarial space tells us something very important about the universe, and that I realized in assembly theory that the universe is too big to contain itself. And I think this is, now coming back, and I want to kind of change your mind about time, 'cause I'm guessing that your time is just a coordinate.
- Yeah. - So I'm gonna change-- - I'm guessing you're one of those, yeah. - I'm gonna change your, one of those, I'm gonna change your mind in real time, or at least attempt. - Oh, in real time, there you go. I already got the tattoo, so this is gonna be embarrassing if you change my mind.
- But you can just add an arrow of time onto it, right? - Yeah, true, just modify it. - Or erase it a bit. - Yeah. - So, and the argument that I think that is really most interesting is, people say the initial conditions specify the future of the universe.
Okay, fine, let's say that's the case for a moment. Now let's go back to Newtonian mechanics. Now, the uncertainty principle in Newtonian mechanics is this. If I give you the coordinates of an object moving in space, and the coordinates of another object and they collide in space, and you know those initial conditions, you should know exactly what's gonna happen.
However, you cannot specify these coordinates to infinite precision. Now everyone said, "Oh, this is kind of like the chaos theory argument." No, no, it's deeper than that. Here's a problem with numbers. This is where Hilbert and Brouwer fell out. To have the coordinates of this object, a given object as it's colliding, you have to have them to infinite precision.
That's what Hilbert says. He says, "No problem, infinite precision is fine. Let's just take that for granted." But when the object is finite, and it can't store its own coordinates, what do you do? So in principle, if a finite object cannot be specified to infinite precision, in principle, the initial conditions don't apply.
- Well, how do you know it can't store its... - Well, how do you store an infinitely long number in a finite size? - Well, we're using infinity very loosely here. - No, no, we're using... - Infinite precision, I mean, not loosely, but... - Very precisely. - So you think infinite precision is required?
- Well, let's take the object. Let's say the object is a golf ball. Golf ball is a few centimeters in diameter. We can work out how many atoms are on the golf ball. And let's say we can store numbers down to atomic dislocations. So we can work out how many atoms there are in the golf ball, and we can store the coordinates that's in that golf ball down to that number.
But beyond that, we can't. Let's make the golf ball smaller. And this is where I think that we think that we get randomness in quantum mechanics. And some people say, "You can't get randomness in quantum mechanics, it's deterministic." But aha, this is where we realize that classical mechanics and quantum mechanics suffer from the same uncertainty principle.
And that is the inability to specify the initial conditions to a precise enough degree to give you determinism. The universe is intrinsically too big, and that's why time exists. It's non-deterministic. Looking back into the past, you can use logical arguments because you can say, "Was it true or false?" You already know.
But the fact we are unable to predict the future with the precision is not evidence of lack of knowledge, it's evidence the universe is generating new things. - Okay, so to you, first of all, quantum mechanics, you can just say statistically what's going to happen when two golf balls hit each other.
- Statistically, but sure, I can say statistically what's going to happen, but then when they do happen, and you keep nesting it together, you can't... I mean, it goes almost back to look at... Let's think about entropy in the universe. So how do we understand entropy change? Well, we could do the...
Look at our process. We can use the Ergodic hypothesis. We can also have the counterfactuals, where we have all the different states, and we can even put that in the multiverse, right? But both those are kind of... They're non-physical. The multiverse kind of collapses back to the same problem about the precision.
So if you accept you don't have to have true and false going forward into the future, the real numbers are real. They're observables. - We're trying to see exactly where time being fundamental sneaks in, in this difference between the golf ball can't contain its own position perfectly, precisely, how that leads to time needing to be fundamental.
- Let me... Do you believe or do you accept you have free will? - Yeah, I think at this moment in time, I believe that I have free will. - So then you have to believe that time is fundamental. - I understand that's a statement you've made. - Well, no, that we can logically follow, because if you don't have free will...
So if you're in a universe that has no time, the universe is deterministic. If it's deterministic, then you have no free will. - I think the space of how much we don't know is so vast that saying the universe is deterministic and from that jumping, there's no free will is just too difficult of a leap.
- No, I logically follow. No, no, I don't disagree. I'm not saying any... I mean, it's deep and it's important. All I'm saying, and it's actually different to what I've said before, is that if you don't require platonistic mathematics and accept that non-determinism is how the universe looks, and that gives us our creativity and the way the universe is getting novelty, it's kind of really deeply important in assembly theory, because assembly theory starts to actually give you a mechanism why you go from boring time, which is basically initial conditions specify everything, to a mismatch in creative time.
And I hope we'll do experiments. I think it's really important to... I would love to do an experiment that proves that time is fundamental and the universe is generating novelty. I don't know all the features of that experiment yet, but by having these conversations openly and getting people to think about the problems in a new way, better people, more intelligent people with good mathematical backgrounds can say, "Oh, hey, I've got an idea." I would love to do an experiment that shows that the universe...
I mean, universe is too big for itself going forward in time. And this is why I really hate the idea of the Boltzmann brain. The Boltzmann brain makes me super... Everyone's having a free lunch. It's like let's break all the laws of physics. So, a Boltzmann brain is this idea that in a long enough universe, a brain will just emerge in the universe as conscious.
And that neglects the causal chain of evolution that's required to produce that brain. And this is where the computational argument really falls down because the computation is to say, "I can calculate the probability of a Boltzmann brain." And they'll give you a probability, but I can calculate the probability of a Boltzmann brain, zero.
- Just because the space of possibility is so large? - Yeah. It's like when we start fooling ourselves with numbers that we can't actually measure and we can't ever conceive of, I think it doesn't give us a good explanation. And I've become... I want to explain why life is in the universe.
I think life is actually a novelty miner. I mean, life basically mines novelty almost from the future and actualizes it in the present. - Okay. Life is a novelty miner from the future that is actualized in the present. - Yeah. I think so. - Novelty miner. First of all, novelty.
What's the origin of novelty when you go from boring time to creative time? Where is that? Is it as simple as randomness, like you're referring to? - I'm really struggling with randomness because I had a really good argument with Jascha Bach about randomness. And he said, "Randomness doesn't give you free will.
That's insane because you'd just be random." And I think he's right at that level, but I don't think he is right on another level. And it's not about randomness. It's about constrained... I'm going to sound like... Constrained opportunity. I'm making this up as I go along, so I'm making this up.
Constrained opportunity. So, what I mean is like... So, you have to have... So, the novelty... What is novelty? This is why I think it's a funny thing. If you ever want to discuss AI, why I think everyone's kind of gone AI mad is that they're misunderstanding novelty. But let's think about novelty.
Yes, what is novelty? So, I think novelty is a genuinely new configuration that is not predicted by the past, right? And that you discover in the present, right? And that is truly different, right? Now, everyone says that... Some people say that novelty doesn't exist. It's always with precedent. I want to do experiments that show that that is not the case.
And it goes back to a question you asked me a few moments ago, which is, where is the factory? Right? Because I think the same mechanism that gives us a factory gives us novelty. And I think that that is why I'm so deeply hung up on time. I mean, of course I'm wrong, but how wrong?
And I think that life opens up that commentarial space in a way that our current laws of physics, although as contrived in a deterministic initial condition universe, even with the get out of the multiverse, David Deutch style, which I love by the way, but I don't think is correct.
But it's really beautiful. The David Deutch's conception of the multiverse is kind of like given. But I think that the problem with wave particle duality and quantum mechanics is not about the multiverse. It's about understanding how determined the past is. Well, I don't just think that actually this is a discussion I was having with Sarah about that, right?
She was like, "Oh, I think we'd have been debating this for a long time now about how do we reconcile novelty, determinism, indeterminism." - So just to clarify, both you and Sarah think the universe is not deterministic. - I won't speak for Sarah, but I think that the universe is deterministic looking back in the past, but undetermined going forward in the future.
So I'm kind of having my cake and eating it here. This is because I fundamentally don't understand randomness, right? As Yasha told me or other people told me. But if I adopt a new view now, which the new view is the universe is just non-deterministic, but I'd like to refine that and say the universe appears deterministic going back in the past, but it's undetermined going forward in the future.
So how can we have a universe that has deterministically looking rules that's non-determined going into the future? It's this breakdown in precision in the initial conditions. And we have to just stop using initial conditions and start looking at trajectories and how the combinatorial space behaves in expanding universe in time and space.
And assembly theory helps us quantify the transition to biology, and biology appears to be novelty mining because it's making crazy stuff. That we are unique to earth, right? There are objects on earth that are unique to earth that will not be found anywhere else because you can do the combinatorial math.
- What was that statement you made about life is novelty mining from the future? What's the little element of time that you're introducing? - So what I'm kind of meaning is because the future is bigger than the present, in a deterministic universe, how do the states go from one to another?
I mean, there's a mismatch, right? So that must mean that you have a little bit of indeterminism, whether that's randomness or something else. I don't understand. I want to do experiments to formulate a theory to refine that as we go forward that might help us explain that. And I think that's why I'm so determined to try and crack the non-life-to-life transition, looking at networks and molecules, and that might help us think about it, the mechanism.
But certainly the future is bigger than the past, in my conception of the universe and some conception of the universe. - By the way, that's not obvious, right? The future being bigger than the past. Well, that's one statement, and the statement that the universe is not big enough to contain the future is another statement.
- Yeah. Yeah, yeah, yeah. - That one is a big one. That one's a really big one. - I think so. But I think it's entirely... Because look, we have the second law. And right now, I mean, we don't need the second law if the future's bigger than the past.
It follows naturally. So why are we retrofitting all these sticking plasters onto our reality to hold onto a timeless universe? - Yeah, but that's because it's kind of difficult to imagine the universe that can't contain the future. - But isn't that really exciting? - It's very exciting, but it's hard.
I mean, we're humans on Earth, and we have a very kind of four-dimensional conception of the world. Of 3D plus time. It's just hard to intuit a world where... What does that even mean? A universe that can't contain the future. - Yeah, it's kind of crazy, but obvious. - It's weird.
I mean, I suppose it sounds obvious, yeah, if it's true. - But the nice thing is you can... So the reason why assembly theory turned me onto that was that... Let's just start in the present and look at all the complex molecules and go backwards in time and understand how evolutionary processes gave rise to them.
It's not at all obvious that taxol, which is one of the most complex natural products produced by biology, was going to be invented by biology. It's an accident. You know, taxol is unique to Earth. There's no taxol elsewhere in the universe. And taxol was not decided by the initial conditions.
It was decided by this kind of interplay between the... So the past simply is embedded in the present. It gives some features, but why the past doesn't map to the future one-to-one is because the universe is too big to contain itself. That gives space for creativity, novelty, and some things which are unpredictable.
- Okay, so given that you're disrespecting the power of the initial conditions, let me ask you about... So how do you explain that cellular automata are able to produce such incredible complexity given just basic rules and basic initial conditions? - I think that this falls into the Brouwer-Hilbert trap.
So how do you get a cellular automata producing a complexity? You have a computer, you generate a display, and you map the change of that in time. There are some CAs that repeat, like functions. It's fascinating to me that for pi, there is a formula where you can go to the millionth decimal place of pi and read out the number without having to go there.
But there are some numbers where you can't do that. You have to just crank through. Whether it's Wolframian computational irreducibility or some other thing, that doesn't matter. But these CAs, that complexity, is that just complexity or a number that is basically you're mining that number in time? Is that just a display screen for that number, that function?
- Well, can't you say the same thing about the complexity on Earth then? - No, because the complexity on Earth has a copy number and an assembly index associated with it. That CA is just a number running. - You don't think it has a copy number? Wait a minute.
- Well, it does in the human, where we're looking at humans producing different rules, but then it's nested on selection. So those CAs are produced by selection. I mean, the CA is such a fascinating pseudo-complexity generator. What I would love to do is understand, quantify the degree of surprise in a CA and run it long enough.
But what I guess that means is we have to instantiate, we have to have a number of experiments where we're generating different rules and running them in time steps. But, ah, got it. CAs are mining novelty in the future by iteration, right? And you're like, oh, that's great, that's great.
You didn't predict it. Some rules you can predict what's going to happen, other rules you can't. So for me, if anything, CAs are evidence that the universe is too big to contain itself, because otherwise you'd know what the rules are going to do forever more. - Right. I guess you were saying that the physicist saying that all you need is the initial conditions and the rules of physics is somehow missing the bigger picture.
And if you look at CAs, all you need is the initial condition and the rules and then run the thing. - You need three things. You need the initial conditions, you need the rules, and you need time, iteration to mine it out. Without the coordinate, you can't get it out.
- Sure. And that's that to use fundamentally. - And you can't predict it from initial conditions. If you could, then it'd be fine. - And that time is the foundation of, this is the history, the memory of each of the things it created. It has to have that memory of all the things that led up to it.
- I think it's, yeah, you have to have the resource. Because time is a fundamental resource. And yeah, I'm becoming, I think I had a major epiphany about randomness, but I keep doing that every two days and then it goes away again, it's random. - You're a time fundamentalist.
- You should be as well. If you believe in free will, the only conclusion is time is fundamental, otherwise you cannot have free will, it logically follows. - Well, the foundation of my belief in free will is observation driven. I think if you use logic, logically it seems like the universe is deterministic.
- Looking backwards in time, and that's correct, the universe is. - And then everything else is a kind of leap, it requires a leap. - I mean, I think that, it's kind of, this is, I think machine learning is going to provide a big, a chunk of that, right?
Because it helped us explain this. So the way I'd say, if you take-- - That's interesting, why? - Well, let's just, my favorite one is, because I'm, the AI doomers are driving me mad, and the fact that we don't have any intelligence yet, I call AI autonomous informatics, just to make people grumpy.
- Yeah, you're saying we're quite far away from AGI. - I think that we have no conception of intelligence, and I think that we don't understand how the human brain does what it does. I think that we are, neuroscience is making great advances, but I think that we have no idea about AGI.
So I am a technological, I guess, optimist. I believe we should do everything, the whole regulation of AI is nonsensical. I mean, why would you regulate Excel, other than the fact that Clippy should come back, and I love Excel 97, 'cause we can play, we can do the flight simulator.
- I'm sorry, in Excel? - Yeah, have you not played the flight simulator in 99? - In Excel 97? - Yeah, yeah, yeah. - What does that look like? - It's like wireframe, very basic, but basically I think it's X zero, Y zero, shift, and it opens up, and you can play the flight simulator.
- Oh, wow. Wait, wait, wait, is it using Excel? - Excel, Excel 97. - Okay. - I resurrected it the other day, and saw Clippy again for the first time in a long time. - Well, Clippy is definitely coming back, but you're saying we don't have a great understanding of what is intelligence, what is the intelligence-- - I am very frustrated-- - Underpinning the human mind.
- I'm very frustrated by the way that we're AI-dooming right now, and people are bestowing some kind of magic. Now, let's go back a bit. So you said about AGI, are we far away from AGI? Yes, I do not think we're going to get to AGI anytime soon. I've seen no evidence of it, and the AI-doom scenario is nonsensical in the extreme, and the reason why I think it's nonsensical, but it's not-- I don't think there isn't things we should do and be very worried about, right?
I mean, there are things we need to worry about right now, what AI are doing, whether it's fake data, fake users, right? I want authentic people or authentic data. I don't want everything to be faked, and I think it's a really big problem, and I absolutely want to go on the record to say I really worry about that.
What I'm not worried about is that some fictitious entity is going to turn us all to paperclips, or detonate nuclear bombs, I don't know, maybe, I don't know, anything you can't think of. Why is this-- and I'll take a very simple series of logical arguments, and the AI-doomers have not had the correct epistemology.
They do not understand what knowledge is, and until we understand what knowledge is, they're not going to get anywhere, because they're applying things falsely. So let me give you a very simple argument. People talk about the probability, p-doom AI. We can work out the probability of an asteroid hitting the planet, why?
Because it's happened before. We know the mechanism, we know that there's a gravity well, or that space-time is bent and stuff falls in. We don't know the probability of AGI because we have no mechanism. So let me give you another one, which is like, I'm really worried about AG.
What's AG? AG is anti-gravity. One day we could wake up and anti-gravity is discovered, we're all going to die, the atmosphere is going to float away, we're going to float away, we're all doomed. What is the probability of AG? We don't know because there's no mechanism for AG. Do we worry about it?
No. And I don't understand the current reason for certain people in certain areas to be generating this nonsense. I think they're not doing it maliciously. I think we're observing the emergence of new religions, how religions come because religions are about some controls. You've got the optimist saying AI is going to cure us all and AI is going to kill us all.
What's the reality? Well, we don't have AI, we have really powerful machine learning tools and they will allow us to do interesting things and we need to be careful about how we use those tools in terms of manipulating human beings and faking stuff, right? Right. Well, let me try to sort of steel man the AI Doomer's argument.
Actually, I don't know, are AI Doomers in the Yudkowsky camp saying it's definitely going to kill us? Because there's a spectrum. 95% I think is the limit. 95% plus? No, not plus. I don't know, I was seeing on Twitter today various things but I think Yudkowsky is at 95%.
But to belong to the AI Doomer club, is there a threshold? I don't know what the membership is. Maybe. And what are the fees? I think Scott Aronson, I was quite surprised, I saw this online so it could be wrong, so sorry if it's wrong, says 2%. But the thing is, if someone said there's a 2% chance you're going to die going into the lift, would you go into the lift?
In the elevator for the American English speaking audience. Well, no, not for the elevator. So I would say anyone higher than 2%, I mean, I think there's a 0% chance of AGI Doom. Zero. Just to push back on the argument where the N of 0 on the AGI, we can see on Earth that there's increasing levels of intelligence of organisms.
We can see what humans with extra intelligence were able to do to the other species. So that is a lot of samples of data, what a delta in intelligence gives you. When you have an increase in intelligence, how you're able to dominate a species on Earth. And so the idea there is that if you have a being that's 10x smarter than humans, we're not gonna be able to predict what that's going to, what that being is gonna be able to do, especially if it has the power to hurt humans.
Which you can imagine a lot of trajectories in which the more benefit AI systems give, the more control we give to those AI systems over our power grid, over our nuclear weapons or weapons of any sort. And then it's hard to know what a ultra intelligence system would be able to do in that case.
You don't find that convincing. I think this is, I would fail that argument 100%. Here's a number of reasons to fail it on. First of all, we don't know where the intention comes from. The problem is that people think they keep, I've been watching all the hucksters online with the prompt engineering and all this stuff.
When I talk to a typical AI computer scientist, they keep talking about the AI as having some kind of decision making ability. That is a category error. The decision making ability comes from human beings. We have no understanding of how humans make decision. We've just been discussing free will for the last half an hour, right?
We don't even know what that is. So the intention, I totally agree with you. People who intend to do bad things can do bad things and we should not let that risk go. That's totally here and now. I do not want that to happen and I'm happy to be regulated to make sure that systems I generate, whether they're like computer systems or, you know, I'm working on a new project called Chem Machina.
- Nice, well done. - Yeah, yeah, which is basically a... - For people who don't understand the point, the X Machina is a great film about, I guess, AGI embodied and Chem is the chemistry version of that. - And I only know one way to embody intelligence, that's in chemistry and human brains.
So category error number one is agents, they have agency. Category error number two is saying that, assuming that anything we make is going to be more intelligent. Now you didn't say super intelligent. I'll put the words into our mouths here, super intelligent. That, I think that there is no reason to expect that we are going to make systems that are more intelligent, more capable.
You know, when people play chess computers, they don't expect to win now, right? They just, the chess computer is very good at chess. That doesn't mean it's super intelligent. So I think that super intelligence, I mean, I think even Nick Bostrom is pulling back on this now, because he invented this.
So I see this a lot. When did this first happen? Eric Drexler, nanotechnology, atomically precise machines. He came up with a world where we had these atom cogs everywhere, they were going to make self-replicating nanobots. Not possible, why? Because there's no resources to build these self-replicating nanobots. You can't get the precision, it doesn't work.
It was a major category error in taking engineering principles down to the molecular level. The only functioning molecular technology we know, sorry, the only functioning nanomolecular technology we know, produced by evolution. There. So now let's go forward to AGI. What is AGI? We don't know. It's super, it can do this, or humans can't think.
That, I would argue, the only AGI's that exist in the universe are produced by evolution. And sure, we may be able to make our working memory better, we might be able to do more things. The human brain is the most compact computing unit in the universe. It uses 20 watts, it uses a really limited volume, it's not like a chat GPT cluster which has to have thousands of watts, a model that's generated and has to be corrected by human beings.
You are autonomous and embodied intelligence. So I think that there are so many levels that we're missing out. We've just kind of went, oh, we've discovered fire, oh gosh, the planet's just going to burn one day, randomly. I mean, I just don't understand that leap. There are bigger problems we need to worry about.
So what is the motivation? Why are these people, let's assume they're earnest, have this conviction? Well, I think it's kind of, they're making leaps that, they're trapped in a virtual reality that isn't reality. - Well, I mean, I could continue a set of arguments here, but also it is true that ideologies that fear monger are dangerous because you can then use it to control, to regulate in a way that halts progress, to control people, to cancel people, all that kind of stuff.
So you have to be careful because reason ultimately wins, right? But there is a lot of concerns with superintelligent systems, very capable systems. I think when you hear the word superintelligent, you're hearing it's smarter than humans in every way that humans are smart. But the paperclip manufacturing system doesn't need to be smart in every way.
It just needs to be smart in a set of specific ways. And the more capable the AI systems become, the more you could see us giving them control over, like I said, our power grid, a lot of aspects of human life. And that means they will be able to do more and more damage when there's unintended consequences that come to life.
- I think that that's right, that the unintended consequences we have to think about, and that I fully agree with. But let's go back a bit. Sentient, I mean, again, I'm far away from my comfort zone and all this stuff, but hey, let's talk about it because I'll give myself a qualification.
- Yeah, we're both qualified and sentient, I think, as much as anyone else. - I think the paperclip scenario is just such a poor one because let's think about how that would happen. And also let's think about, we are being so unrealistic about how much of the Earth's surface we have commandeered.
For paperclip manufacturing to really happen, I mean, do the math. It's like, it's not going to happen. There's not enough energy, there's not enough resource, where is it all going to come from? I think that what happens in evolution is really, why is a killer virus not killed all life on Earth?
Well, what happens is, sure, super killer viruses that kill the ribosome have emerged, but you know what happens? They nuke a small space because they can't propagate, they will die. So there's this interplay between evolution and propagation, right, and death. And so- - In evolution. You don't think it's possible to engineer, for example, sorry to interrupt, but like a perfect virus that's deadly enough?
- No. Nonsensical. I think that just wouldn't, again, it wouldn't work because it's too deadly. It would just kill the radius and not replicate it. - Yeah. I mean, you don't think it's possible to get a- - I mean, if you were super, I mean, if you were- - Not kill all of life on Earth, but kill all humans.
There's not many of us. There's only like eight billion. There's so much more ants. - I mean, I don't- - So many more ants. And they're pretty smart. - I think the nice thing about where we are, I would love for the AI crowd to take a leaf out of the book of the bio warfare, chemical warfare crowd.
I mean, not love, 'cause actually people have been killed with chemical weapons in the First and Second World War, and bioweapons have been made, and we can argue about COVID-19 and all this stuff. Let's not go there just now. But I think there is a consensus that some certain things are bad and we shouldn't do them, right?
And sure, it would be possible for a bad actor to engineer something bad, but the damage would be, we would see it coming, and we would be able to do something about it. Now, I guess what I'm trying to say is when people talk about doom and they just, when you ask them for the mechanism, they just say, they just make something up.
I mean, in this case, I'm with Yann LeCun. I think he put out a very good point about trying to regulate jet engines before we've even invented them. And I think that's what I'm saying. I'm not saying we should, I just don't understand why these guys are going around literally making stuff up about us all dying, when basically we need to actually really focus on.
Now, let's say there's some actors are earnest, right? Let's say Yudakowsky is being earnest, right? And he really cares, but he loves it. He goes, and then you're all going to die. It's like, why don't we try and do the same thing and say, you could do this, and then you're going to be happy forever after.
- Well, I think there's several things to say there. One, I think there is a role in society for people that say we're all going to die, because I think it filters through as a message, as a viral message, that gives us the proper amount of concern. Meaning not the, it's not 95%, but when you say 95% and it filters through society, it'll give an average of like a 0.03%, an average.
So it's nice to have people that are like, we're all going to die, then we'll have a proper concern. Like, for example, I do believe we're not properly concerned about the threat of nuclear weapons currently. It just seems like people have forgotten that that's a thing, and there's a war in Ukraine with nuclear power involved, there's nuclear power throughout the world, and it just feels like we're on the brink of a potential world war to a percentage that I don't think people are properly calibrating in their head.
We're all thinking it's a Twitter battle as opposed to actual threat. So it's nice to have that kind of level of concern. But to me, when I hear AI doers, what I'm imagining is with unintended consequences, a potential situation where, let's say, 5% of the world suffers deeply because of a mistake made of unintended consequences.
I don't imagine the entirety of human civilization dying, but there could be a lot of suffering if this is done poorly. - I understand that, and I guess I'm involved in the whole hype cycle. I would like us to... I don't want us to... So what's happening right now is there seems to be...
So let's say, having some people saying AI doom is a worry, fine, let's give them that. But what seems to be happening is there seems to be people who don't think AI is doing that, trying to use that to control regulation and to push people to regulate, which stops humans generating knowledge.
And I am an advocate for generating as much knowledge as possible. When it comes to nuclear weapons, I grew up in the '70s and '80s where the nuclear doom, a lot of adults really had existential threat, almost as bad as now with AI doom. They were really worried, right?
There were some great... Well, not great. There were some horrific documentaries. I think there's one called FREDS that was generated in the UK, which was like... It was terrible. It was like so scary. And I think that the correct thing to do is obviously get rid of nuclear weapons, but let's think about unintended consequences.
We've got rid of... We got rid of all the sulfur particles in the atmosphere, right? All the soot. And what's happened in the last couple of years is global warming has accelerated because we've cleaned up the atmosphere too much. - Sure. I mean, the same thing if you get rid of nuclear weapons.
- Exactly. That's my point. So what we could do is if we actually started to put the AI in charge, which is I really like an AI, to be in charge of all world politics. And this sounds ridiculous for a second, hang on. But if we could all agree on the...
- The AI doomers just woke up. - Yeah, yeah, yeah. - In that statement. - But I really don't like politicians who are basically just looking at local sampling. But if you could say globally, look, here's some game theory here. What is the minimum number of nuclear weapons we need to distribute around the world to everybody to basically reduce war to zero?
- I mean, just this thought experiment of the United States and China and Russia, major nuclear powers get together and say, "All right, we're going to distribute nuclear weapons to every single nation on earth." - Oh boy. I mean, that has a probably greater than 50% chance of eliminating major military conflict.
- Yeah. - Yeah, but it's not 100%. - But I don't think anyone will use them because I think... And look, what you've got to try and do is to qualify for these nuclear weapons, this is a great idea. The game theorists should do this, right? I think the question is this.
I really buy your question, we have too many nukes, just from a feeling point of view that we've got too many of them. So let's reduce the number, but not get rid of them because we'll have too much conventional warfare. So then, what is the minimum number of nuclear weapons we can distribute around to remove...
Humans hurting each other is something we should stop doing. It's not out with our conceptual capability. But right now, what about certain nations that are being exploited for their natural resources in the future for a short-term gain because we don't want to generate knowledge. And so if everybody had an equal doomsday switch, I predict the quality of life of the average human will go up faster.
I am an optimist and I believe that humanity is going to get better and better and better, that we're going to eliminate more problems. But I think, yeah, let's... - But the probability of a bad actor of one of the nations setting off a nuclear weapon, I mean, you have to integrate that into the...
- But we distribute the nukes-like population, right? We give... What we do is we... But anyway, let's just go there. So if a small nation with a couple of nukes uses one because they're a bit bored or annoyed, the likelihood that they are going to be pummeled out of existence immediately is 100%.
And yet, they've only nuked one other city. I know this is crazy and I apologize for... - Well, no, no. I think it's, just to be clear, we're just having a thought experiment that's interesting, but there's terrorist organizations that would take that, would take that trade. - Yeah, I mean, look, I'm...
- And we have to ask ourselves a question of how many... Which percentage of humans would be suicide bombers, essentially, where they would sacrifice their own life because they hate another group of people? And that, I believe it's a very small fraction, but is it large enough if you give out nuclear weapons?
- I can predict a future where we take all nuclear material and we burn it for energy, right? Because we're getting there. And the other thing you could do is say, look, there's a gap. So if we got all the countries to sign up to the virtual nuclear agreement where we all exist, we have a simulation where we can nuke each other in the simulation.
And the economic consequences are catastrophic. - Sure. In the simulation. I love it. It's not going to kill all humans. It's just going to have economic consequences. - Yeah, yeah. I don't know. I just made it up. It seems like it's all I do. - No, it's interesting. But it's interesting whether that would have as much power in human psychology as actual physical nuclear explosions.
- I think so. - It's possible, but people don't take economic consequences as seriously, I think, as actual nuclear weapons. - I think they do in Argentina, and they do in Somalia, and they do in a lot of these places where... No, I think this is a great idea.
I'm a strong advocate now for... So what have we come up with? Burning all the nuclear material to have energy. And before we do that, because MAD is good. Mutually Assured Destruction is very powerful. Let's take it into the metaverse and then get people to kind of subscribe to that.
And if they actually nuke each other, even for fun in the metaverse, there are dire consequences. - Yeah, yeah. So it's like a video game. We all have to join this metaverse video game. - Yeah. I can't believe it. - And there's dire economic consequences. I don't know how...
And it's all run by AI, as you mentioned. So the AI doomers are really terrified at this point. - No, they're happy to have a job for another 20 years, right? - Oh, fearmongering. - Yeah, yeah, yeah. I'm a believer in equal employment. - You've mentioned that... What do you call it?
Chemokina? - Yeah. - Yeah. So you've mentioned that a chemical brain is something you're interested in creating. And that's a way to get conscious AI soon. Can you explain what a chemical brain is? - I want to understand the mechanism of intelligence that's gone through evolution, right? Because the way that intelligence was produced by evolution appears to be the following.
Origin of life, multicellularity, locomotion, senses. Once you can start to see things coming towards you, and you can remember the past and interrogate the present and imagine the future, you can do something amazing, right? And I think only in recent years did humans become Turing complete, right? - Yeah, yeah, yeah.
- And so that Turing completeness kind of gave us another kick up. But our ability to process that information is produced in a wet brain. And I think that we do not have the correct hardware architectures to have the domain flexibility and the ability to integrate information. And I think intelligence also comes at a massive compromise of data.
Right now, we're obsessing about getting more and more data, more and more processing, more and more tricks to get dopamine hits. So when we look back on this, going, "Oh, yeah, that was really cool." Because when I chat GPT, it made me feel really happy. I got a hit from it, but actually, it just exposed how little intelligence I use in every moment because I'm easily fooled.
So what I would like to do is to say, "Well, hey, hang on. What is it about the brain?" So the brain has this incredible connectivity, and it has the ability to, you know, as I said earlier about my nephew, I went from Bill to Billy, and he went, "All right, Leroy." Like, how did he make that leap?
That he was able to basically, without any training, I extended his name. He went, "Okay." He doesn't like, he wants to be called Bill. He went back and said, "You'd like to be called Lee? I'm going to call you Leroy." So human beings have a brilliant ability, or intelligent beings appear to have a brilliant ability to intercreate across all domains all at once, and to synthesize something which allows us to generate knowledge.
And becoming Turing-complete on our own, although AIs are built in Turing-complete things, their thinking is not Turing-complete in that they are not able to build universal explanations. And that lack of universal explanation means that they're just inductivists. Inductivism doesn't get you anywhere. It's just basically a party trick. It's like, you know, I like the, I think it's in the fabric of reality from David Deutsch, where basically, you know, the farmer is feeding the chicken every day, and the chicken's getting fat and happy, and the chicken's like, "I'm really happy.
Every time the farmer comes in and feeds me." And then one day the farmer comes in and doesn't, instead of feeding the chicken, just wrings its neck. You know, and that's kind of, and had the chicken had an alternative understanding of why the farmer was feeding it. - It's interesting though, because we don't know what's special about the human mind that's able to come up with these kind of generalities, this universal theories of things, and will come up with novelty.
I can imagine, 'cause you gave an example, you know, about William and Leroy. I feel like example like that, we'll be able to see in future versions of large language models. We'll be really, really, really impressed by the humor, the insights, all of it. Because it's fundamentally trained on all the incredible humor and insights that's available out there on the internet, right?
So we'll be impressed. I think we'll be impressed. - Oh, I'm impressed. I'm impressed. - Increasingly so. - But we're mining the past. - Yes. - And what the human brain appears to be able to do is mine the future. - Yes. So novelty, it is interesting whether these large language models will ever be able to come up with something truly novel.
- I can show on the back of a piece of paper why that's impossible. And it's like, the problem is that, and again, there's a domain experts kind of bullshitting each other. The term generative, right? Average person think, "Oh, it's generative." No, no, no. If look, if I take the numbers between zero and 1,000, and I train a model to pick out the prime numbers by giving them all the prime numbers between zero and 1,000, it doesn't know what prime number is.
Occasionally, if I can cheat a bit, it will start to guess. It never will produce anything out with the dataset because you mine the past. The thing that I'm getting to is I think that actually, current machine learning technologies might actually help reveal why time is fundamental. It's like kind of insane, because they tell you about what's happened in the past, but they can never help you understand what's happening in the future without training examples.
Sure, if that thing happens again, it's like... So, let's think about what large average models are doing. We have all the internet as we know it, you know, language, but also they're doing something else. We're having human beings correcting it all the time. Those models are being corrected. Steered.
Corrected. Modified. Tweaked. Cheating. Well, you could say that training on human data in the first place is cheating. Human is in the loop. Sorry to interrupt. Yes, so human is definitely in the loop, but it's not just human that's in the loop. A very large collection of humans is in the loop.
I mean, to me, it's not intuitive that you said prime numbers, that the system can't generate an algorithm, right? That the algorithm that can generate prime numbers, or the algorithm that could tell you if a number is prime and so on, and generate algorithms that generate algorithms that generate algorithms that start to look a lot like human reasoning, you know?
I think, again, we can show that on a piece of paper. Sure, I think you have to have... So, this is the failure in epistemology. I'm glad I even can say that word, let alone what it means. You've said it multiple times. I know, it's like three times now.
Without failure. Quit while you're ahead. Just don't say it again, because you did really well. Thanks. So, what is reasoning? So, coming back to the chemical brain, if I could basically, if I could show that in a... Because, I mean, I'm never going to make an intelligence thing in chem machina, because we don't have brain cells.
They don't have glial cells, they don't have neurons. But if I can take a gel and engineer the gel to have it be a hybrid hardware for reprogramming, which I think I know how to do, I will be able to process a lot more information and train models billions of times cheaper, and use cross-domain knowledge.
And there's certain techniques I think we can do. But there's still missing the abilities of human beings have had to become true and complete. And so, I guess the question to give back at you, is like, how do you tell the difference between trial and error, and the generation of new knowledge?
I think the way you can do it is this, is that you come up with a theory and explanations, inspiration comes from out there, and then you then test that, and then you see that's going towards a truth. And human beings are very good at doing that, in the transition between philosophy, mathematics, physics, and natural sciences.
And I think that we can see that. Where I get confused is why people misappropriate the term artificial intelligence to say, "Hey, there's something else going on here." Because I think you and I both agree, machine learning is really good. It's only going to get better, we're going to get happier with the outcome.
But why would you ever think the model was thinking? Or reasoning? Reasoning requires intention. And the intention, if the model isn't reasoning, the intentions come from the prompter. And the intention has come from the person who programmed it to do it. So I-- - But don't you think you can prompt it to have intention?
Basically start with the initial conditions and get it going. Where the, you know, currently large language models, Chad GPT, only talks to you when you talk to it. There's no reason why you can't just start it talking. - But those initial conditions came from someone starting it. - Yes.
- And that causal chain in there, so that intention comes from the outside. I think that there is something in that causal chain of intention that's super important. I don't disagree we're going to get to AGI. It's a matter of when and what hardware. I think we're not going to do it in this hardware.
And I think we're unnecessarily fetishizing really cool outputs and dopamine hits. Because obviously that's what people want to sell us. - Well, but there could be, I mean, AGI is a loaded term, but there could be incredibly super impressive intelligence systems on the way to AGI. So these large language models, I mean, if it appears conscious, if it appears super intelligent, who are we to say it's not?
- I agree. But the super intelligence I want, I want to be able to have a discussion with it about coming up with fundamental new ideas that generate knowledge. And if the super intelligence we generate can mind novelty from the future that I didn't see in its training set in the past, I would agree that something really interesting is coming on.
I'll say that again. If the intelligence system, be it a human being, a chatbot, something else, is able to produce something truly novel that I could not predict, even having full audit trail from the past, then I'd be sold. - Well, so we should be clear that it can currently produce things that are, in a shallow sense, novel, that are not in the training set.
But you're saying truly novel. - I think they are in the training set. I think everything it produces comes from a training set. There's a difference between novelty and interpolation. We do not understand where these leaps come from yet. That is what intelligence is, I would argue. Those leaps, and some people say, no, it's actually just what will happen if you just do cross-domain training and all that stuff.
And that may be true, and I may be completely wrong. But right now, the human mind is able to mind novelty in a way that artificial intelligence systems cannot. And this is why we still have a job, and we're still doing stuff. And I used chat GPT for a few weeks.
Well, this is cool. And then it took me too... Well, what happened is it took me too much time to correct it. Then it got really good. And now they've done something to it. It's not actually that good. - Yeah, right. - I don't know what's going on. - Censorship, yeah.
I mean, that's interesting, but it will push us humans to characterize novelty better, like characterize what is novel, what is truly novel, what's the difference between novelty and interpolation. - I think that this is the thing that makes me most excited about these technologies, is they're gonna help me demonstrate to you that time is fundamental, and the future is bigger than the present, which is why human beings are quite good at generating novelty, because we have to expand our data set, and to cope with unexpected things in our environment.
Our environment throws them all at us. Again, we have to survive in that environment. And I mean, I never say never, I would be very interested in how we can get cross-domain training cheaply in chemical systems, 'cause I'm a chemist, and the only sentient thing I know of is the human brain.
But maybe that's just me being boring and predictable, and not novel. - Yeah, you mentioned GPT for electron density. So a GPT-like system for generating molecules that can bind to hosts automatically. I mean, that's interesting. That's really interesting, applying this same kind of transform mechanism. - Yeah, I mean, this is one that, it goes, my team, I try and do things that are non-obvious, but non-obvious in certain areas.
And one of the things I was always asking about, in chemistry, people like to represent molecules as graphs, and it's quite difficult. It's really hard. If you're doing AI in chemistry, you really want to basically have good representations, you can generate new molecules that are interesting. And I was thinking, well, molecules aren't really graphs, and they're not continuously differentiable.
Could I do something that was continuously differentiable? I was like, well, molecules are actually made up of electron density. So then I got thinking, say, well, okay, could there be a way where we could just basically take a database of readily solved electron densities for millions of molecules? So we took the electron density for millions of molecules and just trained the model to learn what electron density is.
And so what we built was a system that you literally could give it a, let's say you could take a protein that has a particular active site, or a cup with a certain hole in it, you pour noise into it, and with a GPT, you turn the noise into electron density.
And then, in this case, it hallucinates like all of them do, but the hallucinations are good because it means I don't have to train on such a large number, such a huge dataset, because these datasets are very expensive. Because how do you produce it? So go back a step.
So you've got all these molecules in this dataset, but what you've literally done is a quantum mechanical calculation where you produce electron densities for each molecule. So you say, oh, this representation of this molecule has these electron densities associated with it. So you know what the representation is, and you train the neural network to know what electron density is.
So then you give it an unknown pocket. You pour in noise, and you say, right, produce me electron density. It produces electron density that doesn't look ridiculous. And what we did in this case is we produced electron density that maximizes the electrostatic potential, so the stickiness, but minimizes what we call the steric hindrance, so the overlap, so it's repulsive.
So make the perfect fit. And then we then used a kind of like a chat GPT type thing to turn that electron density into what's called a smile. A smile string is a way of representing a molecule in letters. And then we can then-- - So it just generates them then?
- Just generates them. And then the other thing is then we bung that into the computer, and then it just makes it. - Yeah, the computer being the thing that, right, to generate-- - The robot that we've got that can basically just do chemistry. - Create any-- - Yeah.
So we've kind of got this end-to-end drug discovery machine where you can say, oh, you want to bind to this active site? Here you go. I mean, it's a bit leaky, and things kind of break, but it's a proof of principle. - But were the hallucinations, are those still accurate?
- Well, the hallucinations are really great in this case, because in the case of a large numbers model, the hallucinations just make everything up to, well, it doesn't just make everything up, but it gives you an output that you're plausibly comfortable with, but it thinks you're doing probabilistically. The problem on these electron density models is it's very expensive to solve a Schrodinger equation going up to many heavy atoms and large molecules.
And so we wondered if we trained the system on up to nine heavy atoms, whether it would go beyond nine. And it did. It started to generate molecules of 12. No problem, they look pretty good. And I was like, well, this hallucination I will take for free. Thank you very much.
Because it just basically, this is a case where interpolation, extrapolation worked relatively well, and we were able to generate the really good molecules. And then what we were able to do here is, and this is a really good point, what I was trying to say earlier, that we were able to generate new molecules from the known data set that would bind to the host.
So a new guest would bind. Were these truly novel? Not really, because they were constrained by the host. Were they new to us? Yes. So I do understand, I can concede that machine learning systems, artificial intelligence systems can generate new entities, but how novel are they? It remains to be seen.
- Yeah. And how novel the things that humans generate is also difficult to quantify. They seem novel. - That's what a lot of people say. So the way to really get to genuine novelty, and the assembly theory shows you the way, is to have different causal chains overlap. And this really resonates with the time is fundamental argument.
And if you're bringing together a couple of objects with different initial conditions coming together, when they interact, the more different their histories, the more novelty they generate in time going forward. And so it could be that genuine novelty is basically about mix it up a little. And the human brain is able to mix it up a little, and all that stimulus comes from the environment.
But all I think I'm saying is the universe is deterministic going back in time, non-deterministic going forward in time, because the universe is too big in the future to contain in the present. Therefore, these collisions of known things generate unknown things that then become part of your data set and don't appear weird.
That's how we give ourselves comfort. The past looks consistent with this initial condition hypothesis, but actually we're generating more and more novelty. And that's how it works. Simple. - So it's hard to quantify novelty looking backwards. I mean, the present and the future are the novelty generators. - But I like this whole idea of mining novelty.
I think it is going to reveal why the limitations of current AI is a bit like a printing press, right? Everyone thought that when the printing press came, that writing books is going to be terrible, that you had evil spirits and all this. They were just books. - And same would be with AI.
But I think just the scale you can achieve in terms of impact with AI systems is pretty nerve-wracking. - But that's what the big companies want you to think. But not like in terms of destroy all humans, but you can have major consequences in the way social media has had major consequences, both positive and negative.
And so you have to kind of think about it and worry about it. But yeah, people that fear monger, you know. - My pet theory for this, you want to know? - Yeah. - Is I think that a lot of, and maybe I'm being, and I think, I really do respect, you know, a lot of the people out there who are trying to have discourse about the positive future.
So open AI guys, meta guys and all this. What I wonder if they're trying to cover up for the fact that social media has had a pretty disastrous effect on some level, and they're just trying to say, "Oh yeah, we should do this." And covering up for the fact that we have got some problems with, you know, teenagers and Instagram and Snapchat and, you know, all this stuff.
And maybe they're just overreacting now. It's like, "Oh yeah, sorry, we made the bubonic plate and gave it to you all and you were all dying. And oh yeah, but look at this over here, it's even worse." - Yeah, there's a little bit of that. But there's also not enough celebration of the positive impact that all these technologies have had.
We tend to focus on the negative and tend to forget that, in part because it's hard to measure. Like, it's very hard to measure the positive impact social media had on the world. - Yeah, I agree. But if what I worry about right now is like, I'm really, I do care about the ethics of what we're doing.
And one of the reasons why I'm so open about the things we're trying to do in the lab, make life, look at intelligence, all this, is so people say, "What are the consequences of this?" And you say, "Well, the consequences of not doing it." And I think that what worries me right now in the present is lack of authenticated users and authenticated data.
- Human users. - Yeah, human users. - I still think that there will be AI agents that appear to be conscious, but they would have to be also authenticated and labeled as such. There's too much value in that, like friendships with AI systems. There's too much meaningful human experiences to have with AI systems that I just...
- But that's like a tool, right? It's a bit like a meditation tool, right? Some people have a meditation tool, it makes them feel better. But I'm not sure you can ascribe sentience and legal rights to a chatbot that makes you feel less lonely. - Sentience, yes. I think legal rights, no.
I think it's the same. You can have a really deep, meaningful relationship with a dog. - With a dog sentient? - Yes. - The chatbot's not, right now, using the technology we use, it's not gonna be sentient. - Ah, this is gonna be a fun, continued conversation on Twitter that I look forward to.
Since you've had, also, from another place, some debates that were inspired by the assembly theory paper, let me ask you about God. Is there any room for notions of God in assembly theory? Who's God? - Yeah, I don't know what God is a... I mean, so, God exists in our mind, created by selection.
So, human beings have created the concept of God in the same way that human beings have created the concept of superintelligence. - Sure, but does it mean, does it not... It still could mean that that's a projection from the real world, where we're just assigning words and concepts to a thing that is fundamental to the real world.
That there's something out there that is a creative force underlying the universe. - I think the universe, there is a creative force in the universe, but I don't think it's sentient. I mean, I think the... So, I do not understand the universe. So, who am I to say that God doesn't exist?
I am an atheist, but I'm not an angry atheist, right? I have lots of... There's some people I know that are angry atheists and say that religious people are stupid. I don't think that's the case. I have faith in some things, because I don't... I mean, when I was a kid, I was like, "I need to know what the charge of electron is." I was like, "I can't measure the charge of an electron." I just gave up and had faith, okay?
You know, resistors work. So, when it comes to... I want to know why the universe is growing in the future and what humanity is going to become. I've seen that the acquisition of knowledge via the generation of novelty to produce technology has uniformly made humans' lives better. I would love to continue that tradition.
- You said that there's that creative force. Do you think, just to think on that point, do you think there's a creative force? Is there like a thing, like a driver that's creating stuff? - Yeah. I think that... So, I think that... - And where? Can you describe it mathematically?
- Well, I think selection. I think selection... - Selection is the force. - Selection is the force in the universe that creates novelty. - So, is selection somehow fundamental? - Yeah. I think persistence of objects that could decay into nothing through operations that maintain that structure. I mean, think about it.
It's amazing that things exist at all, that we're just not a big commentarial mess. - Yes. - So, the fact that... - And they exist... A thing that exists persists in time. - Yeah. I mean, let's think maybe the universe is actually, in the present, the things, everything that can exist in the present does exist.
- Well, that would mean it's deterministic, right? - No, I think the universe is... So, the universe started super small. The past was deterministic. There wasn't much going on. And it was able to mine, mine, mine, mine, mine. And so, the process is somehow generating... Universe is basically... I can't put...
I'm trying to put this into words. - Did you just say there's no free will, though? - No, I didn't say that. - As if... - Sorry, sorry, sorry. I said there is free will. I think... I'm saying that free will occurs at the boundary between the... - Past and the future?
- The past and the future. - Yeah. I got you. But everything that can exist does exist. - Everything that is... So, everything that's possible to exist at this... So, no, I'm really... - There's a lot of loaded words there. - So, what I mean is... - There's a time element loaded into that statement.
- I think that the universe is able to do what it can in the present, right? - Yeah. - And then I think in the future, there are other things that could be possible. We can imagine lots of things, but they don't all happen. - Sure. That's where you sneak in free will right there.
- Yeah. So, I guess what I'm saying is what exists is a convolution of the past with the present and the free will going into the future. - But we can still imagine stuff, right? We can imagine stuff that will never happen. - And it's amazing force, because you're imagining...
This is the most important thing that we don't understand is our imaginations can actually change the future in a tangible way, which is what the initial conditions in physics cannot predict. Your imagination has a causal consequence in the future. - Isn't that weird too? - Yeah. - I do.
- It breaks the laws of physics, as we know them right now. - Yeah. So, you think the imagination has a causal effect on the future. - Yeah. - But it does exist in there in the head. - It does. - And there must be a lot of power in whatever's going on.
There could be a lot of power whatever's going on in there. - If we then go back to the initial conditions, and that is simply not possible, that can happen. But if we go into a universe where we accept that there is a finite ability to represent numbers, and you have rounding...
Well, not rounding errors. You have some... What happens, your ability to make decisions, imagine, and do stuff is at that interface between the certain and the uncertain. It's not, as Yasha was saying to me, randomness goes and you just randomly do random stuff. It is that you are set free a little on your trajectory.
Free will is about being able to explore on this narrow trajectory that allows you to build... You have a choice about what you build, or that choice is you interacting with a future in the present. - What to you is most beautiful about this whole thing? The universe. - The fact it seems to be very undecided, very open.
The fact that every time I think I'm getting towards an answer to a question, there are so many more questions that make the chase. - Do you hate that it's going to be over at some point? - Well, for me, I think if you think about it, is it over for Newton now?
Newton has had causal consequences in the future. We discuss him all the time. - His ideas, but not the person. - The person just had a lot of causal power when he was alive, but oh my God. One of the things I want to do is leave as many Easter eggs in the future when I'm gone to go, "Oh, that's cool." - Would you be very upset if somebody made a good, large language model that's fine-tuned to Lee Conan?
- It would be quite boring, because I mean... - No novelty generation? - I mean, if it's a faithful representation of what I've done in my life, that's great. That's an interesting artifact, but I think the most interesting thing about knowing each other is we don't know what we're going to do next.
- Sure. Sure. - I mean, within some constraints, I can predict some things about you, you can predict some things about me, but we can't predict everything. - Everything. - And it's because we can't predict everything is why we're excited to come back and discuss and see. So yeah, I'm happy that it'll be interesting that some things that I've done can be captured, but I'm pretty sure that my angle on mining novelty for the future will not be captured.
- Yeah. Yeah. That's what life is, is just some novelty generation and then you're done. Each one of us just generally a little bit, or have the capacity to at least. - I think life is a selection produces life and life affects the universe in them. Universes with life in them are materially and physically fundamentally different than universes without life.
And that's super interesting. And I have no beginnings of understanding. I think maybe this is like in a thousand years, there'll be a new discipline in humans. Yeah, of course, this is how it all works. - In retrospect, it will all be obvious, I think. - I think assembly theory is obvious.
That's why a lot of people got angry. They were like, "Oh my God, this is such nonsense." And like, "Oh, actually it's not quite." But the writing's really bad. - Well, I can't wait to see where it evolves, Lee. And I'm glad to get to exist in this universe with you.
You're a fascinating human. This is always a pleasure. I hope to talk to you many more times. And I'm a huge fan of just watching you create stuff in this world. And thank you for talking today. - It's a pleasure as always, Lex. Thanks for having me on. - Thanks for listening to this conversation with Lee Cronin.
To support this podcast, please check out our sponsors in the description. And now let me leave you with some words from Carl Sagan. "We can judge our progress by the courage of our questions and the depth of our answers, our willingness to embrace what is true rather than what feels good." Thank you for listening and hope to see you next time.
- Bye. you you you you you