Lenny's Podcast: Product | Career | Growth
00:50:35 · Emmanuel Ameisen, Lenny Rachitsky
Like evolution, pretty simple objective, you know? You sort of like shake things around for a while and like keep organisms that manage to adapt to the environment. And at the end you get jazz and podcasts, you know? That's kind of crazy as well. And so I think there's a sense in which there's there's some fundamental truth that we can learn by studying these things. [00:50:57] S0: Wow. Something that comes up as you say that is what's interesting now is AI is helping us learn and evolve and, you know, progress, like AI tutoring and all these things, just like, it's like interesting how it now is helping us accelerate our own understanding of the world. And I wonder if like this point you made about how the way we learned was lessons. AI is learning just processing a ton of data. I wonder if that's how we end up. I wonder if we change how our education system based on what LMs have been trained on. [00:51:31] S1: Yeah, hopefully you know, we don't change it just so that we ask, we get students who are like hey, here's a thousand words, predict the next one. [00:51:38] S0: Just read it all. Yeah. Keep it all in your head. That's right. Yeah. Let me come back to this kind of safety piece because I think there's a lot of people that are just worried about where things are going. And I'm curious just as someone watching this stuff happen being within alignment org, watching it evolve. Are you optimistic? We'll figure it out. Do you think we'll crack this and keep AI aligned with our interests?
00:52:05 · Emmanuel Ameisen
[00:52:05] S1: My take on this is like, I'm personally optimistic. I think this is something where right now a lot of people are paying attention to it. And first of all, I think that's kind of a great thing. I think as an issue like this rises in prominence, it's exactly what we were talking about earlier. It's like this technology is powerful. It has benefits. It has risks. We have to kind of adapt and shift resources from like benefits to risks and back and forth as it progresses. And so, you know, to me, I feel like sort of we've continued to study it. The thing that's interesting is that there's this sort of, like as the models get better, they get in some ways easier to study. And so there's been this sort of strange, you know, the models get better. And so like the world model inside them is clearer and we can sort of like understand some parts of them better, but also to get more capable. And so they're more able to sort of evade like basic measures of sort of security. And so there's this push and pull as models get better. I think, you know, basically based on this push and pull, wanna allocate more or less resources to sort of various parts of like monitoring, like understanding their circuits better, things like that. But it's also why I'm kind of happy to chat with you because one of the main things that I think is important to make progress is just to make sure that people kind of understand both, you know, what kind of systems these are, like how they work, how they're made, so they can form good mental models of, you know, the present of the future. So they can decide how to shape it, whether that's, you know, taking part in some of these alignment efforts or just like informing them as the public that's gonna have to like vote and sign on much of these issues. Like, I don't know. I'm pretty excited for this current moment we're in for that reason.
00:54:03 · Lenny Rachitsky
[00:54:03] S0: And something I think people misunderstand is people working in these labs have taken this problem very seriously from the beginning. Like I said, Anthropics in the original mission was AI safety and alignment. That was like the reason that it became a company. And a lot of people are hearing this for the first time or think that it's not a serious area of study and that people aren't focused on it, many smart people care a lot about this and are working on it. There's a lot of, from what I can tell, lot of good progress is happening. The other point you made about the models growing very smoothly in intelligence, like, you know, there's been this question of, are we going to have a fast takeoff or a slow takeoff? There's always this fear that we would hit a point, recursive self improvement for example, and it just takes off super intelligence so we're in huge trouble, we have no control, it's out of the box. But it feels very much like we're on the slow takeoff scenario because as you said, the models are kind of very smoothly improving and where we are catching the little things along the way, learning, evolving, putting regulation around it. Know, of the scenarios, this feels like a pretty good path we're on of the many scenarios people imagined and the fears they had.
00:55:12 · Emmanuel Ameisen, Lenny Rachitsky
[00:55:12] S1: As sort of this pace of progress kind of evolves, it's just a matter of reacting quickly. So I think anything, you know, that's why I think having people be informed is great because then people will like voice concerns or like voice their opinions and then, sort of regularly evaluating, you know, what the benefits are, what the risks are and how we sort of like mitigate each is is basically the way that feels like the right way forward. And and I... Yeah. I kind of agree with you that it feels like sort of there's momentum to to do this right now, which is which is great. [00:55:42] S0: Something I wanted to ask you completely unrelated. Where are you on the simulation hypothesis? Being someone that watches this, all this life form growing, are you more convinced we're in a simulation and this is and we're not the base at the base layer of all this or are you not?
00:55:42 · Lenny Rachitsky, Emmanuel Ameisen
[00:55:42] S0: Something I wanted to ask you completely unrelated. Where are you on the simulation hypothesis? Being someone that watches this, all this life form growing, are you more convinced we're in a simulation and this is and we're not the base at the base layer of all this or are you not? [00:55:59] S1: Oh, this is a fun one. I actually haven't thought about this in a while. To me like there's something else that like looking inside these models kind of brings out which is this sort of like almost like there's a fundamental structure that they keep falling on. This is related to your question, I promise, let me get to it. Let me explain. I've studied like a bunch of cloud models and also, you know, some different models, some like open source work. And then a lot of time when you look at how, what they learn and what the structure inside is, it's surprisingly similar, you know, and this is for models that are trained years apart on like different data by different people. And you know, and you look at how they solve these problems and there's just so much overlap. And my take on why that is, is that for some problems that are important, there's just one efficient way to do things, right? Like there's kind of one way to do math efficiently that like fits the structure of our brain and we all learn it. And very few people are doing it a crazy different way, right? Everybody works in base 10, not many people on like basics. [00:57:09] S0: I think that, that to me makes me think
00:57:09 · Lenny Rachitsky, Emmanuel Ameisen
[00:57:09] S0: I think that, that to me makes me think [00:57:12] S1: that there's like some fundamental structure of like information that like these models are picking up on that in some ways, like we're picking up on and that, you know, and maybe like a crazier sort like simulation level that kind of is like regularity in our world. And so that maybe makes me think that like, if you were to have the power to simulate something like our world, actually, like you would land in sort of a similar situation, like there's just kind of this like basin of where things end up and they're just the sort of like easiest way for things to arrange themselves. And so in that sense, maybe, yeah, I'm sort of, I could believe that we're in a simulation. I think I'm not sure I fully buy it. The other reason I don't fully buy it is that even though I think the structure like lends itself to it, there'd be a question of like, why? Why are we like, like who's running this and for what? And that one I don't know about. [00:58:08] S0: Well, something Elon said, it stuck with me about this, that if you were to run a simulation, it'd be a really interesting to be like an interesting time in history or something that you're really excited about. And it tracks that this is a very interesting time in history. [00:58:23] S1: Yes. Yeah. Okay, that's a fair point. That's a Data fair [00:58:26] S0: centers in space and robots and artificial intelligence.