Lenny's Podcast: Product | Career | Growth
01:08:52 · Lenny Rachitsky, Dianne Penn
[01:08:52] S1: Why do you think AI is not great at writing? My guess is it has studied all of the best writing in all of humanity. It's figured out, here's the best way to write. And there's only so many ways to write. And so we've just recognized, okay, this is what AI does. It has these tropes. Is that the core of it? Is there something else that's keeping it from being a great writer? Ironically, being a large language model of all things, you think you'd be really great at language. [01:09:21] S0: I think part of it is also we need to invest more in training improvements to make AI continuously strong on areas like writing. I think it's also the technology's jagged-edged, like we mentioned. So sometimes when the models were good at writing, but not agentic, our thesis is: how do we make the models more agentic or call the right tools? Now that that's improved a bit, then it's, well, now it's these other areas actually become more of the rough edges. And so I think we're in one of those moments worth writing where we need to actually just focus and prioritize on training the models to be great at this area. And that is a very active area for us. So fun that you mentioned.
01:09:21 · Dianne Penn, Lenny Rachitsky
[01:09:21] S0: I think part of it is also we need to invest more in training improvements to make AI continuously strong on areas like writing. I think it's also the technology's jagged-edged, like we mentioned. So sometimes when the models were good at writing, but not agentic, our thesis is: how do we make the models more agentic or call the right tools? Now that that's improved a bit, then it's, well, now it's these other areas actually become more of the rough edges. And so I think we're in one of those moments worth writing where we need to actually just focus and prioritize on training the models to be great at this area. And that is a very active area for us. So fun that you mentioned. [01:10:11] S1: Okay. I'm glad. I'm glad. And also it was going to be interesting once AI is so good, we're like, "I don't know who wrote that." But to your point, sometimes we actually want to know that it's AI. That's really interesting. I never thought of it that way. The other interesting part of this is that there's that comedian who was joking that we're on a plane and the WiFi's down and we're just like, "What the hell? The WiFi's not working on this plane. This sucks. How dare you?" When you're in a tube in the sky flying like a bird. And how dare you complain that the WiFi doesn't work? Your point is there's so much advancement and so much power. We can't fix it all. We can't make it all work the best possible and so basically writing has been not the priority, and it feels like there's more investment happening there.
01:10:11 · Lenny Rachitsky, Dianne Penn
[01:10:11] S1: Okay. I'm glad. I'm glad. And also it was going to be interesting once AI is so good, we're like, "I don't know who wrote that." But to your point, sometimes we actually want to know that it's AI. That's really interesting. I never thought of it that way. The other interesting part of this is that there's that comedian who was joking that we're on a plane and the WiFi's down and we're just like, "What the hell? The WiFi's not working on this plane. This sucks. How dare you?" When you're in a tube in the sky flying like a bird. And how dare you complain that the WiFi doesn't work? Your point is there's so much advancement and so much power. We can't fix it all. We can't make it all work the best possible and so basically writing has been not the priority, and it feels like there's more investment happening there. [01:10:53] S0: Yeah. I think tone and character is a priority. I think it's this advancement of the technology is a work in progress and so we see a leap or an emergence of a jump in agentic behaviors. And so that is a new normal. And then these other capabilities needs to continue improving. And I think once we improve, let's say, writing and tone and character, we probably will say, how do we have Claude be even more proactive? Proactivity is an opportunity, and that's human nature. We want to make ourselves better. We want to make this technology better and I think we're applying it to AI, which is the right thing. We should be making it better.
01:10:53 · Dianne Penn, Lenny Rachitsky
[01:10:53] S0: Yeah. I think tone and character is a priority. I think it's this advancement of the technology is a work in progress and so we see a leap or an emergence of a jump in agentic behaviors. And so that is a new normal. And then these other capabilities needs to continue improving. And I think once we improve, let's say, writing and tone and character, we probably will say, how do we have Claude be even more proactive? Proactivity is an opportunity, and that's human nature. We want to make ourselves better. We want to make this technology better and I think we're applying it to AI, which is the right thing. We should be making it better. [01:11:41] S1: I want to ask you a couple questions I like to ask folks working at the very center of the future that is coming. One is, where do you think human brains will continue to be most valuable over the years? I know Anthropic's mission and vision will reach AGI, a super intelligence. So in the future, maybe nowhere. But before we get there- Intelligence. So in the future, maybe nowhere, but before we get there, where do you think human brains will continue to be most valuable, as we approach that timeline?
01:12:09 · Dianne Penn
[01:12:09] S0: We started to talk about making Claude and models better at judgment, especially in the last year or so. I think judgment is an area where, it's accumulation of so much nuance and so much experience. And these systems haven't experienced as much as humans have. And so I think that hard-earned judgment is a area for product leaders and just generally will continue to be really critical. There are so many things AIs can build. Which one are the things that an org like Lab should build? A lot of that requires human judgment, persistence, so proactivity. These are all traits that are beyond just general capabilities, but just behaviors and characteristics of people at that level of how do you get to the best solutions? How do you create the best experiences? So I think those types of traits are actually the tactile traits that I think will continue to be important. I think there is also still a lot of capabilities and subject matter expertise as well. I think software engineering has been really transformed by AI. I think there's areas like biology, life sciences. These are all things that we're just at the foot of the exponential on. Maybe software engineering, we're on the exponential. On some of these other areas, we're not quite there yet. And so I think you're seeing us shift things like Claude Science investing in these areas because those are areas that I think is just bring this technology to society and having a positive benefit for society. So I think there's a lot more to go there.
01:14:11 · Lenny Rachitsky, Dianne Penn
[01:14:11] S1: Another question I want to ask is, as someone with kids, how do you think about what you are encouraging them to learn? Where do you think you're going to nudge them to be successful in this wild new world that we're entering? [01:14:27] S0: I actually think it's a lot of the same traits you and I probably grew up with, which is curiosity for learning, persistence, believing in your own inner voice. Developing and then believing in your own inner voice. I have a four-year-old, I have a eight-year-old. It's on me to help them develop their inner voice. And whether that's being opinionated and taking a stance to me and developing that, encouraging that, I think that those types of skill sets are things that is important in the future and having their own individual voice. [01:15:10] S1: That is so interesting. It's so related to the answer you had when I asked about how to avoid brain rot essentially and over-relying on AI, which is just keep focused on your own point of view and your own perspective before you over-rely on AI. And just this idea you're describing of building that in kids is really important. That is interesting. And I love how all this connects judgment, persistence, a point of view of your own. [01:15:34] S0: Yeah. [01:15:35] S1: Both for kids and also adults. [01:15:37] S0: [inaudible 01:15:37]. Yeah. Anything- [01:15:37] S1: Anything- [01:15:37] S0: You think about for your ...