The Frontier with Brendan Foody
00:42:04 · Andy Fang, Brendan Foody
[00:42:04] S1: I don't think they are. And so I'm like getting it to like be RL able, is that like gonna be proximal enough to like the real world use case? Or is it just gonna be a fact where it's gonna reach the ceiling and then like to get to the realism, you're just gonna like enterprises are just gonna need to figure out themselves. [00:42:20] S0: It's fascinating because for the labs, simulating those environments is the primary bottleneck to automating them. And so they'll probably be willing to spend a lot of money and how do they build better and better simulations. I think simulations get all the some combination of contractors and synthetic that can they might be buying enough like dead companies data to like extrapolate. [00:42:40] S1: Yeah, we'll see. [00:42:42] S0: Just got a full company exclusive license to previously $15 billion public company. Oh my gosh. And so there's like some giant, yeah, company. [00:42:50] S1: You guys are just about to scrape the graveyard, huh? [00:42:52] S0: Yeah, so hopefully your your accounting problems will be solved soon. Um we'll see. There's definitely so many really challenging things in how you bridge this real-to-sim gap between what evals and environments the labs are hill climbing versus the real things you see in the messy enterprise. [00:43:07] S1: I I guess what the thing I remembered is like even just like figuring out what the right data to query is. [00:43:12] S0: Yeah.
00:43:12 · Brendan Foody, Andy Fang
[00:43:12] S0: Yeah. [00:43:12] S1: Like, you know, for these RL environments, you're not giving them the entire database. But then some term might have 15 definitions in the table. And so it's like maybe this like $15 billion company that has probably has that problem, actually. So probably. [00:43:24] S0: Well, and then the other thing is that if you hire a new accountant to that company, that accountant is not productive on day one. Correct. Because there's all the tacit knowledge that they need to learn, right? Where they're asking all these different questions. And so the thing I always hear from companies automating accounting is that there's this gap between the written SOP of what actually needs to happen versus the more like understood guidance of what you're supposed to do. Yeah. It really ties this problem of user simulation, right? Of like so much of work requires asking questions and interacting with all those people around you. And so we can't effectively automate these problems and build these environments unless we solve that capability within the model environments. Yeah. [00:44:11] S1: I mean, you guys are at the frontier of it. So I'm very curious how this all evolves. [00:44:15] S0: It is gonna be uh exciting few years. So yeah. Well, thanks so much, Andy. That was a lot of fun. [00:44:20] S1: Appreciate the invitation.