Latent Space: The AI Engineer Podcast
00:43:51 · Fabian Theis, RJ Hanaki
Early on, a lot of things have been around just RNA, but you know, since then, you know, we had a very nice paper in science last year on single cell proteomics, we've been extending things to spatial observations, you know, there's sort of all these additional modalities and things that you can can can measure, and I think then interesting questions come up in that particular domain where you know, assays work very well. [00:44:11] S1: Yeah. I mean, is my natural inclination is to like gathering cross domain stuff. It, I think it's all often ripe for good, good generation of really good and interesting ideas. Have you just as a follow-up, these you've been doing this eight years now, I guess. So what kinds of, you know, sort of longer term outcome benefits have you seen from this?
00:44:33 · Fabian Theis
[00:44:33] S0: I think one thing that this is also, I think, how we got students to even join in this maybe initially. It sounds like more work. Right? You kinda need to learn two things, and you go to two lab meetings and so on. But I think once, you know, students are done in in in in in Germany, Europe, think in general, but I in Europe in general, people sort of typically do a master's first before they go into a PhD. Right? So not just bachelors in US. Right? So you do, like, one or two or more of master. And and then they sort of know science a little bit, but they don't exactly know what sort of interests them. So in this combination type of thing, you know, they can sort of sample a bit because in this grad school, they just get different proposals, so they can sample a bit what they're interested in terms of domain, but then they can also play around a bit with the method side. So I think that was kind of attractive. Yeah. I I think with this sort of trying out different things, I had the impression that this sort of turned the students into very good data analysts, but then also modeling people. And then a downstream, you know, the sort of areas where they they went into was also equally diverse, know. So some people went back in now in the in the biomedical domain into pharma, but, you know, some obviously is data research, some went more into some sort of startup direction, some went into very pure AI type of work. I think NVIDIA just a few months ago were hired in one month, two of my people going very much into sort of the computation aspect, and also a bit of a biopart that NVIDIA is now building up, and there are similar other of the big companies. So I think it it gives them an an an interesting profile. I think when... Nowadays, when you get interviewed, you know, it's it's a good idea to say, you know, I I didn't only do, this fancy model that improved maybe 2% in a NeurIPS paper type of thing, but you also sort of had the real sort of more complex, deeper application that, like, you know, I had to help find as as a use case.
00:46:07 · Brandon Anderson
[00:46:07] S2: There's been a movement amongst AgenTeq AI. Like, several guests we've had or we've had a blog post about how the wet lab scientists have started basically becoming computational thanks to AgenTeq AI. I don't know if this is... As I'm kinda curious, like, as this evolves, as basically now AgenTake AI enables any scientist to be now become their own computational, what do you think the evolution of this sort of, like, co advising strategy is? And also, what do you think the evolution of, like, integration between wet lab, biologists, and computational teams are? I mean, I also can think of, like... I've heard several, you know, famous CEOs say things like, our strength is integration between computational and, well, lab teams. So I'm I'm curious to see how you think that evolves and how you also, like, set up culture to exploit, you know, these new technologies.
00:46:56 · Fabian Theis
[00:46:56] S0: Let let me maybe sort of keep the the culture part a bit out because I think it's a hard one to answer, but a very good one. So let me first sort of talk about the, I think, very cool, cool point that I I think you asked about where where these things happen sort of goes with deep integration. I think one of the most exciting frontiers we currently face, and I think maybe have as an opportunity, is we can really now start guiding the experimentation. So where before, you know, we built these human cell atlases. We had sort of this mapping aspect. Then we talked about the word model prediction problem. Right? So from mapping, we went to prediction. But now we can go to actually steering the next experiment. Right? And this has always been the scientific method, know, sort of putting a hypothesis in the loop and then doing something with it. But quite frankly, very often the papers end it with some model, right, maybe some sort of concept figure, maybe at a little bit validation. Then typically you start the next project, right. And of course you learn a bit, but there's not like not like a continual learning type of thing. But now, you know, I think we can actually really loop back more and more. This is happening very much so in molecule design or material design and so on, you know, sort of the lab and the loop is really working out. And even though some big pharma has been putting this out as sort of a general general big theme, there's not many examples here where really people do multiple loops of this integration of an experiment, a computation model, then going back, whether this is now two person to one. Right? But like this integration is hard to set up. And it's hard to set up once because of modeling, because actually sort of once you have a model, actually deciding what's an optimal next question is not trivial. And we actually brought out, I think it should be on on bio archive today or tomorrow, a new thing which we call Lab Compass, which is an inverse generative model that actually allows you once you have a forward world model or whatever, to tell you what you need to do in order to reach a certain state. So super exciting for us, right. And I think a big part of the work was not just the model, but actually the work with experimental people.
00:48:37 · Fabian Theis
In this case, a good friend and colleague from University of Cambridge who was doing hematoquiesis in addition, had a sort of a rapid cycle system where we actually set up three, four lab in the loops where we iteratively improved on a model. And this is, I think, a really hard thing. And this sort of goes into your second question, Brandon, right? Like how do you bring up a culture where once your computational person or model or whatever predicts something that you actually get to convince experimental people to put their lifetime in, because these experiments often take some time, right, to actually buy into and actually measure some of these follow ups. And sometimes, you know, this works a bit better if it's sort of molecules, because then, you know, so the stakes are not as high, but, you know, if you, like, say, you know, you need to do this new cell and you need add these very strange things, do you really want to do this? Like, shouldn't we maybe not take a bit of our gut feeling, and then you know, this sort of these intermediate solutions come. So I think really setting this up is far from trivial. That needs culture, and it might be the same person doing it. A lot of people then start throwing around robotics and so on as well, but I I think this is a tad too early because the the cycle times in terms of our essays are still a bit on the long side. But I do think this will come. And, you know, obviously the the ultimate vision being that we want to RL everything, we want to do RL also in in in in this loop. It's a bit out there, but, you know, I think we're we're slowly getting that. The moment is more maybe active.
00:49:50 · RJ Hanaki, Fabian Theis
[00:49:50] S1: I think that very much like we talked to a Lila there, that is their their kind of their core thesis is is is that basically the lab is part of the RL environment kind of sort of thing. Yeah. No, that's great. Fabian, it is late at night for you now. I really appreciate you taking the time out of your evening to to talk to us. Look forward to to watching your research. And when I say you, I mean your lab and colleagues and you as well. I'm a really look forward to watching this progress and keeping careful track of the things that we talked about today. [00:50:23] S0: Yeah. Thanks so much, RJ, Brandon, for having me. I I I think these links are important. This sort of look in beyond what maybe you do, like in your own sort of smaller disciplines, and these discussions helped me a lot. I really enjoyed the discussion. Had a lot of fun. Thanks. [00:50:37] S1: Great. Thanks. Take care. Thank you.