00:26:02 · Grace Gong, Kevin B. Boyd
[00:26:02] S0: way. When an AI is answering something wrong, so how do you figure out whether the problem was the motto or the retrieve document or the prompt? [00:26:16] S1: So you're talking about less agentic in that question and more someone is interacting interactively with the tool? Is that what you mean? [00:26:28] S0: I would say, yeah, like more of like interacting since, you know, I feel like if you are building out, let's say like in the, yeah, I guess like also in the school context or like in whether it's like, you know, yeah, like, maybe, like, a faculty or, like, people are trying to pull diff... Different level of, like, information from the system.
00:26:28 · Grace Gong, Kevin B. Boyd
[00:26:28] S0: I would say, yeah, like more of like interacting since, you know, I feel like if you are building out, let's say like in the, yeah, I guess like also in the school context or like in whether it's like, you know, yeah, like, maybe, like, a faculty or, like, people are trying to pull diff... Different level of, like, information from the system. [00:26:49] S1: I mean, I'll be honest with... Like, we don't spend too much time helping people, like, with individual queries and things like that. We are spending a good amount of time helping people to understand how to use AI effectively. And that's true both with the staff, so the administrators across the university, as well as faculty and students. And so I think there's an element of many people when they start to use these tools, they think, I can just ask a simple question like what I do with Google, you know, or some other search engine and I'll get a response. And unfortunately, when you do that a lot of times, it's garbage in garbage out, you know. You know, what I think is really helpful for people to understand is the more context you provide, the better the answers that you get. And that's I think a key thing that we're really trying to help people understand, is how do you provide enough context, develop the harnesses, to get the results that you're looking for, whether that's something you're doing with an interactive chat or something you're doing with a tool like code.
00:26:49 · Kevin B. Boyd, Grace Gong
[00:26:49] S1: I mean, I'll be honest with... Like, we don't spend too much time helping people, like, with individual queries and things like that. We are spending a good amount of time helping people to understand how to use AI effectively. And that's true both with the staff, so the administrators across the university, as well as faculty and students. And so I think there's an element of many people when they start to use these tools, they think, I can just ask a simple question like what I do with Google, you know, or some other search engine and I'll get a response. And unfortunately, when you do that a lot of times, it's garbage in garbage out, you know. You know, what I think is really helpful for people to understand is the more context you provide, the better the answers that you get. And that's I think a key thing that we're really trying to help people understand, is how do you provide enough context, develop the harnesses, to get the results that you're looking for, whether that's something you're doing with an interactive chat or something you're doing with a tool like code. [00:28:03] S0: So how do you defend... So, like, going back to the security aspect, so how do you defend against prompt injection when something AI reads, try to trick into ignoring it's an instruction or exposing data?
00:28:03 · Grace Gong, Kevin B. Boyd
[00:28:03] S0: So how do you defend... So, like, going back to the security aspect, so how do you defend against prompt injection when something AI reads, try to trick into ignoring it's an instruction or exposing data? [00:28:23] S1: Yeah, that's definitely a problem. I don't know I the answer for that. You know, I think with where we are providing a chatbot, let's say a tool that allows someone to ask questions about benefits. You know, so much of that is us doing enough testing to make sure that prompt injection isn't possible, that we're really clear on what happens if someone is asking something that exceeds the bounds of whatever that chatbot has been built for? [00:28:55] S0: I guess like when we also talk about the research that the UChicago people are doing, What are something that you find most interesting when you are like looking at the researches?
00:28:55 · Grace Gong, Kevin B. Boyd
[00:28:55] S0: I guess like when we also talk about the research that the UChicago people are doing, What are something that you find most interesting when you are like looking at the researches? [00:29:12] S1: I have to be careful. Like, I can't play favorites. So. You know, don't... I want to avoid giving a specific example, but I will say that you know, I have a family member who was dealing with cancer in the last few years. And you look at some of the amazing research that's happening in universities right now about how to prevent cancers and how to treat cancers. You know, where I get really excited about that. You look at, I think most people are familiar with the mRNA, which has been so successful with COVID vaccines. Using that same mRNA technology to effectively provide essentially vaccines for certain types of cancers. Like, think that's, that is really exciting. You know, that is absolutely the kind of thing I get excited about. And it's one of the reasons why I love working at a place like the University of Chicago, because you do feel like in some little way you're contributing to changing the world for the better.
00:29:12 · Kevin B. Boyd, Grace Gong
[00:29:12] S1: I have to be careful. Like, I can't play favorites. So. You know, don't... I want to avoid giving a specific example, but I will say that you know, I have a family member who was dealing with cancer in the last few years. And you look at some of the amazing research that's happening in universities right now about how to prevent cancers and how to treat cancers. You know, where I get really excited about that. You look at, I think most people are familiar with the mRNA, which has been so successful with COVID vaccines. Using that same mRNA technology to effectively provide essentially vaccines for certain types of cancers. Like, think that's, that is really exciting. You know, that is absolutely the kind of thing I get excited about. And it's one of the reasons why I love working at a place like the University of Chicago, because you do feel like in some little way you're contributing to changing the world for the better. [00:30:40] S0: When I guess like when you're helping with like empowering these kind of like research with the tools that's like whether it's like the university is providing. Do you feel like it's since like you also work in like commercialized companies before and like, is there any core differences of like building out the infrastructure for like the school versus like, you know, the IT of like, you know, United Airlines or like things that are kind of like more commercialized?