What We're Missing When It Comes to Colleges and AI
25 Apr 2023 · 33 min
AI experts Michael Littman and Charles Isbell discuss how ChatGPT and large language models will reshape higher education. They argue against bans, pointing to tools like Quill.org and Khan Academy's Khanmigo that improve learning outcomes, and stress that AI's impact depends on how colleges integrate it into teaching and align it with mastery-based learning.
Chapters
Michael there's no question that even as the mainstream media talks about inflation or bank bailouts or climate change, there is one story that they're also talking about that is in our wheelhouse here on Future youe. That's the launch last November of OpenAI's ChatGPT.
There's no question about it, Jeff. The AI chatbot garnered anywhere from 5050 to 100 million users, depending on whose numbers you believe, within weeks. And it truly announced, I think, the arrival of generative artificial intelligence in the minds of the public. It wowed and, frankly, cowed people. And it's put education back onto the front page as people have wondered everything from whether this represents the end of writing to rampant cheating, or whether it heralds a new age of boosting the
quality of student work.
So today on Future youe, we're interviewing
two faculty members who specialize in artificial intelligence to help us understand the broader implications from AI and what's coming that
perhaps people in higher ed have yet to consider.
Earn Continuing Education units this spring with Teaching Practice, an online faculty development program from CourseHero. Over a series of asynchronous courses, you'll uncover new ways to leverage tech in the classroom and build inclusive curriculum, all while supporting your own well being. Plus, you'll get weekly office hours support from leading instructors. Enroll for free today@education.coursehero.com subscribe to Future youe wherever you get your podcasts. And if you enjoy the show, share it with your friends so others can discover the conversations we're having about higher education.
I'm Jeff Salingo.
And I'm Michael Horn.
When it burst onto the scene in November 2022, OpenAI's ChatGPT turned heads in education. Its clear and thorough written responses to user generated prompts sparked widespread discussion. What it might mean for higher education was one area of speculation. Some worried about the potential for plagiarism, with students dishonestly passing off computer generated work as their own creative product. Some viewed that threat as particularly formidable, pointing to three attributes that make ChatGPT different from past tools. First, ChatGPT generates responses on demand. That means that students can receive a complete essay tailored to their prompt in a matter of seconds. Second, ChatGPT is not repetitive. That means it answers multiple submissions of the same question with responses that are each different from each other, and they have different arguments and even different phrasing. And finally, its output is untraceable. The essays that it produces, the answers that it provides literally are not stored in any publicly accessible place on the Internet. That, in turn, has led to lots of hand wringing about the impact of ChatGPT and AI more generally in higher education. According to one survey from Best Colleges In March of 2023, 43% of college students say they've used AI tools like ChatGPT. Roughly 20% say they've used them to work on assignments or even exams. And roughly a third of students knew that there were rules that prohibited using AI at their colleges. But over half said their professors hadn't even talked about AI or ChatGPT. Now, ChatGPT is what's known as a large language model. That means it's one in which, in the words of ChatGPT itself, has been trained on a huge amount of text data, such as books, articles, and web pages. It has learned how to understand and generate human language by analyzing patterns and relationships in this data. That's the end of the quote from ChatGPT. But it does this in a probabilistic way by essentially predicting what the next word should be in a sequence. Michael Littman is a computer science professor at Brown University, studying machine learning and working to engage broadly about applications and the implications of artificial intelligence. His take is that public engagement with these core ideas of computing and artificial intelligence are critical to the health of our society because these tools are a powerful force, and they can be a powerful force for good or harm, depending on how they're used. As Michael pointed out, so much of the focus in the higher education conversation has been about these large language models. But that's not all higher education should be thinking about when it comes to AI.
I think one of the things we're seeing part of the sky falling is, wait a second, these models are too powerful. And the other part of the sky is falling is, oh, my God, these models are not powerful enough. And so there's a lot of mixed signals. I think that we're getting along those lines. But at the moment, we shouldn't be too surprised that these models are having a difficult time being useful, because they're not trained to be useful. They're really trained to predict the next word. And so I think, looking forward, my hope is that people will be thinking instead of so generally like, let's just make a model that knows everything about everything to say, okay, we need something in education, we need something in to support scientists. We need something to work on the power grid, and that they'll focus the data on how to exploit what we have, what we know, to some particular problem where you can actually measure the
performance those are a lot of different kinds of models that Michael is proposing. Folks in higher ed should think about models that are trained potentially on smaller data sets than our large language models and models that might do other things. For example, AI can perform specific tasks such as recognizing objects and images or making predictions based on data. As ChatGPT told me, these tasks typically require specific inputs and outputs, whereas language understanding and generation is more complex and requires a broader understanding of context, grammar and meaning. That's the end of the quote. But in other words, the inputs into these models, they're not necessarily language and they are trained by humans to solve specific types of problems. Charles Isbell is the dean of the College of Computing at Georgia Tech. He was a guest on a stop on the Future you campus tour at Georgia Tech back in June of 2022, and his research passion is artificial intelligence. He was one of the architects of Georgia Tech's low cost online master's degree program in computer science that at the time it was launched, was an eighth of the cost of that of its rivals and has gotten extremely good student outcomes. Charles told us that the limitations of today's large language models shouldn't surprise us perhaps as much as they seem to have.
It's a large language model and as Michael says, it's really about the next word, right? So here's a bunch of words. What's the next word that you're likely to see? It is not. Here's a bunch of knowledge and things that have happened recently. What's the next thing that is going to happen? How should I change my view of the world? Words to words? Now, because people talk in a particular way and because languages are, you know, they have a lot of predictability and there's a lot of data out there, you can appear to know what you're talking about. You can appear to be smart. But as someone once was having. I was having a conversation with someone recently about this and they're saying, well, as soon as you push it, it starts making things up. But that's not really true. It's always making things up. It just so happens that the things that it makes up sound reasonable most of the time if you keep it in its sort of narrow length.
Charles and I have both worked in the field of reinforcement learning, and one of the fundamental premises of that field is the learning agent needs to actually have access to the world to interact with it, to learn from it, to make a hypothesis and then test that hypothesis in the world. These language models can't do that. They make a hypothesis and the only way that they can test that hypothesis is by observing somewhere else in the corpus, is there some language that maybe bears on that? And in some cases the answer is no. Like, no one's talked about that. There's no examples of that. The only way to really learn that is to say something in a social setting and then have everybody look at you like you're crazy. And then you realize, oh, that was the wrong thing to say. And so I think there's a fundamental limitation in language as our entry point to all of intelligence.
As a result, Charles then argued, these tools are actually more limited than what they might seem at present. They're really good at translation, in other words, but they're not designed to build new ideas that don't yet exist. And the discussion around them also shirks the real question, which in Charles's mind isn't worries about plagiarism or the end of writing. Indeed, he called back to a breakthrough in AI in the area of grading written essays from many years ago, even before he helped launch Georgia Tech's low cost online master's degree program in computer science.
Using vector space models of words, you could predict the same score for AP English writing essay as a human being. And it worked remarkably well. And people, you know, some people are like, oh, this is amazing. But of course there was nothing going on there. It was just a collection of words. What you were really capturing is that people who write really good essays for AP English happened to use certain words. There was nothing about this that captured proper order. So you could in fact take an essay that was worth a five and completely scramble the words so they were nonsense. And you would get the same score because it didn't understand anything about word order. And what's happening now in some ways is very similar. It's just that it's a lot more subtle than just looking at the words. So I don't really worry about that. I think that there are ways to kind of deal with it. I think the real question we have to ask ourselves is if we think of this as a tool as a opposed to as an enemy, what does that actually look like for us? And how can we use it to effectively educate students and to make our lives easier otherwise?
So if these are some of the challenges with AI in higher education and large language models in particular, what are some of the opportunities? Where might they have impact? Jeff had some immediate ideas that led us to all brainstorm some others.
I was just came back from Arizona State and they're using it to rewrite course descriptions, especially for the catalog, especially for students. Right. Because if you, and, and then they're, you know, showing it back to the professor and the professor says, wow, that's, that's a better description of my course than, than I wrote. Right. And it's also, by the way, using words that people will use to describe the course. It's also helpful for the online courses to get people to actually register for, for them and sign up for them.
And one of the things that I discovered is I'm much happier being an editor. I don't want to write the first from the blank page if I can help it. I'm very good at writing introductions. I'm very good at sort of bringing things down to their essence and listing contributions. And it's the kind of thing you teach students to be good at. But you want to start from somewhere if you can. And I think that it's actually quite useful to use tools like this to just get started and get past that first blank page. But that's not the same thing as doing your work for you. It's not the same thing as explaining what is important about what you do. So I think it's perfectly fine. And I would be very happy to throw something in as a bunch of notes and then have Chat GPT clean it up and make it sound slightly better. I would, I'm sure, do another pass at it to make it sound like me, but I think that's a wonderful thing. I wouldn't, I'm no more bothered by that, that I'm bothered by, you know, Google Docs or Pages or Word trying to correct my grammar. They're wrong most of the time, but when they're right and I'm perfectly happy with them.
So those are just a few of the positive use cases. It's not hard to imagine many more. In addition to being your editor, these tools could serve as your research assistant, a way to uplevel all work around campus, and something to push and prod and test your own thinking. Indeed, since we recorded this conversation, ChatGPT has started to integrate with other tools, calculators and other computing tools that allow it to do many more things. But all this then raises another question. If folks like Charles are less concerned around plagiarism from these tools, might there still be bad uses for them? The answer is certainly yes. But Charles and Michael both believe that if we have deeper clarity around what are the goals from using these tools? And more broadly, what are we trying to accomplish in any specific facet of education that would be a helpful starting point.
I think here you have to be very careful. And I think a lot of the language around this and discussion around this sort of falls into this trap of not being clear about what the goals actually are. And so you end up deciding it's going to be an unalloyed good or it's an unalloyed evil, but of course it isn't. It's a tool. And hammers are very good for driving in nails, and they can also be misused in terrible ways. And so you just have to figure out how you're going to use it.
And perhaps those alternative ways might not be so terrible.
Michael suggested, could they actually cheat themselves out of an education or do they end up in the long run just getting a different kind of education? So I wonder, I wonder if there's other skills that even the undergrads, if they, if they're cheating, but they're cheating, you know, very consistently and deeply that they might come away with some skills that, that will pay off in the long run, like editing, like Charles said, Like, once you get to the pinnacle of your profession, like Charles, mostly what you're doing is editing.
These reflections then raise the question, how might we start to tune these models in the context of higher education so that they can be more and more useful? And perhaps this is comforting, but as the conversation shifts to how to tune these models to a specific problem, and we consider how to get clearer both around the goal of how we use these AI tools and, and the goals of any educational activity, that's going to mean more reliance on and input from human beings.
In particular, the notion of tuning it to some particular problem and not just saying, okay, we've got this giant model. It does everything, therefore it does everything. Well, I mean, you see this in human society that people specialize, right? And when you are a computer scientist trying to do biology and you don't know any biology, you do bad biology, right? The way you do good biology is you bring in someone who's, who's a specialist, who actually understands that area extremely well, knows what the subtle distinctions are, knows where the nuance lives, knows where the pitfalls are, and can really help scope a description or the work or whatever kind of biological stuff that you're doing from that perspective. And so I absolutely agree with you that, or I guess I'm on board with the idea that you're saying that, that honing these tools, it's not like we push a button, we create this great AI, and therefore it solves all human problems. And we're done. It's always going to have the same issues that we have, which is that to become an expert in an area, you need to study that area. Now, I guess an AI can study more areas in more detail than a person can, but with, like, less comprehension. So at the end of the day, I think, you know, you really still need to do the work of applying it to a particular problem.
The place where I think AI will actually have an impact if we do it right is on building models of individual learners based on the way that they interact with and interact with the systems. And the data you're able to get, like, we know, for example, that you can intervene with students in their first semester or two and significantly raise the chances that they will remain in school if you notice they're not going to class or that they're not doing well in this particular subject. And there's all kinds of things you can do in a very simple intervention will allow you to change the trajectory of their academic career. So imagine doing that at the individual level and doing the level of understanding and learning and automating that and making it work at scale. So I think data, the sort of data about groups of people and then data about individuals that allow us to tailor things at key moments during their educational journey is a thing that we ought to be able to do, which doesn't have anything necessarily to do with ChatGPT or large language models, but it has a lot to do with just simply predicting what we know about how human beings. When we can tell that human beings are falling, you know, off the cliff or sort of drifting out. I completely. I think that would be easy to do, and it's something that we don't do enough of, at least not at the level of individual courses and learning. I mean, imagine what a difference that would make, right, if as a teacher, you are being told, here's three or four students who are having this particular problem, maybe you should bring this up in your next lecture or, you know, maybe you should, you should look at this quiz question because it seems to predict something else, and it would change the way that you did, you know, the way you presented a lecture or the way that you, you did your final exam or, or the way you changed an assignment. I mean, those things can make. Make huge differences.
These insights then bleed into perhaps a place where AI might have a much bigger impact than what the conversation in higher education at the moment is focusing on. And that's the relationships.
One of the things that we've learned in research on education is that it really matters that people build a relationship with the teacher. Right. That's not just a matter of we'll just give you a lot of facts and then you'll know a lot of things. It's like people need the motivation, they need the positive role model. They need that relationship to happen. And, you know, at the end of the day, we're going to see, I think, a benefit from this technology to the extent that it can form healthy relationships with people and get them excited about learning. So I think there's. That's a scary thing because I don't know that I want people to have relationships with machines like that. That undercuts what a relationship is.
I mean, does it. We do that now, right? We have virtual tasks. People sort of bond with them and they learn, and they do a pretty good job of answering the common questions, and they make things easier for the rest of us. I mean, you could argue that even if you Ignore the virtual TAs, you and I already benefit from this, right? You teach a thousand people in a class, and you have an army of TAs, and the TAs are the ones interacting with the students. They don't necessarily build a relationship with you, but they think they do. I mean, so Michael and I both, we've created two online classes, one in machine learning and one in reinforcement learning. I continue to teach this class. It has a thousand students in any given semester. Each one of those classes, and the students see video of us, and they feel very strongly a connection between both me and Michael, even though Michael isn't there and doesn't interact with them at all. But they feel this strong connection. And at least the feedback we get is because of the way that we did this, they feel more motivated to learn. They enjoy it. It's actually working. And I don't know why that would be true of a virtual assistant or something like that.
That's very threatening to me.
Well, so, but, but, but on that,
right, I've seen some early AI that can, you know, create actor like humans that deliver content and you can reprogram and much cheaper to create content that feels like you're being talked to and so forth. Is that going to change the nature
of online programs and connections online?
What else can from an editing perspective through AI?
I mean, exactly what you say. I think you can create these things and people will connect to them and, and it'll help them learn or it won't. I mean, somebody's going to have to, you know, intervene and, and be a part of it, but it may, it may make the common case easier to deal with so that you can focus on the more difficult ones.
So at the end of the day, will the introduction of AI in education be a good thing or a bad thing? Charles argued that the ultimate impact comes back to relationships. And Michael suggested that the goals we set for AI will be what matters most.
We always overestimate the short term impact of technology and underestimate the long term impact. And that's what we're doing here, right? Everybody's freaking out and they're imagining worst case and best case scenarios. And I absolutely guarantee you that most of the things we're concerned about right now either won't come to pass or can be easily mitigated. It's the long term, decades long, cultural changes to the way we think about education and the relationship between students and teachers. That's what's going to be impacted and that's what we're going to have to think about. That's generational, not just, you know, what's going to happen in my midterm exam in the next three weeks.
One of the fears about AI more generally, not just in higher education, is that if we make it too powerful and give it the wrong goals, it's going to do terrible things to us because it's going to pursue those goals in a way that's going to be to our detriment. And I think arguably that is the case. Somehow people, humanity, are wired so that when we pursue our goals, we often in the short term do terrible things, but somehow in the longer term fix it and there's some force that is getting us back on track somehow. We just aren't. We don't accept when things are so terrible, we try to find a way to make them okay again. And I see that in this setting as well, that, yeah, it's a little bit of a bumpy ride right now, but we're going to make it okay again. We're going to figure out how to make this benefit people broadly.
On that hopeful note, we'll be right back on Future youe. Do you want your course content to be engaging or do you want it to be pedagogically sound? You probably want both, right? But knowing how to leverage all the teaching tools at your disposal can feel like a never ending learning curve, especially when it comes to technology. At CourseHero, teachers with diverse backgrounds come together to create rich and engaging learning experiences using online tools and applications. From learning how to create a more engaging syllabus to building a more inclusive curriculum. CourseHero is a virtual gathering place for teachers who want to level up their digital pedagogy. Join Course Hero's Teaching community, where digital innovators and classroom change makers connect and share actionable insights for the future of education. Create your free account today@coursehero.com Educators members get access to their faculty newsletter filled with teaching tips from fellow faculty, ebooks and early bird registration to upcoming events and workshops. Join today@coursehero.com educators that's coursehero.com educators
welcome
back to Future youe. And thanks, Michael, for putting together that package from our conversation with Charles and Michael, the other Michael, you bet.
Jeff and I want to dive in right away with a question for you, actually, because I'm curious. You get to spend a lot of time around faculty and administrators in higher ed, and I mentioned some stats about student usage of ChatGPT. But what are you hearing about from the faculty and administrators about their reactions?
Are they worried? Are they optimistic?
I think the reactions, to be honest with you, Michael, are all over the place because I think so many people, like many of us, are still trying to figure this out. And what I like about it is that where they are figuring out, they're at least being transparent about it with each other, with administrators and faculty, but also with students. So, for example, I was at Tarrant County College in December, which is in Texas, soon after ChatGPT came out, and the faculty members there were having open conversations with students about the tool, about both academic integrity, but also how the tool can be used as an academic aid to explain concepts that were really hard to explain in the classroom, to ask better questions, because it was generative in that way. Right? So you could continue to go back to it, to ask a question, to just make your questions better. And I really like that because it was involving the students in their learning. It was involving the students in how the tool can be used. It was involving the students about questions about the ethics of the tool. And so I think that this is just something that, to me, that college and university leaders and faculty members have to be really transparent about with their with their students. You know, I recently hosted a dinner for several alumni in the ASU Georgetown program that I helped start, the Academy for Innovative Higher Education Leadership. And it was interesting because at least one of the attendees runs a teaching and learning center. And she emphasized how such centers really need to bring together faculty to learn from each other. Because what we're also seeing, I think in this is how faculty in different disciplines might be using the tool in different ways. And so how do we and I think again, this is where teaching and learning centers could be really front and center on campuses and bringing folks together. And then finally, just one final thought on this piece is that I think we know so many people are running detection tools to create, you know, to catch cheating with ChatGPT, and as we know, some are not very accurate. And I really think it comes down to this core belief that the power of these tools should be in helping students and not punishing them. And I really hope that no matter what happens over the next six to 12 months, because I have a feeling this won't be the last time we're talking about this is that that is at the core of what colleges and universities do, is that it is doing what Tarrant County College is doing and making students be part of the learning process rather than bring this tablet down from on high and to say, oh, faculty, this is how we're going to use it, and oh, students, this is how we're going to essentially punish you if you misuse it.
Jeff, I totally want to follow up and just agree, agree, agree with that point because a, we know that active learning helps students. And so when you're involving them, they're active creators of that, they're going to get a boost. But also, you remember we had Sean Michael Morris in the show in the beginning of the season from Course Hero, and I thought he made the point that we really have to stop playing this game of trying to catch students cheating and instead figure out how to trust them more in essence and bring them as partners in the learning process rather than adversaries. Those weren't as exact words, but I think that's the sentiment of it. And it frankly, it seemed to be Charles and Michael's take to an extent as well, that plagiarism and cheating, that's just not the most interesting question at stake here. And I guess instead the question is, okay, what should they be doing? So then I get to pivot and ask you, what's your take on, you know, what should higher ed be doing with regards to this stuff if it isn't focusing on, you know, the cheating and the plagiarism?
Well, what's interesting to me about this is that AI in higher ed is not new. It's been around for some time now, particularly in the hands of administrators with administrative tools. So, for example, we had pound set at Georgia State, which is driven by the technology that Mainstay formerly and Mid Hub used. Right. And that was A chatbot that was integrated into course content. And we know that from studies they did at Georgia State that they did this randomized control trial where half the students were selected to receive messages related to the chat to the class from the chatbot. Half got those messages, half did not. And the students who received the messages earned grades of B or above at a rate that was 16% higher than those not on the chatbot. So here's clearly a way where AI helped. Or then, you know, you have Saint Louis University putting Alexa in dorms. Again, helping answer basic questions. This is obviously pre chat GPT and pre generative AI, but clearly still driven by AI. And now what's interesting to me is that now suddenly students have access to the tools that direct them. And suddenly we think it's a problem. Right. And that it needs to be monitored. So I don't want to repeat ourselves here, but again, it goes back to who has control of the tools. And when the administrators had control of the tools, it was fine to use them on students the way they wanted to use them. But now suddenly, when we have open access tools in AI now suddenly, oh, it's something. The students have to be controlled, right? We have to watch them. They have to be monitored. And I think it goes back to your point about what John Michael Morris told us. And just one other final thought on this, Michael, is we know the future of work is partially about the future of AI. It's clear that AI is going to take over parts of our jobs. I know here on Future youe, we hope that AI kind of books, our guests perhaps even writes our scripts for us. So, so we could be. So we could free up a little bit of our own time. But whatever it's going to take, take over parts of jobs. And so we really need to teach students how to use these tools, how to fail with these tools. What are the ethical things we should be thinking about? So the more that we make these tools part of the learning process, it not only makes learning more engaging for students, but more than that, it teaches them how to properly use these tools in the future when they're going to be confronted with them every day, I would imagine, in their jobs.
Right, Jeff? I just, I couldn't agree more. I think you're exactly right in this cat and mouse game of schools and technology, try to catch, you know, the learning and so forth, like the technology is going to win. Students are getting savvier.
They're.
They're using the models to make their essays sound more like them. Technology is going to keep getting better. This is just not the right focus and we need to move toward active learning. My favorite one, mastery based learning, where it becomes more about the mastery of the material instead of the game, if you will, of just trying to produce
the artifact of an essay.
Like, did I really learn? And really help students, frankly gain the confidence to put their own thoughts on the page, even if that means, like they might fail occasionally. And that's okay because now we're going to view it as an iterative process in which we're taking the AI as a tool to help them get better.
So let's finish up with this then. Michael we just got back from ASU GSV and there were so many panels there about AI powered tools. So what's the coolest AI powered thing you've seen in education lately? Because we know from, again from being at ASU GSV that every entrepreneur right now is pitching everything with AI in the title. And so what are you most excited about?
Yeah, so I'm not going to name one of the for profit ventures that was using AI in the deck. I'm going to go with two nonprofits actually, quill.org is one. They use AI as a tool to actually teach the writing. Jeff. So they basically have developed essay prompts based on, you know, passages that students have read and so forth. And then they trained the model on all of these possible answers students could give. And so, you know, you start off your essay with a topic sentence and the AI jumps in and says, hey Jeff, like you should be more specific in the topic sentence and outline, you know, the major points you're going to go hit. And then you start to get into your evidence and it says, hey Jeff, like you ought to cite, you know, X, Y and Z. And it's really coaching you along. It's a very cool writing tool. And then the second one that I think a lot of folks are buzzing about is Khanmigo, which is your friend in Khan Academy. And it's basically Khan Academy partnered with Chat GPT4 to create this tutor alongside and if we'll link to it in the show notes, Sal Khan did a demo of what it looks like, but it's really cool. Like you're doing your exercises, your quizzes, your problems in Khan Academy and there's a tutor right alongside you now giving you little prompts and so forth. And I think, I frankly think it's pretty revolutionary.
Jeff.
Yeah, it's interesting, Michael. I just think we're going to see so many revolutionary tools coming on this front in the next couple of years. And as we said, I don't think this is the last time we're going to be talking about generative AI on this show. So before we wrap up this episode, we do have one of our favorite segments. Our question brought to you this season by course Hero. And this one comes from Carla Carter, an associate professor of cybersecurity at Bellevue University in Nebraska, which Michael, as you remember, many, many, many moons ago, we first came up with this idea to do this podcast together when we both appeared at Bellevue University. And here's her question. How can we ensure through policy and practice that the use of AI tools
in higher education is ethical and equitable
for everyone, for example students, faculty, staff, the public, etc.
Thank you.
So what's your take on that?
Michael I think, you know, it's a great question to me and you said it also, right, Like AI is going to become part of everything in our in the work and the future in which we're living. So look, do not ban it is the first rule. There's been a lot of school districts in the K12 realm that have banned AI. Universities in some cases I think have that inkling. Don't ban it, instead incorporate it, make it available, create exposure opportunities really as the default so that it's part of the course and part of the learning. And, and this is important, I think, so it doesn't create extra fees for the students. It needs to be really something that we assume is universal and that universities, I think are going to be providing as part of the financial aid packages, if you will, just like they might help out with courseware and have gotten a lot better on things of that nature rather than sticking students who can't legitimately afford textbooks with the bill that they really start to account for these tools in the same way. Jeff and with just a big thanks to Carla for the question and a thank you to Charles second time appearance on Future youe and Michael as well, out of Brown. Just a really interesting conversation. It feels like it's changing daily at the moment with the news around AI. So we will certainly stay tuned. We look forward to your thoughts and we'll see you next time on Future.
You.
It.
More from Michael
The Impact of AI Optimization on the Use of Time, Space, and Resources in Schools
The Impact of AI Optimization on the Use of Time, Space, and Resources in Schools