AI, Accelerated Learning, and the Why Behind Math

Welcome to the Future of Education. And now here's your host, Michael Horne.

Welcome, welcome. Welcome to the Future of Education. I'm Michael Horn. And today's guest, Barry Malkin has had a fascinating career at a fascinating perch right now at a company that I got to know very early on in my introduction to the world of education technology, which is Carnegie Learning. We're going to hear a significant update, I think, about what they're up to and as well as, frankly, some perspective on some of the burning questions that educators are really asking right now around the rise of AI and more. But all in this bigger question, because we're obsessed with helping all individuals build their passions and fulfill their human potential. And that's something that Carnegie Learning is obsessed with as well. And so, Barry, first, it's great to see you. Thank you for doing this.

Well, thank you for having me. It's a pleasure to be here.

Yeah, you bet. So let's start with that, like just your own background right into your current role, leading Carnegie Learning in your own journey. I suspect when you started out, that's not something you would have necessarily guessed that this is where you'd be at the moment.

No, probably not. Although I have enjoyed every moment of it. I've been here for seven years now, and I'm having a ton of fun. We're making huge progress and having a huge impact on students across the country. So I couldn't be more thrilled with what I'm doing. I have had, I guess, an interesting pathway to where I am today. So I started as an investment banker in New York many, many moons ago, focus on mergers and acquisitions and covering a variety of industries at the time. And so I was in New York for a while. I'm from the Midwest originally. I'm from Milwaukee and a Midwesterner at heart, and decided to finally move back to the Midwest and brought my fiance or wife at the time to Chicago with me, who is a New Yorker. So that was a bit of a tough sell. But I was able to convince her. And I got a job working for Deborah Cuazo and Michael Moe. Actually, that was my first job in education. I was working with them for them at Merrill lynch in Chicago, and they were building an amazing business services and educational services practice at the time. And I just fell in love with education. I fell in love with the people. I fell in love with the mission, the entrepreneurialism. It just felt right for me and I kept rolling with it. So I stayed in investment banking for a while with Deborah and Michael, went to Another firm where I also stayed for a while and was advising companies all over the world on capital raising and mergers and acquisitions in education across the spectrum. I made a job transition at that time and I went to what they call the buy side where I worked for a public company, Career Education Corporation, in their mergers and acquisitions group and again working all across the world looking for higher education institutions to purchase at the time. So you know, that that was a transition from advisor to, to principal and I really, really enjoyed it. I went to make a long story short, I ended up at Apollo Education Group where I was the global head of mergers and acquisitions there and worked on acquiring educational technology companies and higher education institutions and even building some product there and doing some strategy work as well. It was a. It was a lot of fun. I was there for about six years. One of the acquisitions I did at Apollo was Carnegie learning. So in 2011 we had a real challenge at the University of Phoenix, which was the largest business within the Apollo Education Group. And that was we were having persistence problems with students getting through basic math education courses and we needed a solution. We were using products by, by a number of third parties and it just wasn't satisfying the requirements and we were losing too many students too early and they're in their post, you know, post secondary education journey. So we went around, we looked for solutions and we came across Carnegie Learning. We were fascinated by the work that they were doing, the research that backed the product, the AI and its capabilities, and we ended up acquiring the company in 2011. Again, to make a long story short, the post secondary industry had had lots of chall and the integration of Carnegie Learning into Phoenix didn't quite happen in the way we all envisioned it because of lots of distractions and changes in that landscape. But the idea was to obviously improve the outcomes in math, but also to leverage the AI across different subjects and classes throughout the university. So that was the rationale. It was a good thesis, a really good thesis and a great Little business in 2015. So I had left Apollo and I had been gone for about a year. I was doing some advisory work, some personal investing, and trying to figure out my next gig when Carnegie Learning was for sale. So they decided to divest the business when they were taking it private. And I put together a small group and we bought the business from Apollo. And it's been seven years now and we've completely transformed the organization. And I just always thought it was a sleeper. I thought it had, you know, the great bones, amazing people, great technology, the pedagogy was amazing and I naively felt that I could do something with it.

Well, and you haven't been wrong. So I mean that's, that's your history, right? And coming into it, the history of Carnegie learning, I think is also fascinating because I, you know, people may know, maybe they don't, but if they don't, it was initially a math only solution, and if I recall, really an algebra only solution developed out of Carnegie Mellon. It was built with AI, as you said. It's really, I think it's fair to say, and we'll get into this later, like the first edtech product with artificial intelligence in it that I'm aware of anyway, and a rigorous curriculum, rigorous backbone, lot of research behind it. It also had a very, at the time, sort of specific, shall we say, classroom models. A little arcane in its early days, but you all have evolved a ton. You have even more research. Like you're one of the few folks that has a federal government research study behind it showing positive and significant effects on student learning. But what are you all today like? It's much broader than math. If I look at the website.

Yeah, it is broader than math. And so when I began in 2015, we were simply focused on middle school and high school mathematics. And that had been the business for 20 plus years. And as you said, it started at Carnegie Mellon University. It started as a research project between the School of Cognitive Science, the school Psychology and the Computer science department, all led by John Anderson, who was really the force behind the research that created what was called Cognitive Tutor at the time. And you know, it's. That was very early in ed tech days, before there were computers in classrooms and you know, in schools they were very, you know, they weren't prevalent at all. So they were way, way, way before their time. But they had some success rolling it out as a research project within the Pittsburgh public school system and got a lot of interest in what they were doing from districts across the country. And Carnegie Mellon University is a very commercial university and knows a lot about tech transfer and monetizing intellectual property. And that's exactly what they did with Carnegie Learning and created a company from it. So we've evolved quite a bit. So first we first started out as a technology company. We moved into curriculum, and then we also moved into services. So those are really the three legs of our business today. But now we're broadening the business beyond math, but also expanding within math as well. So one of the most exciting things that's happening at the company is the launch of our K5 math product, which is going to be a blended learning product much like our existing 612 product line. So we're incredibly excited about this. This company has always wanted to do a K5 math product, and so I'm, I'm incredibly excited. The product's amazing. It'll launch officially at the beginning of September, but we're already, we're already getting a lot of interest in it. So that's, that's the main thing. We've expanded beyond 612 math into K5, but we've also expanded into literacy as well as, as world languages as well. And we're putting a lot of effort into improving, reinventing and wrapping technology around those, those subjects as well. So we're super excited. We've got a new Core612 product coming to market and, and lots of exciting things happening in the, in the world languages space as well.

Very, very cool. So, so let's, let's dive deep, though, in the math strand itself. Because one of the interesting things that, that you all say is you don't just teach people the what of subjects like math, but you really focus on the why behind it. Right? And so I'd love, I can guess what that might mean, but I'd love to hear it from you. Like, what does that really mean and how does that work in a digital learning solution? Like, I think when people think digital learning, they think like procedures and computations, but not why. That sounds like something you'd get out of a humanities course. So how are you all doing that?

Yeah, look, the whole point of what we do is to strengthen the conceptual understanding of mathematics. We are not a procedural mathematic math company. We really believe that students must, must internalize and understand why they're doing the math, what its proper application is, and when and how to use it most effectively. And, and if you're just teaching, you know, multiplication tables and memorization and, and manipulating equations, you're not teaching anybody the application of that mathematics. And so that's, that's really what we try to do. We, we center a lot of our problems around word problems. And I know some students find that more challenging, but at the end of the day, it produces students who understand much, much more about the mathematics and how to apply it in the real world. It's, you know, if you were, if you were a, if you were a engineer at SpaceX and you were trying to, you know, figure out, you know, the aerodynamics of a rocket, an equation is not suddenly going to appear for you to Solve that problem, you're going to have to figure out what it is you're solving, the purp of the math that's necessary to solve that problem. And then, and then, and only then do the equation. So this is what we do, this is how we teach and we believe it's by far the most effective way of instruction.

So I want to dig in this a little bit more and understand it better because as you know, there's been this big reckoning over the last few years around the science of reading, right. And for folks tuning in, right, like the importance that you actually have to teach the mechanics of how to read and not just sort of guess based on the pictures near you and so forth. We haven't seen that, I don't think in math per se. Like we've seen commissions come along and so forth. But it does seem to me, if I look at it from a high level, that there are some food fights or fractures, if you will, in the world of math, right. Like Crassley, I'd say on the one hand you got folks talking about the importance of learning procedures, right? Like getting auto to automaticity through, like, yeah, you got to memorize your times tables, right, so that you'll be able to do the higher order math. And then I think on the other hand, you have the conceptual folks that, that talk less about the importance of getting the right answer and more understanding the why behind the answer. You know, sort of what are the mechanisms, in other words? And I'm just sort of curious in your answer it sounds like you're saying both have wisdom, but I'd love to know how you think about the split and fundamentally what's the country getting right and wrong right now about math instruction.

So you said something that was interesting. You said that in the conceptual framework of mathematics, you care less about what the answer is. And I think that's a misconception. We want to get to the right answer. We just don't believe there's a singular path to achieving that answer. Every problem in life has a number of solution sets. It doesn't matter if it's math or any subject or domain. And so there is a right answer here. But we want students to be able to prove it out in their own way. It doesn't mean there's unlimited pathways. We obviously need to instruct the student in the most efficient method. But by having them stress, by stressing the conceptual framework and the ability for a student to take their own path, it's only there that we can actually understand where Their struggles are and where their misconceptions are. If they're just memorizing math problems and manipulating equations, we can't see the work. And if we can't see the work, we can't really diagnose the specific skills that they're struggling with.

Super interesting. So in other words, it sounds like, yes, I'm doing the procedures, but I want to see your actual work behind it, to see the pathways, because it may turn out that when I start to, you know, do the quadratic equation, you realize Michael actually has a more fundamental problem on understanding, you know, exponents or multiplication or whatever it might be, I don't know, factoring. And so you, you using that would say, okay, like, we actually got to go there. And maybe it's not a procedural thing, it's like a conceptual. Michael doesn't understand that this is in fact, a question of division. Is that sort of how you're thinking about it?

That's exactly right. And it, you know, what's interesting is our textbooks as well as our software utilize the same principles. So even though it's a digital solution, the digital solution is unpacking the specific skills that students are struggling with. And so within any math problem that we're providing within our Mathia software, we could be analyzing anywhere between 5 and 25 different skills in a single math problem. And, and when we're, and we're, we're really looking at those discrete capabilities of the student to understand where they're, where their struggles are. So it can, it works in our, it works in our print, in our ebooks, as well as our, as well as our software.

It's fascinating. So this actually, I think, hits at another tension we see right now in the math. It's not like the reading wars, right? We don't have the math wars, but I think there's some tensions brewing, and one of them seems to be acceleration versus remediation. Right? Like you're going to fix the thing that the kid is struggling with versus like we're going to push you through, but we'll sort of loop in, right, to build the skill up that maybe is deficient in the service of that higher order thing. I think those are the crass categories, if you will. How do you think about that question? I have a guess based on what you just said, but I'm sort of curious, like, philosophically, how you think about the importance of personalizing learning in a subject that's more cumulative maybe, than any other subject that's out there.

This is a hot Button of this organization, as well as myself personally. So what's happening in math education really way too often is that students are being placed in below grade level content because they are struggling with some component of on grade level material. And unfortunately, when you, when you take a student and you put them two, three grade levels behind, it could be a life sentence for, for being behind in mathematics for, you know, like I said, forever. And so what we try to do is we try to, we try to remediate the specific skills that they're, they're struggling with. And every student, whether they're an accelerated class or, or intervention course, you know, they obviously need remediation, but they don't necessarily need to be put, you know, in a single or multiple grade levels below where they need to be. And so we think of it as a highway. And the student can get off the highway for a moment or go on a rest stop, but they're getting back on that highway. Most other companies, through remediation intervention, they're taking them off the highway and they're putting them on a completely different road. We don't believe that's necessary. We think with the power of our curriculum and the power of our software that we can see specifically where they're struggling and maintain their trajectory on the road on the on course level material.

It's super interesting. Tell me if like this is my. Aha. I think from hearing you say that and tell me if I have this right. It sounds like to me, basically you're saying when we personalize along the categories of like on grade level or all for like fourth grade math versus sixth grade, it's too blunt an instrument. Right. Like we are tracking people and things that are hard to escape. Whereas when we're personalizing it sort of the atomic level. Right. Of like the specific misconception, then we're being much more precise. We allow for a lot more fluidity, frankly, like once you remediate maybe that one thing I didn't understand from like three years ago, I might start soaring now. Because now like everything comes, comes together. Is, is that the right way to think about it?

Absolutely, 100%. Every single student needs remediation at one point or another. The difference is we are, we are keeping them on grade level. We're not sending them down a grade or two. That's our whole objective. That's our North Star. Keep them on grade level. Remediate them where and when it's necessary, but keep them on task.

That's awesome. All right, so last topic, as we've as we finish up because you all hit on a bunch of the hot button issues in education and the last one right now is artificial intelligence. It's everywhere, right? Chat, chat, GPT and sort of is at the end of English and all these questions and math faculty being like, now you have a calculator, right? And all this stuff. So I said it up front. Carnegie Learning was at least as far as I know, perhaps the first solution out on the market with an AI driven solution. So not the first in research, but like really out in the market. There's obviously so much hype, excitement, worries right around this stuff right now. How do you. And it can be beyond your product, right? Like how do you think about the use of AI in education? Like where's it going to make an impact? Where is it overhyped and sort of, I mean you probably have a level of nuance that we don't. So what are we missing? What's the media and the conversation missing about this story?

Yeah, well, look, things are changing so rapidly with ChatGPT and it's hard to know exactly where it's going to go. I'm not a fortune teller or Nostradamus, so I don't know exactly. But look, the real challenge of teaching in the classroom is being able to differentiate between all the students and all their different needs because they're all at different places without question. Right. And so the power of artificial intelligence is the ability to kind of give those teachers some additional leverage to help all of these different students who are at many different places. It's what our Mathias software does. It's what it was built for and it's really what makes it so special. It's a competency based framework. Everybody goes through it at their own pace and it provides that differentiation to really help again scale the teacher's ability. So I think AI is an incredible tool. It's obviously in its infancy, but the power of it and you know, GPT and AI is really around the ability to personalize instruction for first, for every student. And that's the, that is the holy grail of education to be able to meet every student where they are at any moment. And so I'm very, very excited about the recent developments. It's going to keep us on our toes. We have to continue to reinvent ourselves and continue continuously improve our products. But I couldn't be more excited about, about where things are headed.

Let me stay on that one bit. And this is my observation, you didn't put me up to it, but I think It's a chance for you all to toot your own horn, no pun intended. But as I look at it, one of the things that I've sort of concluded about AI before the ChatGPT stuff came out was that in and of itself, like it's not going to deduce causality of what things you've got right or wrong. Like in its own sort of big abstract model, it is best used when it's built on a rigorous curriculum with good assessments that are giving good, indicate like good data into the model and sort of, it has a theory of learning. And when I look at you all again, you're developed out of Carnegie Mellon. There's a clear theory of like how math concepts connect with each other, the importance of understanding the why behind them, how you build that, like all that is there. And then the AI sort of turbocharges it within a model it seems to me, as opposed to like, I mean we're seeing this right now, right, With Bing and Google getting all sorts of things wrong in the world, which is okay when you're doing a search, less okay when you're instructing someone. It seems to me it's the two together though, like rigorous theory led curriculum with the AI that's like the magic sauce. Do you agree with that? Is that too simple?

I, I do agree with it. And this, this company is unique in that we have a large research staff. We are, we are undoubtedly the most researched education technology company on the planet. There's been more independent, truly independent. Not like, not like, you know, casual research and, and case studies, but truly independent research that's been done on our products and services. And it's proven that the approach that we take is sound. It works and works well, but it's really a combination of the pedagogy and the technology that work so well together. So I think we're in a unique place as a company. I think we have the ability to really make huge gains in outcomes. There is going to be a flight to quality within the, within the K12 school systems. All of these products and services, whether it's supplemental or core, that have been sold into the market for way too long have not had any discernible impact on student learning. Just look at, look at the, look at the numbers. And so I really think that districts are going to focus more on research driven products that they can trust, that they can get a quantifiable return on investment. And that's why I think this is our moment. This company has always been way ahead of its time. Today, we are exactly where it needs to be to make a huge impact on students across the country.

Well, here's to the impact. And Barry, thanks so much for joining us. I really appreciate you sharing the stories and the work that you're doing.

Well, thank you for having me. It's been a pleasure.

Yeah, you bet. And for all those listening, we'll be back. Next time on the FUTURE OF education.