Season 4, Episode 4: Which Pilots Should My School Try?
15 Nov 2022 · 31 min
In this episode Michael Horn and Diane Tavenner explore how schools can deliberately select and prioritize innovation pilots. They begin by reflecting on their partnership and the broader purpose of the podcast – building community among educators seeking systemic change. The conversation then moves to concrete frameworks: (1) aggregate project planning (Wheelwright & Clark) that starts with SMART goals, gap analysis, and categorizes innovations into incremental (core), derivative (platform/sustaining), and transformational (bet) types; (2) driver diagrams that translate a SMART aim into primary and secondary drivers, creating a visual strategy and prioritization tool. Diane illustrates these ideas with Summit’s history, describing two transformational bets (the 2011 blended‑learning shift and a current mission‑driven redesign) and giving examples of derivative (the ED‑principal pilot) and incremental (quarterly step‑back meetings) innovations. They discuss the importance of matching pilots to organizational capacity, resource allocation (e.g., 10 % transformational, 30 % derivative, 60 % incremental), and avoiding three common pitfalls in the innovation funnel: over‑commitment, paralysis, and mis‑aligned mix of innovation types. Human factors are highlighted – pilots must fit the passions, skills, and buy‑in of the people who will implement them. The episode closes with reflections on change‑management, the need for disciplined rhythm in evaluating ideas, and a brief book recommendation (Daniel Pink’s Drive).
Chapters
Foreign. Hey, Diane.
Michael, it's a really good week to tell you how grateful I am for you and our partnership. You know, processing through these. These crazy last few years in our conversations has been such a gift. And, and the added bonus is that I learned a lot from you. And, you know, that was brought home to me this past week as we've been preparing for this episode. Just, I just learned a ton in our collaboration.
Well, I first thank you, but right back at you, Diane. I was thinking of this recently as I taught about Lean Startup and discovery driven planning to a group out in Arizona a few weeks ago, and this, Diane, no joke, was by far the best I've ever taught it. And I don't think it's a coincidence, given we had just done this episode and it was a great way to clarify thoughts and take the theory that I bring with the practical realities on the ground that you bring and make it a much more comprehensive and tangible thing for those listening. So look, here we are gearing up for another episode, though now about innovating in schools and what it actually looks like on the ground.
Diane, it's so great. I'm excited for this one. And it's interesting, Michael. We usually start each episode by just naming the reason we started this podcast in the first place, and, you know, which is our shared hopeful for the future of schools as a potential bright spot coming out of the crises that our schools and our communities and our country have been facing over the last few years. But it occurs to me that at some likely unconscious level, a key purpose has also been to be connected. Quite frankly, at the end of the day, everything we propose here that we want to have happen in schools will rely on human connection. While I don't think we've ever said it explicitly before, I. I hope one thing we might be doing here is building connection among all the people who are. Who are like us and believe we can create the schools our children and our society deserve.
It's such a good point, Diane. And hopefully people, you know, sense that community. I mean, I, I will share one more story, actually, because as you know, I like to visit schools when I can on my travels. And I was at a micro school actually in Arizona on this, on this trip, and I was about to miss my flight because I couldn't get an Uber come to this location.
The new reality.
A new reality, right? And I was freaking out. And one of the women who leads the micro school, she just dropped everything and said, I'll drive you, which was so generous. But then a Minute into the drive, she looked over me and she said, you know, this is kind of weird because I feel like I've been in conversation with you and Diane on my phone for the last year or so, listening to you, and now here you are with your voice in my car. So as listeners like her now, this year we're going deep on how to innovate within schools. And it's not easy. I've obviously written about it, and we showcase innovative school models like summits, all the time. But all too often people don't see the continued innovation that you frankly do, Diane, in your schools and others like you do to keep getting better. Some of those year to year incremental improvements, but some are pretty big changes with how you've always done things to be far more transformational. I mean, that's actually how you moved into the blended learning world initially and how we first met. And so two episodes ago, you were amazing enough to share one of the pilots you all are doing at the moment to better support and ultimately retain school leaders, or your EDs, as you call them, others call them principals. And we talked a fair bit and in some depth about how to structure a pilot and what you all are doing. But the question I was left with, and I want to dig into this episode, is how or why did you choose this specific pilot, Diane?
It's a good question, Michael, and I'm glad you're asking it so that we can unpack it. And I will confess that it's pretty intuitive for me, at least from my perspective. When you ask the question, I'm wondering, do you have a framework or a theory? That's silly. I know you do. So which one of those would you recommend? You recommend to organizations? Just give me some structure for my reflections.
Yeah, I'm happy to give it to you. How I think about it sort of as I view the book of or the shelf of theories, and I take one off, right, and we put it on and see how it fits. But it is interesting. I think one of the reasons we do this is that we're trying to take what's so intuitive to certain people and start to create some rules so more people can access it. So we're not relying on intuition alone, but for this one. The framework that I love stems from something called aggregate project planning. It's a concept that Steve Wheelwright and Kim Clark, the former Harvard Business School dean, created. And the way I like to counsel schools through it is for them to first clarify what are their goals, like how do they measure what success looks like. And these measures, let's be honest, they can be complex and multifaceted. This isn't a for profit operation where it's just like the bottom line, right? It's much more complicated. But the idea is that they should still be measurable in concrete, specific ways and they should be time bound so that everyone in the building or in the school community knows what success is. And that gets back to the importance of having those smart goals that we talked about two episodes ago. From there, once you have those goals in place, then you can start to say, what are our current gaps? Like, you know, how far are we away from realizing our goal goals and how large are those gaps? And to realize those goals and frankly close the gaps, you then say we're going to need to invest in a range of different kinds of innovations. And so Wheelwright and Clark, they identified in their seminal paper four types of innovations they had support. Derivative, platform, breakthrough. I could have those slightly wrong, but that's my recollection. And you know, but we could easily just frame them as something like, okay, you got your core or your incremental, you know, your sort of routine innovations you do on a regular basis without thinking about it, you've got your derivative or what you might call your sustaining or platform innovations or something in the middle. And then something like more transformational. For example. I will tell you, I know you all do this because frankly, Diane, when you had, you had clarified goals and for your graduates, what you wanted them to do in the world, and I know you'll talk about this later, but you also knew what your gaps were for those graduates, and that's part of what led you to launch that blended model, as I recall the story.
Anyway, yeah, okay, this is really fun. Now that, that's the perfect entry. Remember last season, Michael, when I shared that I was reading Leadership Lessons from the Cherokee Nation by Chief Corn Tussle Smith? Okay, so in my view, it's a, it's a brilliant leadership book, one that we've studied as an organization, and we use it to build our leadership capacity. And the essence of Chief Smith's theory is that leadership is simple. It's knowing where you are, which he calls point A, knowing where you want to go, which he calls point B, and how you will measure that success and then make a plan to get from A to B. And then you, you make a series of adaptive moves along the way because nothing ever goes to plan. So simple, right? You just said clarify your goals, which I read as point B, and define how to measure your success. Okay, Check that's in that. And assess your current gaps, which is the difference between A and B. You got to know where you are to know what the gap is, and. And then invest in innovation. That will close that gap, which I read as the plan and the mechanics of innovating, in your words, you know, innovating in your words. And, you know, I don't love that word innovation so much anymore. So that's sort of the adaptive plan, in the chief's words, is really, in our language, improvement science. I mean, that's what that body of work is. So it's interesting to me that there are tons of books and articles and theories. And in the end, leadership is really simple to conceptually know how to do. And as you and I both know, it's really hard to do in practice. And so, you know, that point A to point B in real life can be really challenging. But that might be. Well, that is a conversation for another day. The key point here is that innovation is, by definition, in my book, leadership. It's not separate. It's not different. It's the core work of leading and managing a successful organization. It isn't a side project or a silver bullet. It is the work that we do every single day. And I think that might be the most important thing we figured out at Summit. And what sometimes seems to be missing in other organizations who want to innovate is they don't see it as actual their job, the core work, the leadership of the organization.
Yeah, it's such a good set of points, Diane. I've always loved David Gergen's definition of leadership, which is basically the same as what you just laid out, which is that leadership is the act of trying to move a group to a goal, and you're doing it within a certain context. That's simple. And yet, as you said, much harder to do than to say. But I think the other piece of that is, you're right. A lot of people when they quote, unquote, innovate, they're just throwing stuff at the wall as opposed to, like, very strategically, how do we improve against our goals? And that's why innovation, I think, can get, like a weird or bad name, because it becomes the throw stuff at walls practice as opposed to being deliberate. So I guess on. On the doing note, though, Diane, can you narrate a bit of what this looks like in your actual context?
Yeah, definitely. Let's start with the different types of innovations, because I liked. I liked the three categories that you named. They really resonated with me that this idea of sort of incremental, you call it core, the middle group, the sort of derivative or sustaining, and then the transformational. And I'll be honest, Michael, the easiest for me to identify right off the bat, the bat are the transformational ones because quite frankly, there's so few of them. In the last decade or so, I think we've undertaken two transformational innovations at Summit. No, I know we have. We, we've done two transformational innovations. The first was back in 2011, you referenced it at the top, you know, and, and we're about three years into the making of the second one. And so let me just ground folks a little bit in that quick history. I think it might be helpful. So in 2011, Summit's very first class of graduates had been out of high school for four years. The mission of our school and our organization was to prepare a diverse student population for success in four year college and to be contributing members of society. Our mission was our point B. And it's one of the nice things about being in mission driven organizations. You're actually pretty clear about where you're going. And so everything we did was to move towards realizing that mission. So of course we were measuring college graduation as the primary way of understanding if we were meeting the mission. Now it takes a long time to get to that moment. So I will never forget the day when we confirmed that in the first four years out of our school, 55% of our first graduates had earned a four year college degree. That day changed everything, Michael. Interestingly, most people outside of our organization thought it represented incredible success because by comparison, our graduates were doing so much better than the national averages for persistence in college and four year degrees. But we were obsessed with the 45% who hadn't earned the four year degree. Our goal, our North Star mission, was 100%. And so to us, the model we had built was not working the way we intended. So the gap starts to emerge. I now have the language of transformational innovation. But at that time, honestly, Michael, we called it a bet. The farm change. That was our language that we decided to undertake to tackle that gap. And we decided that if we had any chance of addressing it, we basically had to bet everything we had on a change that would do just that. And as you noted, this is Summit's first transformational innovation, which was a fundamental change to our school model that brought us into the blended world, the personalized world. It went through a series of titles. The second transformational innovation is in progress as we speak again. It was prompted in the very same way. Three years ago, we did the most comprehensive study to date of all of Summit's alums from all of our schools. And of course, we looked at the measurement of our mission, college persistence. And Michael, the, the number hadn't moved. I mean, we had a lot more graduates at this point, but the number hadn't moved. And I'm going to skip over the emotion that's involved in these situations because there is a significant amount and just say that once again, there were these mixed interpretations because there is a remarkable story of achievement there. And our model isn't meeting our intended goal or mission for our organization. And so for us, these are profound moments in our, in the work that we do and in this case, the collective leadership of Summit use this measurement and all of the accompanying data and information. We have to, for the first time in 20 years, change our mission. And we did that to be reflective of the current world and responsive to students and families. And we also launched a second bet, the farm model change that is designed to close the gap between where we are point A and where we want to go, which is point B in our new mission.
Wow, your storytelling, Diane. I think here is though, exactly what should happen in organizations because looking to your history does a few things, but among them, it, it helps you identify and categorize past projects that you've done to understand like how much each kind of innovation, how much each category, if you will, is likely to move us toward our goals. And once we've done that, then we can know how many of these different kinds of innovations in each of the categories are we going to need to do to actually realize those goals. What's the mix, in other words? And it's clear you've begun with the two big ones, those transformational categories. What about incremental and derivative? I'm just sort of curious what slides there.
Yeah, well, there are a lot of those, so I'm not sure I'm going to be able to categorize them all. But perhaps let's work through a few examples and you can check me to make sure I've got them in the right buckets. But let's start with the one we talked about a couple weeks ago in the pilot we're doing. This is the year long cooperating Ed principal pilot. In my view, that is clearly a derivative pilot. It is a next generation management structure model that's derived from years of work to improve the old model that has consistently fallen short. Does that, I think that Resonates.
That lands for me as well. Yeah. Because it's not a simple. We're tweaking the mix of projects in the platform sort of innovation.
No. Okay, great. I think a good example of the incremental or the core innovation we've got going on right now is how we structure our quarterly step backs. And so, just in short, the school and network leaders gather on a different school site each quarter. We, you know, different people do different versions of this. We're using an improvement, you know, basically improvement science techniques to improve the efficiency and the efficacy of those days so that they better support our mission and goals. So that's like an ongoing incremental seems.
Yeah, I totally agree. That makes perfect sense. And I think it's a perfect place also for improvement science to make a real tangible impact. I also imagine more broadly, Diane, that over the past few years you've seen dozens of things, I suspect, in all these categories that you thought you might want to change in your schools or that other educators, frankly have reached out to you or other leadership and said we really ought to overhaul X, Y or Z thing, you know, and my guess it's is it's not a shortage of things that you could do pilots within each of these categories. So what I really want to know, I think, is how did you choose this specific pilot? Let's stay with the ED1, et cetera, or something to tackle instead of all those other things. And just to further frame the question and like, where it's coming from when I ask it, Diane, my experience with a lot of school superintendents and principals, when I talk to them, is that when they list out their priorities for the school year, they end up with like a list of like 30 things. And the reality is, is if you have 30 listed priorities, that means you actually have no priorities because you aren't prioritizing just a couple things and making trade offs. And that means you're not going to do all these things. Well, and it's actually interesting until roughly like 1900 or so, for 500 years, basically, the word priority existed as a singular word, not plural. It was only around 1900 that we made it a plural word and allowed people to get away with having multiple priorities.
Fascinating. See, there we go again. Learning. Super interesting. Okay, I like this question. I'm gonna get a little bit nerdy here, though. I know you don't mind that. I hope, I hope others don't mind it. So my answer here is we use driver diagrams and for those who don't already know what A driver diagram is and already love it because we. Once you know it, you're gonna love it. In short, it's a tool that asks you to clearly articulate a. I'm just gonna use your language from before a smart aim, you know, it's specific, it's measurable, and it then asks you to identify the primary drivers of what will move you from where you are today to that aim. And so I just love the sort of simple terms of it. It's like if we do X, then our aim will be true. And very rarely is a, you know, a single thing will make the whole aim true. So you, you have a few primary drivers there. And of course, depending on how big your aim is, the primary drivers might be pretty significant bodies of work. And in that case, they get secondary drivers that are, you know, you sort of do the if then thing with that, get identified. And when we do this and do it well, what we get is basically our entire strategy for how to achieve our big goal or our mission articulated and prioritized. And you know, as a leader of schools, you read books and people tell you that you can only have a small number of priorities. And you just taught me that maybe it was only one, but, you know, most people will allow you a couple nowadays. And I will say at the same time, I get that cognitively it feels impossible not to prioritize 30 things, as you said, Michael, for me, leading my organization to build a well constructed and agreed upon driver diagram is sort of the third way approach here, where I bring both of those like, demands on me together. Summit does a lot each year. No one, I think, will ever accuse us of not doing a lot, but it's all organized and prioritized under a clear aim, with a clear prioritized set of measurable work. And the huge benefit here is that everyone in the organization can actually see their own and specific work and where it fits into the driver diagram or the strategy and how it relates and how it contributes to the aim, which maximizes resources and capacity and really does address some of that, like, hey, can't we do this? Can't we do this? Because, you know, you just ask yourself, well, where does it fit?
Gosh, I'm totally getting goosebumps right now, Diane, because Clay Christensen and Bob Mesta, I think, would have called this work you're doing driving forces is what they called it. And as I understand it, driving forces was basically what you just described. And it was something that Clay was very big on before he discovered and I think frankly got swept away with by the world. This, this idea of disruptive innovation. But it was all about, like finding root cause forces of what caused, you know, a certain outcome to occur. And then, like, map backwards, what does that mean we need to do? And very similar to what you said. So that's all cool. I guess the question then is to figure out which of these projects appear on that almost fish tree diagram, for lack of a better phrase, that you're actually going to tackle in a given year, that there are two more pieces that I think it's worth going over in terms of the aggregate project planning framework itself. So as an organization, we need to know, historically speaking, just how many of these different types of innovations do we try out as a pilot before we get a successful one? Because not everything we launch, especially frankly in the transformational category, is going to work or get the outcomes that we want. And then we need to ask ourselves, what's our capacity as an organization for actually launching innovations in these different categories, as in, most organizations can't successfully try out more than say, one transformational, what, every three to five years? Maybe that might be even stretching it. Maybe you can do like three derivative innovations a year. I'm somewhat making this up. And maybe like 10 to 15 basic or routine innovations a year. I think Clay Christensen used to say that it's like 10% of your investment is into the transformational category, 30% is in derivative stuff, and 60% is in the basic blocking and tackling of improvements. And the reason I think that's important to know is because all too often, and I see this all the time, Diane, organizations do one of three things with their ideas and their innovation funnel, right? So again, the innovation funnel is all those ideas and those things that quote, unquote, you should do and everyone's telling you to do. But first, basically the first mistake is that leaders over commit and execution suffers. You just can't do it. All right? The second mistake is that they don't commit to anything and they just get paralyzed because, like, oh my gosh, we could do all these things and they don't do anything. And then the third mistake that I often see is frankly, that they commit to the wrong mix of these innovation types. And there's a mismatch to your point of driving to the aim or the goal between what they actually do and their actual strategy. And your actual strategy, by the way, is what you do, not what you say. And so you see that mismatch start to develop en route to that point B, if you will.
Diane, I can totally see how all three of those things could happen if you're not incredibly clear about your mission, your big goal, your aim, and how you believe you are going to get from here to there. I think we might be tapping into the moment where theory and practice miss each other. Michael, you know and understand a theory about a mix of innovations and how you can put some estimates on it and guidance. But in the end, the leaders in the organization have to take an extraordinary amount of complexity and make sense of it in that framework. And they have to make it real and bring it to life. Life. And I can't help but thinking if over committing, paralysis and mismatching are products of not having a really strong mission, aim, driver, diagram, or the equivalent of the stuff that we've described. Because without the clear prioritization and inherent criteria that comes from it, how in the world could you make choices, let alone good choice choices? It would. It, I mean, it feels like I'd be betting on horses based on, you know, their names and their jockey's uniform color or something like that. And.
Oh dear, you may have, you may have just spotlighted Diane, why I'm so bad at betting on horse racing. But, but, but continue with the strand because I think this clarification around goals and the work it takes as an organization to do that, to figure out what you're going to do is really important.
Yeah. I think another thing to note here is that innovation is by definition change and change is by definition hard. That there's a reason that there's volumes about change management, which is another reason to have a clear aim, theory and articulated strategy with a very compelling. Why? Why are you doing this? For everything you're doing, you have to bring the entire organization along with you because otherwise you're just going to get all of these millions of ideas that have nothing to do with what you're doing. And how are you supposed to. What criteria are you using to make those choices?
Yes, yes and yes. I think I look and I think we probably want to talk in a future episode about how once you've chosen the innovation or pilot that you will do and those you won't, how you get everyone else on board. But, but for this topic of just choosing the bets you're going to make, the big thing I think you've done is by having a very clear sense, Diana, of, of goals and cause and effect, like what drives the outcomes you want. In other words, that allows you basically whenever someone comes into you, you know, with an idea or a project or A pilot that they want to do that you quote Diane, you just have to do this. You take their suggestion, and my guess is either implicitly or maybe explicitly, you sort it into the appropriate category. And then ideally, you're setting up a rhythm whereby you, as the leadership team, are evaluating all the like ideas against each other at clear checkpoints or milestones. My guess is like, maybe this is the summer where you say, okay, what are the couple things we're going to commit to? And by doing that, you have a discipline and a rhythm to be innovating against those goals. And by doing this, you also make sure you're not pitting, say, a transformation idea against like a routine just sort of thing you would do where the payoff, it's significantly larger for the transformational idea. But the risk and also the effort in terms of resources is. It's freaking a lot higher. So it's just really figure it's really hard to pit those sorts of innovations against each other, which I think is what a lot of people sort of default to sometimes because they haven't built this prioritization theory.
If the innovations are not planned separately from the work of the organization, we can then evaluate if we have existing resources that can drive the innovation, which is most likely true for a certain number of incremental innovations, for sure. And we often. And so that goes back to your sort of 60% when you were saying that, I was like, yeah, that's kind of like, because you have people doing their job, and if they know how to do this work, they do their job and they do it at the same time.
Right, do your job.
Exactly. So we often find that we need. We find that we need project management support for the derivative innovations. You know, there. There is like a little extra needed in there. And so that requires some extra resources, and the transformational require substantial resources that go well beyond our normal budget. And so for the last two categories, we know that we need to secure additional resources in order to bring them to life, which helps with the discipline of like, okay, we need to plan that out, and for us, that's generally through fundraising. But you can see that it helps us to be really clear about what are we doing, what do we expect to come from it, and why will it benefit not just us, but others as an innovation? And then therefore, why does it deserve resources?
So this makes a ton of sense, Diane. And the resources you just outlined are actually exactly what I would expect these different kinds of innovations to require. But I guess my last question is to asking you to Bring us home, because I'm still a little stuck. Like, how'd you pick the new support model for your EDS as the pilot to do out of. I don't know how many other things were. Were on your plate at the time.
Yeah, well, Michael, I hope we've been able to unpack that. It is more than intuition here that I do really believe in a disciplined approach. And. And we've been talking about how necessary that is to do this work. Well, I would argue it is insufficient, though, because there's a human side to all of this. And I, and we, our leaders, believe strongly that you have to factor into these decisions the passions and the interests and the skills of the people who you actually have in your organization doing the work. And, you know, the best chance you have for an innovation to succeed is that it fits into a really clear strategy and has a clear hypothesis, and that the people who are designing, implementing, and living with the change believe in it, they care about it, and it resonates with them. And in the case of our ed pilot, we have extraordinary school leaders who want to be more involved in the leadership of the organization Sensation and want to continue to be excellent site leaders. The real people who are doing this work want the and. And not the or of this and of our previous model. And so when we all came together around the analysis of the idea, this was the thing that put it over the top for us. Amazing, talented people believing it and wanting to do it.
Love it, Diane. And I mean, it frankly lands right. But you all had a conversation and you made it explicit and you brought it home. So we'll put that aside before we leave. Everyone. What's something you're reading or watching or listening to right now?
All right, well, I'm doing some work with a group that is pretty new to basically everything we talk about on this podcast. And so I'm going to revisit an oldie but goodie this week, Michael, which is Drive by Daniel Pink. A real oldie, but a real goodie. At Summit, we have what we call the Leadership Bookshelf, which is a list of foundational texts for everyone engaging in our work. And this is one of those select texts that's on that Leadership Bookshelf, because, quite frankly, it just so clearly lays out what motivates people and something I think our traditional education system tends to sadly, completely ignore. So one of my favorite parts of the book is at the end, where the author gives you a recap in all sorts of different forms. So from a personalization perspective, I Love this. And one of the forms is in is a, is a tweet that summarizes the book. And so I'm just going to leave you with that tweet which is quote, carrots and sticks are so last century. Drive says for 21st century work we need to upgrade to autonomy, mastery and purpose.
Ooh, I love it. I love it, I love it. Love me some Daniel Pink in general, but love that quote. I've got a few things for you, Diane, because I've been sort of laid up with COVID and you know, you get to watch a little bit so few innings of the World Series each night. But the one I'll name is that I finished the book called the Science Transforming how we Learn. Uh, it's by Sanjay Sarma. Until who until recently he actually lived near me and, and, and leads open learning at mit and he wrote it with Luke Yokinto and it's a book I had skimmed when it first came out, but I finally sat down to really read it and it's terrific. I think it's the best book I've read at helping to bridge the gap between what I think of as the unfortunate and false dichotomies between the so called constructivist and behaviorist learning camps in the world. Sort of curious how you think about. I think they're frankly camps that even John Dewey tried to close toward the end of his life. And folks like you at Summit or Montessori, I think do a masterful job of pulling from the right camp at the right time, depending on the objective and context. But Sanjay and the book does just a great job, I think grounding it in the evidence from the science of learning from both neuroscience and cognitive science. So I highly recommend it it as a read and with that, thank you for joining us on class disrupted.
More from Michael
The Impact of AI Optimization on the Use of Time, Space, and Resources in Schools
The Impact of AI Optimization on the Use of Time, Space, and Resources in Schools