How to Redesign Organizations for the AI Era

Today on the AI how to reshape.

Your organization in the context of artificial intelligence.

The AI Breakdown is a daily podcast.

And video about the most important news and discussions in AI.

Go to breakdown.network for more information about.

Our YouTube, our Discord and our newsletter.

Hello friends, back with another long read.

Episode of the AI Breakdown.

This is in many ways a part two of last week. It is from the same author, Professor Ethan Malik, who I should shout out has an amazing blog@1 Useful Thing.org and who has a new book coming out which we will of course share extensively here. But this piece is all about how.

To rebuild your organization in the context of AI.

I think there's a lot of insightful things in here and I can't wait to talk about it after we read the piece. But let's turn it over to an AI version of myself created with 11 labs. Read Ethan's essay and then we will.

Come back and discuss I want to talk about the future of organizations, but to do that we need to start with their past. In fact, I want to start as far away from AI as possible with the New York and erie Railroad of 1855. Stick with me. I promise it will make sense in a paragraph or two. The railroad faced a huge new technological and organizational problem. How do we organize work across a huge geographic distance with a huge number of employees, all while maintaining centralized control and planning? Using the technology of the time, the Telegraph executive Daniel McCallum came up with a solution. The world's first organizational chart. The chart, long lost before being rediscovered by Kaitlin Rosenthal, is a thing of beauty. Drawn as a plant with branches and leaves, it shows both geography each rail line and station are indicated, and organizational structure. Each employee is indicated down to leaves for each wiper or engine man. If you remove those gorgeous touches, replacing the organic forms with lines and boxes and flipping it on its head, you get the modern organizational chart. Remarkably unchanged for a century and a half. Each new wave of technology ushered in a new wave of organizational innovation. Henry Ford took advantage of advances in mechanical clocks and standardized parts to introduce assembly lines. Agile development was created in 2001, taking advantage of new ways of working with software and communicating via the Internet in order to introduce a new method for building products. All of these methods are built on human capabilities and limitations. That is why they have persisted so long. We still have organizational charts and assembly lines. Human attention remains finite, our emotions are still important, and workers still need bathroom breaks. The technology changes, but workers and managers are just people and the only way to add more intelligence to a project was to add people or make them work more efficiently, but this is no longer true. Anyone can add intelligence of a sort to a project by including an AI, and every evidence is that they are already doing so, they just aren't telling their bosses about it. A new survey found that over half of people using AI at work are doing so without approval, and 64% have passed off AI work as their own. This sort of shadow AI use is possible as LLMs are uniquely suited to handling organizational roles. They work at a human scale, they can read documents and write emails and adapt to context and assist with projects without requiring users to have specialized training or complex custom built software. While large scale corporate installations of LLMs may add some advantages like integration with a company's data, though I wonder how much value this adds. Anyone with access to GPT4 can just start having AI do work for them and they are clearly doing just that. What does it mean for organizations when we acknowledge that this is happening? We have the same challenge Daniel McCallum had 150 years ago, how to rebuild an organization around a fundamental shift in the way work is done, organized and communicated. I don't have the answers to how to do this yet, nobody does. But I can give you a preview of what it might look like Section Rebuilding a Process I help lead Wharton Interactive, a small internal software startup inside of Wharton devoted to transforming education through AI powered simulations. Unsurprisingly, we embraced the power of LLMs early on because we have been careful about building an organization with a culture of exploration. We do not have a secret cyborg problem and everyone has been very willing to share their uses with the rest of the team. So I know that our customer support team uses AI to generate on the fly documentation both in our internal wiki and for customers. Our CTO taught the AI to generate scripts in the custom programming language. We use a modified version of Ink, a language for interactive games. We use it to add placeholder graphics, to code, to ideate, to translate emails for international support, to help update our HTML and our websites, to write marketing material, to help break down complex documentation into simple steps, and much more. We have effectively added multiple people to our small team and the total compensation of these virtual team members is less than $100 a month in ChatGPT plus subscriptions and API costs. But in many ways this is just the start, because what we are starting to think about is how to completely change processes, how to cut down the organizational tree and regrow it. Doing so will involve changing a lot about how we are used to working. Take for example, the process we use when designing a new feature for our core teaching platform, like a screen that gives feedback on game progress for our entrepreneurship game. Since nobody has built the kinds of complex educational games we are developing, we have to do a lot of fundamental thinking. How do we display scores for many different learning objectives? How do we keep a feeling of experimentation when people are being graded on their results? How do we translate abstract game decisions into points? Designing a feature is a complicated and iterative process. This process involves multiple meetings and lots of time and energy. But how could we redesign this to incorporate AI as not just a tool, but also as an intelligence that can add to the process, not just automate it? Well, one thing that AI is quite good at doing is providing feedback. We know from research that you can get reasonably good simulated feedback from AI Personas. Not as accurate as a real person, of course, but good enough for an interim step. So let's give our testers a chance to focus on more important tasks and have the AI do a first pass at user feedback. I pasted in the screenshot you saw above and wrote you are an first year MBA student playing the entrepreneurship game created by Wharton Interactive. This is the grading screen you see part way through the game. Give me your reactions and ways to improve it given your perspective. Do it in character. Then I asked for the same from a high school perspective. Not too bad as a way of getting some initial reactions. What else can we change in our process? Let's move on to that first one hour meeting where we go over all the external and internal feedback as a group. Now meetings are important ways to achieve consensus and generate ideas, but pretty bad places to gather and collate information. What if we can reduce that meeting down from an hour by having the AI do the synthesis for us? Everyone can just use an AI voice transcription service to provide their feedback. I simulated elaborate feedback from team members Alice, Bill and Carol and asked GPT4 to compile all of the results of proposed changes in a table. Now the project lead can review this document. The AI still makes mistakes and modify it, creating an agenda for the shortened meeting, but the AI can go further. I asked it to create sample HTML pages for illustrating possible changes, just so these would be easier to visualize our options and the meeting itself can focus on building, not just planning. Instead of a long meeting compiling information, we can use one of a large number of free tools that use GPT4 to create HTML prototypes on the fly from screenshots and drawings. Here I use the free screenshot to code. We aren't just meeting, we are instantly able to ask for changes and see a prototype of the results. Even without coding experience. Make it one column, add icons, make it look more futuristic, etc. And these are just off the shelf projects built with GPT4. Imagine what the AI models in coming months will do during this entire process. The AI is of course recording the meeting and giving us takeaways and do to DOS at the end. This is a feature already included in Microsoft Teams Copilot and will I am sure be coming to other conference software soon after the meeting. Our developer can not only ask the AI about points raised in the meeting, but they also get a working prototype they can use to build from. And of course they are getting AI assistance in actually implementing the prototype, adding more speed. So even with today's tools we can radically change our process. Theoretical discussions become practical, drudge work is removed, and even more importantly, hours of meetings are eliminated and the remaining meetings are more impactful and useful. Process that used to take a week can be reduced to a day or two. And this is not even the most imaginative version of this sort of future. We already can see a world where autonomous AI agents start with a concept and go all the way to code and deployment with minimal human intervention. This is in fact a stated goal of OpenAI's next phase of product development. It is likely that entire tasks can be outsourced largely to these agents, with humans acting as supervisors. Section how to Rebuild Organizations Even without agents, AI is impacting organizations and managers need to start taking an active role in shaping what that looks like. Like everything else associated with AI, there is no central authority that can tell you the best ways to use AI. Every organization will need to figure it out for themselves. I would like to propose a few principles, however. First, let teams develop their own methods. Given that AIs perform more like people than software. Even though they are software, they are often best managed as additional team members rather than external IT solutions imposed by management. Teams will need to figure out their own ways to use AI through ethical experimentation, and then we'll need a way of sharing those methods with each other and with organizational leadership. Incentives and culture will need to be aligned to make this happen, and guidelines will need to be much clearer for employees to feel free to experiment. Second, build for the oncoming future. Everything I have shown you is already possible today using GPT4. But if we learned one thing from the OpenAI leadership drama, it is clear that more advanced models are coming and Coming fast. Organizational change takes time, so those adapting processes to AI should be considering future versions of AI rather than just building for the models of today. Third, you don't have time. If the sort of efficiency gains we are seeing from early AI experiments continue, organizations that wait to experiment will fall behind very quickly. If we truly can trim a weeks long process into a days long one, that is a profound change to how work gets done and you want your organization to get there first or at least be ready to adapt to the change. That means providing guidelines for short term experimentation rather than relying on top down solutions that take months or years to implement. I'm not sure who said it first, but there are only two ways to react to exponential change. Too early or too late. Today's AIs are flawed and limited in many ways. While that restricts what AI can do, the capabilities of AI are increasing exponentially both in terms of the models themselves and the tools these models can use. It might seem too early to consider changing an organization to accommodate AI, but I think that there is a strong possibility that it will quickly become too late.

All right, back to non AI.

NLW here.

This question of how organizations are going.

To change in the face of AI.

Is a really interesting one to me.

Something that I've observed is that the.

Forces for organizational change are happening in two directions. There is on the one hand, bottom up pressure. That bottom up pressure is coming from the fact that individual employees are simply finding tools that are actually useful to them and just using them until they're told not to.

Could be ChatGPT, it could be midjourney.

It could be something else that's custom, purpose built for their particular role or industry. And once they find something that works, it tends to replace whatever it replaces entirely. As in, there's no thought of ever.

Going back to doing it the old way. Once that happens, those folks are tending to share it with their colleagues and.

Their friends at work who they most enjoy. All of a sudden you have broad based bottoms up adoption that wasn't told to do that by a boss, but.

It'S still absolutely happening.

The flip side however, is that of course there are organizational mandates and basically everyone in a leadership position at any organization right now is being asked by the people one step above them what their AI strategy is, how they're figuring out how to incorporate these things into their workflows. That goes all the way up to.

CEOs who are being pressured by their.

Boards to figure out what their AI strategy is. I don't know that I've ever seen such a bottoms up plus top down sort of ascension of a new technology and I think it's going to have really dramatic impacts on how this all plays out. I think one of the most notable pieces of advice which I highly agree with from the essay that we just read is this idea of letting individual teams have at least some agency over how they implement these systems. I think in general bottoms up change is likely to be more sustainable because it's coming from insights from people who are actually doing different types of jobs. But that's particularly the case when it comes to AI where although the technologies are extremely transformative and disruptive, it is going to take some amount of experimentation to figure out what really works and what's really useful. Anyway, great stuff, another really thought provoking piece, but that for now is going.

To do it for the AI breakdown.

Appreciate you listening as always and until next time peace.