The Shortcut Excel AI for FP&A Teams to Test Overhyped Modelling Promises with Giles

Foreign. The MOD Squad featuring Ian Schnorr, Executive director of Financial Modeling Institute. Giles Mail, humble MVP and co founder of Full Stack Modeler and Paul Barnhurst, the FP and a guy.

We're getting to a dangerous phase where the outputs are really looking good in lots of places, which I think is a fantastic step forward. I think this is an interesting one because this tool and the founder Nico, I would say quite deliberately hyped up.

Marketing than any other tool I do find interesting. The first prompt you read right here is build me a three straight model template for my company.

I've never seen this in my life. It's reversed the formatting, new chat context.

Remaining is your memory. I do like that it tells you what context is remaining. Because you run out of context, you need to start a new chat.

It can solve the Excel and financial modeling World cup cases 10 times faster than human champions. That's a big broad statement.

At the top they claim to have thousands of customers.

Big claims which we going to have to unpick. So foreign.

To another episode of the Financial Modeler's Corner featuring two of the founding members of the MOD Squad, one of our illustrious members is on a flight back from London. Inshore will not be able to join us, but I have here with me my trusty co pilot, Giles. Mel. Why don't we start by having you introduce yourself real quick, Giles?

Sure. Hi Paul and hello Ian, if you're watching, my name is Jaz Mail, I'm co founder of Full Stack Modeler. Do a whole bunch of Excel and financial modeling training and yeah, I am part of this gang going around testing all of the AI tools and now I think probably at some stage LLMs and things like Microsoft Agent. Really enjoying the series so far. I don't know about you, I feel like I'm learning a huge amount as I go along with this. I'm sure there's a lot more to uncover and looking forward to testing Shortcut today.

I'm definitely learning a lot as well. And one realizing frankly how beneficial they can be when used. Right?

Yeah.

And also how scary they can be when used incorrectly. It's like I said before, it's a magnifier if you know what you're doing, great. If you don't, please don't use it.

Yeah, and I think we've said before, you know, I have said certainly in a few places we're getting to a dangerous phase where the outputs are really looking good in lots of places, which I think is a fantastic step forward. But if you don't know what you're looking at and you don't know how to review what it is that's been built. That's probably the most dangerous time. It's only going to get better from here on in. So this is, I reckon this is the most dangerous moment in Excel Financial modeling tool lifetime.

I agree. They're going to be a lot better in six months.

Yes.

Excel agents going to be better and the tools that survive are going to be better because they are only going to survive if they get better.

Yeah, right, Absolutely.

I mean, think of where AI was three years ago. So before we jump into this episode, I'll do a quick just kind of couple minute recap of where we're at. If this is the first episode, you're coming in at a little bit about our co host who's not with us in Schnorr. He's the head of the Financial Modeling Institute and he's usually here with us each week, but he's been in London this last week. You got to hang out with him some there. Giles, anything you want to share from that experience?

Yeah, it was great. So the FMI and Ian and Amy ran a kind of networking members session in London. So I think there must have been 50 or 60 people there.

Oh, fabulous.

Two MFM. So I was there. Jeff Robinson was there as well. Ian did a great speech in this bar that we were at, which was great. And I think it was just a really nice showcase of the community that FMI have kind of started to build globally and it was certainly very strong in London.

Awesome. Well, you know that that's great. If anyone doesn't know me, I didn't technically introduce myself at the beginning, but I'm the FPA guy, Paul Barnhurst. I've been hosting this podcast for a couple years now, so hopefully you know who I am. If you don't, you recognize the beard. There we go. That's all I ask. Kind of like with Giles, you recognize that sometimes he wears a fur coat and he's humble. Yeah, we both go for brands. All right, so quick recap. We're in series, I think episode six or seven now. I think this is seven. We've tested several tools. We've looked at Excel Agent, we've looked at Rosie AI, which is shut down. Shout out to Dennis. Love the work he did there. I think. Just a moment. He was one of the very first to two years ago really start on this journey and I think he helped push things along a lot. So good. Shout out to him for all the hard work he did with Rosie, and we're sorry it didn't work out for him. Others we've tested, tested Trace Light, we've tested Tab AI and we've tested Excel Agent. And today we have on the list. Why don't you tell our audience what. What they're going to win today, what our testing is, Kyle?

What are they going to win? I don't know what they're going to win, but we're going to test Shortcut. So I think for reasons that we. We definitely should go into, I think we have to be open with the audience. I think this is an interesting one because this tool and the founder, Nico, got more hype through, I would say, quite deliberately hyped up marketing than any other tool. For me, it potentially started the ball rolling on a lot of the hype in our space. Big claims which we are going to have to unpick. So I'm expecting a lot from Shortcut. And again, as we have always said, like, I want good tools on the market. So if Shortcut lives up to the claims, it's going to be really impressive.

Yeah, exciting. I mean, they definitely did. I think when we show the web page, many of you will probably have seen the one video that was hype. We might run that. It's only a minute long. Then I show the webpage here in a minute and we run through it. They've done some great things. I've had Nico on my podcast. They're clearly working very hard. They've clearly believed they have the best tool out there. They've shared that many times. They've definitely talked a lot of hype. So it'll be exciting to test it. Unfortunately, as we go through this, many of the tools responded to us, not all of them. When we sent out surveys to try to get people to participate, Shortcut was one we did not hear from, so we had to sign up ourselves for their free trial. We'll talk a little bit about that here in a minute. And Giles was smiling because you're a.

Little bit nervous, Paul.

I am a little bit nervous. We'll explain why here in a moment, but why don't we jump into their website and kind of walk through that like we've done with all the others, what we like, what we don't. This one's definitely a little different. This is the first tool we've tested that has its own spreadsheet agent and then added an Excel agent. And at first that Excel agent was only available for max accounts, and then it's so many credits and they've, you know, kind of changed that as they've gone. We've seen a lot of changes in a few months. I think they've been around, which is common for a startup. So let me go ahead and share their screen and let's run through it. So why don't I give you first shots just looking at it right now. Anything jump out to you?

Yes. I mean so this is why I'm saying as much as, you know, I have personal opinions on the approach that's taken just from a professional, neutral perspective. They have set the bar themselves. The world's best xlai. So that's. I guess my comment is that's what I'm expecting.

Yep. And you know, I think it's trusted by thousands of paying users at top companies. Great. So they're growing. You know, some of the others have mentioned similar type things I do find interesting. The first prompt you read right here is build me a three statement model template for my company. So build me a template to use. When's the last time you used a template to build your three statement models?

Well, I mean I, I've actually got, I've just because I used to consult 10 years ago, I do have templates all over the place. Interesting one to get an AI to build it. I can see a world where that is useful when it's reliable because I think a lot of professional modelers will tend to work off templates of various sorts. Interesting. Yeah, it is.

I've never been a big. I mean I definitely think there's places for templates but I find especially fpa every company revenue things are so different. I was always just building, kind of really starting from scratch.

Well, I also just think if you are a professional modeler, whether you're a one man or woman band or you're part of a big modeling team at Operis or whatever Fors, Mazars, F1, F9, all the big names. I mean you're already gonna have templates.

So again I always point there's definitely a template level. So Yeah, I agree.

But, but they, they might be looking. Those big companies might be looking at tools like this and I'm sure part of their thinking is that okay, well can they help us do this better somehow? And, and we don't know the answer to that yet.

Yeah, well, we know, I mean in has told us, you know, in some of his travels just recently one of the big firms he met with, you know, they're, they're doing a bake off with looking at Excel Agent and Shortcut for using in their firm. They they still think the tools are not quite there. They have a similar opinion to us on that. Doesn't mean they may not select one to use and get benefit. But I think it's like what everybody says. Vibe coding at first just wasn't there. Now people are really starting to feel like it's much more there. But you know, Vibe coding has been going on for what, 18 months now.

Word of the year, apparently.

Yeah.

Word of the year. That. That nearly made me fall off my chair. Good Lord.

Well, what other dictionary said the word of the year was this phrase 6, 7, which I don't know if you even heard it. It's been popular by kids in the US and nobody really even knows what it means. Sometimes they'll say it to mean I love you. Sometimes it's just a nonsense word. It's really weird. My daughter doesn't do it at all, but she's that age. Got in junior high, one of the dictionaries labeled six, seven. Okay. It's two numbers as the word of the year. It's not even a word.

But anyway, I think we're old. I think we're just old.

100%. I felt old there. There's no question there. I'm going to enlarge the screen a little bit. So here's what we get. Shortcut turns hours of Excel work into minutes. You know, then we have their video running. And then I think this is interesting, the accounting use case. And maybe we'll just run through a few of these. Take my aging accounts receivable data and show me days outstanding for my customer. All right, fine. So that's an example. Pe diligence this deal for me by performing a customer concentration analysis. All right? You know, and then they keep going. And we won't run through all of them, but you know, take my bank statements attached so it looks like you can. You can attach files, which I do like not every one of them had that they are using a Mac, so we have to end the episode.

No, I'm just kidding. A third party tool that's not in Excel on a Mac.

All righty. And then finance and operations. So there's that. Let's kind of keep going down everything you love about shortcut. Excel Native works with your existing macros, keyboard shortcuts, large files and more use. Shortcut is an Excel plugin. So what I think's interesting is how quickly they've kind of. Even though they have their own spreadsheet they've realized we have to do this in Excel. Would you know, if you didn't already know before, that its own spreadsheet in addition to a plugin?

No. And it's one of the things that I kind of got a little bit frustrated about with some of the early videos. I don't think it was obvious that it wasn't originally in Excel. And I would just say this again from a personal perspective. I don't want to be using a spreadsheet tool that isn't Excel. I don't want to use Google Sheets. I'm not interested in using something else that looks like Excel. Like for me, if I'm going to use an add in for my spreadsheets, it's going to be Excel. But other people may be.

I actually kind of find it fun to test the different ones and see where they're good. I haven't gotten enough to really start using them just because of that switching cost.

Yeah.

Even though spreadsheets are pretty similar because I've seen some cool things for others. So I like to see them and test them. I think it's kind of fun when they do it, but I still do all my work in Excel.

Is this, is this the main video below that I see? Is this the original?

This is. So let me make sure I have sound turned on here. Let's, let's see if there's anything else below that. Then we'll run this video because this is really, I think it, it is germane to this whole conversation because it drove a lot of the hype. I know you called him, called him out with a little bit of concern on it. There were several conversations. So here's again the claims. Let's kind of run through this. The most accurate Excel agent in the world. They show their benchmarking, beating copilot and Excel. Now what's interesting in this benchmark and the others haven't chose to participate, Cabs isn't here, Trace Light isn't here. You know, and Cabs has many different models and all these other tools there's you know, probably 20 we could list. So it'd be really interesting if all of them participated to see if that holds true. Maybe it does and great if it does. But it would be interesting to see exactly that.

I think great if it does. They're just enormously bold and black and white claims the most accurate exile agent in the world. So again, going into this, I can't be as generous as I think we're always trying to be because they're not coming at this neutrally like everyone else. They are saying they're the best out there. So that's what we want to see.

Right, so then you have, okay, auditability, Excel parity. So shortcut is immediately enabled to open and export Excel files. So here's where you really see. But without the manual work, it's still, it's almost hidden that there's a spreadsheet here. I would like it much clearer of what they're offering is. I think there's some confusion. That's. That's my take here. And then, you know, speed. So nothing surprising there. Again, the industry leader in gold standard securing the future of finance. No big shock here. They have all the standard security that any, any tool that wants to work in the enterprise space is going to have to have, you know, and then media, the YouTube video, AI powered spreadsheet demo.

There's been a lot of this, so. And again, this drove me nuts because it was getting reposted all over LinkedIn. I don't know whether people have, you know, been incentivized to say these things on their behalf. Possibly, possibly not. But we had another round of Excel's dead shortcuts here and that stuff really annoys me.

Right. I mean, you can see it right now is Shortcut, the new Excel. Rest in peace, Excel.

It's clickbait, isn't it?

It's classic visual and wording AI, Excel agent at the top. They claim to have thousands of customers. Excel has 700 million. So Excel's not dead, but like, genuinely.

If they've got thousands of paying customers and you're on the hook for $14,000.

Yeah, we'll get there in a second. Wild, big reveal.

Can we watch the video? Because I. I'm hoping if it's the original video, we could. I think it's important. It is.

Let me make sure. I'm going to remove and reshare, because I don't think I turned on sound. So give me one second here to stop my screen share reshare. Bear with us, everybody. Okay, I did have sound on, so let's go ahead and watch this video. All right, so this video came out, what, maybe three months ago now? Roughly three, four months ago, maybe a bit more.

I can't remember exactly, but it's not been that long.

So what were your. I know you had very strong feelings on this video. Like this, for example, you felt like they didn't make it clear that they were using their own spreadsheet. I know that was one frustration for you, right?

So what I'll do, There's one or two statements that I don't like. I'll just focus on one and I might just let it. I'll stop talking just so everyone can hear it.

Okay?

Hey, I'm Nico from Fundamental and today we're launching an early preview of Shortcut, a superhuman Excel and spreadsheet agent. Shortcut's pretty good at Excel. In fact, it can solve the Excel and financial modeling World cup championship cases 10 times faster than the human champions. Let's look at a couple examples. You'll notice Shortcut looks pretty familiar. It has near perfect feature parity with Excel. You can open up existing Excels and Word from there, or you can export them. And of course you can run formulas. But you can also one shot most of your work and come back when it's done. Here is Shortcut solving one of the hardest problems in all of Excel, the financial modeling World cup case that takes about an hour. I attach multiple PDFs and I ask it to solve it using the existing model and to make a new sheet with the answers. Now it actually uses the existing model the way you're supposed to and using real Excel formulas. So it fills out the net revenues. It then goes and starts to tackle costs and fills out the rest of the income statement. Then it starts tackling the balance sheet and it realizes that the PP and E line item is messed up and it just recursively solves its own mistakes. So it fixes the ppe, fills out the rest of the balance sheet and then it proceeds to the cash flow statement. Then it makes a new sheet for the answers. Shortcut completed this case in less than 10 minutes and in a single shot. Shortcut is also very strong at building complicated models from scratch. Here I asked it to build a multitab pro forma cap table for a Post Series A company and it did this in a single shot in less than 10 minutes. Something that takes professional lawyers up to a full day to get done correctly. Shortcut can clean, edit and analyze data way faster than humans can. Here I've added a 5000 row CSV of all of the companies that have ever been through Y Combinator and I asked it just for some deep insights. It charted it and it built dashboards that explained the data to me. And here it turns out the majority of companies are still active. They are B2B, but the consumer has a higher success rate. Until now, the 2 billion white collar workers using Excel haven't really felt the wave of AI that's coming shortcut can already do 80% of human work on Excel, and it's only getting better. Our early preview is live now. Comment for an invite code and I'll give you access.

There's a lot I didn't like about this. I didn't like the classic LinkedIn tactics of, like, you got to comment a thing in a. In the comments to get a link to whatever. There's some big statements in there. So it can already do 80% of the work that's done in Excel. The big one for me, partly just because, you know, I'm involved with the esports stuff. It can solve the Excel and financial modeling World cup cases 10 times faster than human champions. That's a big, broad statement, and I'm guessing they didn't test it on all of the cases. Solving some of the esports cases can vary on difficulty, so we will test it on what I would call an easy and a sort of intermediate case. So it should, you know, genuinely, it should get that 100% correct within a couple of minutes. Financial modeling cases are hard, so I don't believe it is solving the most complex financial modeling World cup cases and the hardest questions 10 times faster than the best humans. I'm sure we will get there eventually, but if it's doing that now reliably, everyone should be using shortcut.

All right, so we've watched the video, we've got through that. Let's go back. And I want to show just one other thing here, so I'm going to bring back up my screen. So let me just put it back on since you were presenting before we get into testing. So we know we've been going a little while, but this is all important, so bear with us. So the first thing I think is interesting is right, you can, you can test it two ways. We're going to test it Excel today, because that's what we prefer. But we want to show you it also has its own spreadsheet, you know, and so we're going to see a few things here with its own spreadsheet. I'm going to make, again, make this a little larger so we can kind of see it a little bit better. Has its own prompt library. Always like that. You can save your prompts. I think that's a nice feature. You know, you can put your rules and instructions, your AI preferences. Again, others have that. So I'm not seeing anything, you know, groundbreaking here. You know, new chat context remaining is your memory. I do like that it tells you what context is remaining because you Run out of context. You need to start a new chat. That's something that I think is really nice to have. You know they have their Pro and Max version. We're using the Max they have. Hey, do you want speed or do you want power in an answer? So they give you that. But they're still selecting behind the scenes what they're doing, which I prefer. So I like that, you know, similar to the others they have. Hey, do you want it to perform the action or do you want it to ask questions without making changes to your spreadsheet Again, I think that's an important feature. So you know they have their own model guide. Building a model. I'm going to stop it there. I don't know exactly what it means but we'll come back to that later. But you, you can click on a build model guide and I think it helps walk you through things. The one thing I want to show, if you click on account here you have, you know, several options. We got the Max Unlimited. We signed up for the free seven day trial. We'll show that here in a second. We got the tutorial Privacy Blog. They have a community, their support settings, subscription, etc. So what we had to do and that's not the image I wanted. Let me pull up my image. Why do I not see it? Oh, I say I think I saved it. So let me just pull. Give me one second here, we'll pull it up. I'm going to pause for one second. We'll be right back. All right, we're back. Giles, anything jump out to you from that screen and then I'll explain it.

Yeah, just I hope you've been saving. Saving hard. Paul.

So shortcut offers a 14 day free trial for teams not their pro or Max requires a credit card. If you don't cancel in time, you're on the hook. I did three members for a year so the cost is almost $5,000 per member. Was that come out to 4800. So 400amonth for each seat. So we're paying, you're paying 1200amonth here. And so I had to put in my credit card. You can see that information's hidden outside of, you know, my bank there. But yeah, I told Giles I will be canceling at the end of this session before he gets off the the call to make sure I'm not on the hook for $14,400. So pricey.

Pricey for a lot of big companies if it can genuinely save the sways of time that is spent, you know Organizing data, tidying up, data processing things, then that might feel like one extra model.

Half a model a month if you're working in pe, if every analyst is giving you an extra half a model a month worth a lot more than $400 drop in the bucket.

Absolutely. But I guess for us having gone through this journey, it's just very. It's right at the top end of what we've seen.

It is. And it was a little more of a harder process, a little. A little clunkier than some of the others, to be fair. And so that kind of jumped out. But what we're going to do now, I think we'll start with Giles, is why don't we get into testing? That's what everybody's here for. They don't want to hear us rant forever. Really works.

You don't want to hear that.

Well, I don't want to hear you ran forever. So I assume nobody else does. How's that for an answer, Giles?

That's great. Do you want to put my screen up?

Yep. We're going to go ahead and throw Giles screen up here.

So I'm. I'm sticking to a shortcut on the web. I've uploaded the. The. The first.

All right, so we're trying the web version here first.

Yeah. Depending on time, maybe we'll try the desktop as well.

Well, we can do the first case, web. Do the second desktop, whatever.

Try that. Like, I. I assume it's the same.

Yeah, it's your. It's the same agent behind the scenes. So.

Okay, so hopefully everybody knows what this is now, but I'll do a quick recap. This is what we think of as sort of intro level, Excel esports case. So we've got seven levels of challenges that get harder and harder. First level we've seen is if I go up here, extract, you know, number of characters from a string. So we want to see something like the left function with the character choices and the word. What we're really looking for is like, functions getting the right answers, but hopefully getting it in the right way. But also it's really impressive, even for us, when we just see a tool understanding what the challenge is. Because the prompt is really just saying, look at this case tab. There's five bonus levels and seven main levels. Answer the questions.

And just to give context, no tool has got 100% on this tab. Last week tried everyone, got all seven right. Which others have done got three of the five bonus. Some of the others have got four. Four. But what was impressive is Tabs got really close on the color one. They made a slight mistake. They're the clo. So on the whole, they got the closest, even though they didn't have the highest score.

Yeah.

And so let's see how Shortcut does. So really, for Shortcut to be the best here, we would expect 100% bonuses and all seven levels. So we're gonna kick it off. Similar prompt we've used before to do everything. We're gonna go ahead and pause it here. We'll be back. We're gonna let it run for a minute. We're back. Solved Level one. What would you like to add, Giles?

No. Fine. Happy so far. So it's solved level one. It's used the left function. It's linked to the kind of driving cell. So I think even in one of the earlier tools, we're kind of not seeing it use the cells that we wanted. Level one done. We. The prompt said stop at level one. So what I'll do now is we will get it to proceed with the other levels. And it's probably worth pausing there because I'm going to guess it's going to take a few more minutes.

Yep. We'll probably be three, four minutes here. And we'll be back. All right, we're back. Shortcut ran for several minutes. It went through levels one through seven. One thing Giles and I noticed, you'll see here is it didn't answer the bonus questions all the other tools did. So we're going to prompt it to answer those while we go through what it did. So that's a little disappointing when you agree, Giles. All the others picked that up, but they didn't.

Yeah. I think it's gonna be a mixed bag. So let's ask it to do the bonuses.

And then how about you run us through how it did, kind of what you. What you thought of its performance?

Yeah. Do you want to do that now or.

Yeah, yeah, let's just let it run. Why don't we go through the levels 1 through 7 now while it's working on the bonus questions, if we can.

Okay. So good and bad. I think it's got the. I don't understand what this overlay is, but again, that's just. I'm not familiar with the tool in detail. So level two is a great example. Right. Level one, it got. Right. Left function perfect. Level two, it has. Oh, God, it keeps jumping.

Yeah. It's going to move around a little bit on you, so we'll do the best.

And here, level two, it's got the right answers here. Okay. You had to split the text string with numbers and sum the two largest. But it's done that initially. Okay. It's going to annoy me jumping around. But anyway, this is the formula. So it's actually kind of split each of the numbers out here. But look at what it's doing.

Why don't. Why don't we pause and come back. We'll let the bonus questions finish so you don't have to see the screen bouncing back and forth.

Yeah, sure. Let's do that.

Okay, give us. We'll be back in one minute or so. All right, we're back. We had a prompted on the bonuses but it got all of them right. But one and it was one off. Made a reasonable assumption of why it's off. I think in that it counted the color pink in the legend plus the map. Right.

Yeah. I think we can forgive it that. I mean that, that because we wanted to count the number of pink cells in the. The grid here, it's included this. So it's one off I think for me. Okay. It got it wrong by one, but it's quite understandable why it would get that wrong.

So I look formula. That was correct. It had the right logic. There was just a misunderstanding which is reasonable. Now a hard coded it so we don't know how it did it.

We. We don't know which. Which is not perfect. But it's. It's very close, I think.

Very good job. I. I give them. Yeah.

So here's where I'm at with this in terms of the answers. I think it's got all of the levels right, which is great. But I have massive issues with the way it's done it. So this is going to be a classic thing where if the challenge was just get the right answer, I don't care how you build the model. Great. It's got full marks. This was the one where you've got to pick the top two numbers from this text string and add them up. So I thought it had done a dynamic range here, but it's actually individually built a calculation that is adding splitting.

Each of them out.

If you look at this, I'm assuming if I keep going to the right.

Here, each one gets bigger.

Yeah. So let me. And I. I've also noticed my Excel spreadsheet is now seriously slow. So I might. Let's just go back one. I just want to show you this. So here is the formula that it created for. I don't know, I can't even bring that bar down.

It looks like that maybe, but that. That burns my eyes. Could you stop?

So there's getting the right answer and then there's building something like that, which to me is absolutely horrific.

Agree. That is a terrible method to build it.

So it's then doing some weird things. So the next level was pull out the column number corresponding to the reference here. So if you take this, we've got F10. F is the sixth column. It's done the right approach in our eyes column and indirect, but it's made it a range which you don't need to do. So I don't know why it's done that. Got the right answer though, which is good. If you go down here. Good work. It's done. Len minus len substitute. It's using the cells, which is what we complained about with some of the others. It was sort of not linking. So I think that's good. This is horrendously overcomplicated, but it is eventually getting to the right answer. So tick in the box and then indirect map is great. And the final level where you've got to go to the map and offset by one up or down.

Good works. Interesting. They did the if statement first. Most the others you see the offset and then the if statement. But irrelevant. It's right.

Yeah, I'm okay with that. So I think.

Okay with that as well.

I think it's done a good job. But you would not in a million years accept that formula in a professional model. No chance.

Sure. Definitely concerned with that. All right, why don't we move on to the next one? In the interest of time we've been going a while, we're going to give it the harder case. Why don't we do that in Excel itself versus its web version? You good with that?

Yeah, I think I am. So I have to figure out how exactly I do it, but bear with me one second.

All right, we're going to pause this for one second while Giles goes to remedial shortcut school. We'll be right back. We're back. We've moved on to the what we'll call an intermediate case, one that was used for the ExCel UK Championships in London, right?

Yep. Harder case. Just like before. I'm going to give it a pretty high level prompt. Analyze the case tab, answer the questions. I'll hit go and let's see what it does. We probably will have to pause for this.

We are back. We're going to see how shortcut did here with this intermediate case. So, Giles, why don't you take this one away.

Yeah, sure. So if you ignore knowing anything about the claims made, I'd say it's done really well. So it's got five out of seven levels right. Got level one wrong, got level two right. I would say that the formulas it's using here. Okay. Nothing horrendous.

I think there's no. The better formula shorter we've seen so far.

I feel like I need to look into that one myself. What. How is that doing that so quickly that. So there's quite a lot of. That is fascinating to me. I need to figure out match.

So it's doing a max of the range and matching the max.

I'll have to look at that because there's quite a lot of layers to what goes on in this where it's kind of changing the scores. I'm just wondering whether it's actually changed the underlying scores here because it doesn't look like there's much of a logic going on in these. Oh, oh, hang on a minute. Oh.

So it used different logic for each one. It's not a drag and drop.

So what was confusing me was the kind of emotions here. Change the scores here and I couldn't see how it was doing what is quite complex work. The answer is it's doing it all manually one by one. So again, this is something that Ian calls out. That's fine. It's got look times two. But these twos are hard coded. It's fine but you couldn't replicate that. So it's good. It's a hard level. It got the right answer but it didn't do it in a very good way. Level five, I mean, okay, it's another hard level. It's got the right answer. That's pretty crazily horrendous but it's also a hard answer and it's chosen and.

It hard coded again like round 200 divide them in of the absolute value. So you got that. That round right up front.

But I think like it's.

It got it right credit.

It's impressive that it got that right level. Level six, it got. It got three right but then everything else wrong. And this is hard coded so we don't know what the logic.

That's always frustrating. But again we didn't specific. We did ask it for formulas but it decided to hard code so.

And level seven it got right so. And it got some of the bonuses wrong here. Two of the bonuses are wrong. It did find my favorite drink. So shortcut gets massive kudos.

That's 100 bonus points. To shortcut for getting that huge bonus points.

So my position is, had they not made claims like it can solve Excel and FMWC cases 10 times faster than the human champions, I would be stood here and the only thing I would say is that's really impressive. Probably one of the best we've seen. But because they've made that claim, I think they've failed against their claim. That's not 10 times better or faster than the world champions.

Sure, they fail to live up to some of the hype, but it's a solid tool.

It's annoying, but that's what drives me nuts is I have an air of negativity about shortcut because of the hype and it's genuinely one of the better tools on the market that we've seen even compared to agent.

Let's keep going. In the interest of time, we're going to hold off on the trial balance one. We may come back to it. Why don't we go to some of the modeling cases? We'll come to my FPA last. Since you're already going. You're.

Let's pause because I have to switch over. But then we'll go into that for sure.

All righty. So should we pause here for a moment?

I think pause because I'll bring the files up and then we'll do.

Right, so we're going to pause. Let him bring up the files. We're going to do the modeling one next and then we'll go through some of the other. So we'll be back in a moment. We're back. We're going to start with letting it build a model, then we'll kind of go from there. We don't have INS prompts here with us today. So Giles has recreated roughly what he did. And what we're basically asking to do is if you know is this is one of the FMI cases for the AFM exam. Henderson Manufacturing, I can remember it's one of their practice models. Building it more than once, actually practicing for the test, going through it several times. So it's funny, every time I see it, I'm like, I remember that thing. But I'm not sure if that's a good or bad thing. But we'll leave that alone. So what we're going to do is he's basically asked it, given a lot of freeway. Hey, you have historical data. Build me a five year model. So walk us through the prompt. Let's go there and then we'll kick it off.

Yeah. So I remember it was simple for me and so build a five year forecast in the model starting from historical actuals provided, make reasonable assumptions, build share schedules for each area of the model and follow best practice. And for context, what we've seen so far is almost every tool has really struggled here. And then we saw Agent, Microsoft's Agent, and it did a very impressive job. Really bizarrely, Agent almost seemed like uniquely better in the financial modeling area. And the other tools that we've seen didn't do particularly well here. So if Shortcut can get to agents level, it will be doing really, really well.

Yeah. And so just so you know, we'll probably pause and be back in 10, 15 minutes. This is a long task. We'll fill you in if we think we need to along the way. But just remember we're letting it work. So why don't we kick off the prompt and see how this goes. All right, we're back and it's done work. So overall seems impressive. Definitely some issues, but we did get a workable model. Some tools we haven't even really got what I call workable model. We have something workable here. So kudos on that. There's some good layout things but why don't you walk us through it, Giles? It's a little bit of a mixed bag.

Yeah. So again, if I just start as if I'd seen or not heard or seen any of the hype, I think this has done one of the best jobs out there. This is, this is kind of in and around the same level as Agent. So I think presentation that is, you know, it's actually built a free statement 5 year annual forecast which is what we asked it to do. Things that I really like, which I don't even think Agent did was it's added like a separate assumptions tab and a supporting schedules tab. Like in terms of the way I model, that's more in line than Agent was.

Well, I really like it did all the color coding.

Color coding so that there is lots in here that I'm like, do you know what? That is a really good job. It's also wrong.

So that is wrong. So let's walk through some of that. Then we're going to give it a chance to fix itself like we've done with others. So why don't we walk. Why don't you walk us through the issues you see?

Well, I'll walk through everything because I'll go through the good and the bad. So in terms of. This is kind of like a very vertical, not a vertical. So a particular. There's bits of horizontal but you've got like a lot of the logic happening in the financial statements lines. I misspoke when I said vertical so not a lot of the schedule work does the calculation work? It's almost like a little bit of a mini schedule model. So you've got the growth rates being applied here for lots of these line items.

Yeah. Instead of having a schedule that it's linked to.

Yeah but to this point the income statement looks pretty good. Depreciation is coming through. It's making an interesting choice here where you're actually hard coding the assumptions for depreciation if you look at the PP&E schedule by the way kudos for having a PP&E schedule that looks nice and is right in the sense that you've got an opening balance capex depreciation which is just matched and then a closing balance. Cool. I assume that formula is right. Yeah so that looks good. Interest taxes it's making some high level assumptions on the split between current and deferred but again that's fine we asked it to make assumptions so down to net income really good. Stop.

Go back for one second. One thing I think is interesting go back to the net income line. So notice G H and I are all US dollar and then it took probably because your your computer settings is GBP and you'll notice it's now using pound currency which is not a big deal we could easily ask it to fix it but it's just interesting.

It is interesting but I think one of the other tools you know but.

I'm not going to hold that against them if that's their biggest problem they get a hundred it's not one of.

The other tools had the net income link for the operating cash flow up here so look it's produced a very well structured model Net income is coming down it's adding back depreciation you've got deferred yet so perfect deferred income taxes are being adjusted off and the operating cash flow Good then. So this is where I. Do you remember I said at the beginning like this is the most dangerous period at the moment I think that we'll ever experience in this space because this looks great and if you were to rely on the number you'd be in a lot of trouble because it's got the signage wrong on the capex spend so this is coming through as a positive cash increase because of capex.

Spend Isn't the sign wrong on other as well but it's all zero so.

It doesn't matter Possibly you've also got. So this is interesting. I thought this was just immediately.

Oh, you know what else I just noticed it didn't start with the right year in the model.

Yeah, interesting.

That should be 2025.

Yeah.

It linked it to the last year of actuals.

So that's. So this is a really weird one. And again, this isn't unique to shortcuts. Sometimes it's just like it has a bug in where the links are. This should have been pointing to the year before. Before and it was pointing two years before. I don't know why, but that happens. I'm sure that will get better with time. So the biggest issue for me is the capex is wrong. It's also, you know, it's quite unusual to see something like this where you've got. What was I going to show you? The revolvers being. I think that is wrong. You know, I think the signage is wrong on the revolver. That's a repayment of the revolver year on year and a cash balance of 10.

Yeah. Which they put a $10 plug hard code in the bank debt revolver. So there's clearly some issues there. So there's the capex issue.

The revolver in the cash doesn't look right to me and it doesn't matter. I mean, yeah. So if you're repaying the revolver balance off by these amounts, you wouldn't expect to see the revolver debt balance increase period by period. So I think the revolver's wrong and it doesn't balance. So the, the main. Let me just do it down here. So if you do assets minus liabilities and equity, assume this is. It is in millions. So it hasn't produced a balancing balance sheet. So agent produced a balancing balance sheet and with one prompt it got the revolver. It actually said, if you remember, I haven't done the revolver yet. I can add it. Do you want me to do this? And we said yes, and then it added it. So it. This shortcut's done well and it's not at the level that agent did because as far as we could see a.

Revolver plug to maintain a minimum 10 million cash balance. So why don't we ask it to flip the sign on the capex and let it run through the model. Then let's ask it to say, hey, it doesn't balance. Can you review and tell us why it doesn't balance and then we'll ask it to fix it if it comes back with a reasonable answer. Okay, so we're going to try both of those and see if they can fix them. Good job. But this reemphasis our point. Regardless of how good the model looks, you need to really know what you're doing.

Absolutely. I mean, it's only because, you know, we've done financial modeling before that you could go through this and go, hey, that's, that's right. That's not right. And this, this is why I think it's so interesting. I mean, shortcut will get better and better with time. So, you know, I'm sure it won't always be the case, but I think one of the other big claims was like, it can do the job that an analyst would do in four hours, in 20 minutes or something.

I think it said it's better than. Is already better than 80% of modelists or whatever. Yeah, I had some claims that.

So that might be the case if, if 80% of your model is a terrible. But if you imagine you were an investment manager and your junior analyst came to you and said, there you go, they'd be out the door.

Yeah, maybe if they were brand new first time, you'd train them, but it wouldn't be long before they'd be out the door.

So that's. Should we pause? We'll see if it can fix.

Yeah, let's pause, give it a minute to rework itself and see where it goes. All right, we're back. We asked it to fix two things. Giles asked to fix the capex, which showed the wrong sign, and we'll explain what was going on there. And we asked it to fix the balance sheet. It got the number closer. But there are two very concerning things here that I would call red flags whole. Great job. But let's, let's talk through the first one. Help us understand this negative number. Tell us what it did there, because this is bizarre.

This is one of the most insanely ridiculous things I've seen anything happen in Excel. So it is. If you look at this number, right. Capex is negative 1415. Sorry, let me bring it over here. This is the CapEx line, which I was looking at and saying, oh, they've got the sign wrong. That's clearly a logical error. And then we saw, as it was going through, it just said in the, in its own text, it said, no, it's all right, the four. I can't remember what it said, but it was like the. It's. We've just used parenthesis in the formatting. So I thought, that's weird. Actually, when you do look at this, you've got in the assumption line. It is a positive set of numbers for Capex and there is a negative sign at the start of this. So in theory that should be negative. If you look at the format, I swear to God I've never seen this in my life. It's reversed the formatting so that the.

Positive numbers have negative and the negative numbers are positive.

So I do like again, stepping back from my frustration of the hype really like top marks for doing well with the structure and everything. But when you think of where we're at and the claims being made not just by shortcut all over the place, that is deadly. Like, could you imagine an analyst, what would happen to an analyst if they just manually switched the formatting to show this? Now I could add another prompt and I could tell it, you've done this wrong. Don't do that. You are getting to the point where you're like, you have to really be careful and find all of these issues.

The biggest thing with that is not that it. It's not that it's not easy to fix. That's not the issue.

Yeah.

The issue is it's extremely hard to spot to find. That's what's going on. That they took a custom number formatting and reversed it.

Yeah.

Well, because I tell you, normal human as I've ever seen done in a model.

Yeah. Because I think most people. What would you do? Okay. You'd be look, I mean if you were. If you weren't very careful, you'd be looking at this and you'd probably, you know, maybe you'd remove the minus without checking anything else because now that looks right. But actually that's positive numbers because it's reversed the formatting.

That's actually wrong.

That's just so dangerous. It also. So it does look like it's trying to maintain a cash balance of $10 million. The revolver. What did it do with the revolver in the end? So the revolver drawdown is like 29. 7. That looks better. It's still. So it's. This was the other thing right. As we watched it. We both laughed. It still doesn't have a balancing balance sheet.

Might but read what it said. We have to read this because I think this is worth reading. Can you go to where it. So I would I. Can I have the fun on this one?

Please, Dan?

All right. The other LTA is correctly hard coded at 12. Given the complexity of tracking down a $30 constant offset which could be from rounding and net working capital calculation, tax calculations or any of number of places. Given that it represents only 0.26% of total assets. I'LL consider this acceptable for a financial model. Most financial models have small rounding differences. Let me provide a final summary. No.

Yeah, it's 1.3 million, which he hasn't spotted, so.

And that gets to their kind of confidence. Really interesting, though. Basically said, look, it's kind of like we as a human. It's two in the morning. You ever been there, Giles? They're like, screw it, I'm plugging it and I'm going to bed.

That's exactly what it's like.

Felt like it raised the white flag and said, I'm out. Tap me out.

Yeah. So I think, you know, we want to do your tests. In summary, it did better than most. I don't think it performed as well as Agent mode because Agent seemed to do more of the fundamentals. Right. On the fundamentals.

It did a better job of layout and color coding than Agent.

It did.

I'll take fundamentals over presentation.

But it also made one of the most ridiculous decisions I've. I've seen anywhere. That. That is just so illogical. I. I can't really put it into more words than that. Yeah, so. So again, lots of hype, two huge red flags.

One telling me a variance in your balance sheet is acceptable. It's one thing if you were adding in actuals and your cash didn't plug by, say, $1,000 on a million or whatever, and you put it in because you couldn't reconcile it as an unreconciled item. I've done that when updating to actuals. Yeah, I could live with that. Balance sheet, not balancing. No. You need to figure out why that I don't find acceptable. So. All right, let's jump into my case. We're going to pause here. I'm going to get set up. We'll be back in just a moment. All right, we're back. And I think in the interest of time, we're going to directly start with the deferred revenue, because I'm going to assume it's going to do a good job on the pvm. Nobody's missed that yet. And then if we have time, maybe we'll try the analysis one with your ledger, because I think that's a more interesting use case. So let's run through the deferred revenue and we'll just see how much time we have left, whether we can run one more or not. So I'm going to kick this off, but just as a reminder, this is prepaid revenue. You get 25,000 or say 24,000 for simple math. It's a two year contract. I need to recognize a thousand a month as I earn that. I'm asking it to build that schedule. I've given it a single prompt saying hey, I want you to include the following columns. I want you to put headers at the top. I want to make sure everything goes to zero. I want roughly a four year schedule. So let's go ahead and let it work and see how it does. All right. So we're going to go ahead and pause it here. Probably take four or five minutes then we'll come back. But we're going to go ahead and let it work. So it's already kicked off and started here. All right, we're back. It's just putting the final formatting touches on it. It's nearly done. Excellent. The schedule is working perfectly. Let me verify the overall structure. So let's walk through it while it does its last little tasks. Again we're in Excel here. Nice. What I do like I left the column and then you know the the first row outside of the title there and so there's a little more spacing. I I like that all the column widths look like the formatting looks right. That's nice. Some have flipped contract amount and put it over here. They put it here. Don't care Formula works. What we don't like is again it hard coded and it did the year minus year times 12 plus month minus month plus one works little more complex. Do a date diff or something else.

Divide it by every tool has consistently put hard coded numbers in from the for the dates.

Isn't it that it is the other thing you know again gets getting the totals right here. If we come all the way to the end so it summed it all and then it checked it it all comes to zero. Many others did an absolute balance and allowed an ABS and allowed it a rounding error. Some would do an okay and conditional formatting. I've seen I prefer those a little better than just a straight but again I'm not going to penalize them for that. I'm fine with that. We'll ask them to correct the formula and so I probably should change the prompt to say they should have made the formula dynamic and I'm guessing it would get it right. So not a not a huge issue but an annoyance. So starting with G3 please change all formulas to be dynamic and instead of hard coding the date set the dates equal to the date in the column headers in row two. I think that should work. See if it gets let's See if it did the dates right here. Ooh, these aren't dates that. It's not gonna work. Yeah, let's see if it figures that part out. So, again, that's another issue. That's why it did the. Is you gotta be very specific in the prompt. Right. If I rewrote that and prompted it differently now, I can fix it on this end. But little things. So I'd say not the best one I've seen here. One of them did do dynamic, but on par with the other.

No, it feels in and around where all of them have more or less.

Yeah, it feels about the same on this task. All of them have had little issues. Some have been a little better, some have been a little worse. Like sometimes they get the. The dates way wrong. And. But they've all pretty much done the task. And with minimal prompting, I can have a usable schedule. So I think that's the key takeaway. We'll see real here. So it did the date. Why is it doing 1 minus 8 ng 2?

Don't know.

That's kind of interesting.

That's in quotation marks as well. I. Yeah. I don't know.

So very. Again, this gets back to what we've said many times. The formulas are weird sometimes. If you know exactly what you want, be specific.

Oh, do you know, I think. Sorry, it's. It's making the date because. Because of exactly what you pointed out. The date, their text. So it's adding one to turn it into a concatenated set of characters. That's a date.

And what I would prefer to see because if you ever decided to go to weeks or any other schedule, is you really wanted to take end of month kind of, you know, it's taking that first day and saying, is it just outside of that? Which works.

Interesting that it's double. It's got the. Oh, no, sorry, I thought that was dollar signed on the column and the row. So it actually does have a dynamic in terms of, like the rows and the columns. It does work. It's just a bit of a. Bit of a weird way of doing it.

Yeah, I should have told it to fix the date. But fine, let's go ahead and move on. I think I'd like to do your analysis case if you're open to that. I think we have a few more minutes.

Yeah. Okay.

I want to see how it compares to tab AI because let's be honest, so far, you know, Shortcut's done a good job ignoring the hype. There are definitely some key concerns, but I really think that task after we were both very impressed with Tab AI. I'd really like to see what shortcut does pause.

I'll bring it up and then we'll come back. Yeah. So this was the sort of the challenge that as you said Tab AI did pretty well on. We have some trial balance data across a year. The kind of. Well, the only. The major interesting insight that you would hope it would pull out is that the. The net income kind of goes negative and then pops back up towards the end of the year. But really the ask is just analyze the data on the trial balance data tab and produce some sort of output summary with visuals and KPIs. So I will hit go and we'll see. And I think just before we probably pause for a second. I don't know if your head's in the same place as me, Paul. I think it's. It's done reasonably well on certainly like my initial Esports challenges didn't get it perfect. But if you step away from the claims, that's still really good. It makes some weird decisions with functions and formulas, but we've seen that with every single tool. And then financial modeling wise again, if I just say it without the hype, I think it did really well with the structure and I think we probably could have got there with a few more prompts like never say that it's okay to have a balance sheet that doesn't balance. Don't ever do that with formatting. You probably could have got there one.

Or two times if you put an instruction in. Don't use custom number formatting. Right. If we had put that in in the beginning because it has instructions. Problem solved.

Exactly. But then you have to layer in the claims which is, you know, it's better than. It's 10 times faster than the best financial modelers in the world. Which I mean that, that was nowhere near that. So it's a shame. But I still think Shortcut has done overall a good job.

Yeah, it hasn't lived up to its claims and we get it. There's marketing hype. We see a lot of that with AI. It's not just shortcuts at let's. Let's be fair there. But it is something we were measuring it against. So if you go against the claims, it's not where it claims to be, but it is very good right now. If I look at all of them, I, you know, I think agent is very. I think many of them are solid. My favorite so far. And it's because of the overall like if you, you know, this one has a two. But I think it's the overall way it's structured, all the different models that it does, the reasoning that has a nice dashboard, you can see the usage. The most complete product and I think it's competitive in whole against anyone else right now is Tab AI. But many of those are just UI things. Others can catch up. The reality is none of them are all that different. Some are really bad in certain areas. Some are very similar on tasks you could do if you're smart. I think with any of the tools we've tested so far, you could be more productive with certain parts of your job. Is that a fair statement?

Yeah, I think I'm. I mean, I have to say, like what it's producing now, it's. It's definitely got a good sense of style and formatting, which some of the tools have been a bit further down on. So I think Tab AI and what I'm seeing as we talk are my favorite in terms of they're creating things that are visually appealing, which is great. So that's a really good start. Yeah. There was a lot about Tab AI that I liked. There were bits about everything that I've liked. There were bits of Rosie that I liked.

I like some of the pipe on stuff that Trace Light did. I really like that. I like some of the other it's tasks and it's to do lists and I would love to be able. There are certain things I would take from every single tool if I was wanting the ideal tool. That's what I would like.

And you know, it's going to change so quickly. I mean, all of these tools are, I'm sure evolving every day and it might be that in a month's time they've completely shifted in terms of where they compare and Agent will be a completely different beast. Again, it is just fascinating.

And there's also price. Yeah, right.

Like there is.

From what I've seen for Agent, am I paying $5,000 for the year? No, I mean for shortcut, I would go with a different tool that I could get for 30amonth.

If, I mean, if you were paying 5,000 a year, you would expect close to perfection, I would think, which we've not seen. But again, this is really good.

This is really good right here. I don't know about numbers. Presentation is really good. Let's, let's be clear.

Presentation, that's the best. Even though it hasn't finished. I'm already. I would put this above what Tab AI did, albeit I don't know that.

I would because it's layering graphs on top of each other. If it doesn't fix that.

Oh, I think it may go down, scroll down.

See right now some of those. If it doesn't fix that, I would. That's a, that's a big red, red flag for me.

We'll give it a, we'll give it a bit more time. But I, I keep running because remember.

How long we ran tab AI for like 20 minutes and never quite finished. It was taking so long.

Okay, so, so that's a big negative for me. These are all hard coded numbers.

Yeah, that's a real problem.

That's. I mean, that, that, so tabe. I did it with links to the right places. These are hard coded numbers. So that instantly kind of made me, I want to.

I would send this back to my analyst and say, redo it all.

Absolutely.

I'm not even going to look at it. Right.

All of these numbers. If I move that over, I'll do, I'll do its job for it. These are all hard coded numbers.

Correct me if I'm wrong. You're the manager. Your analyst gives this to you. What are you going to say?

I'm going to say go and redo it. Again. You are not grasping the concept of what we do when we try to build tools where you can automate and rerun processes.

Everything needs to be auditable, flexible, you know, traceable. And so, yeah, we could probably ask it, but I don't know if those numbers are right. I have no idea.

Yeah, I mean that the net income looks fine, but it's hard coded. So it's. Again, it's, it's one of the shames of all this stuff. I guess at the moment it's really impressive and it's also fundamentally wrong.

But what it gets back to too is those are things you could get right with prompting. So with time and with prompting, you can get some really good stuff. We're not encouraging people not to use these tools. I think it's the opposite. Make sure you know what you're doing, make sure you're willing to check things and be patient and recognize that there may be times quicker to do it on your own and that they're just not. They don't live up to the hype. I think that's, at least for me, that's the message versus, hey, I'm massively disappointed because it did this or that. It's like, no. On the whole, I'm massively impressed.

Yeah, it's a really Good point. And actually, to be fair, I've just put the prompt in. So I appreciate we'll be wrapping up pretty quickly, but this is probably the headspace I would be in if I was really determined as a modeler to be using an AI tool. I just think you have to get this nonsense out of your head that you can click a button, grab a coffee, come back 10 minutes later, the work's done, send it off like it really is almost. You've got to spend as much time after your coffee, go and get a coffee, but come back and just be ready for the fact that you've then got to check absolutely every part of what's been built. Because the chances are there's going to be stuff you're going to have to fix or ask it to fix itself. Yep.

No, agreed. I think we're all on the same page. So we'll give this a couple minutes here and we're going to head toward wrapping up. So we still have several more episodes we're going to do. We have some testing, some guests we want to bring on some other exciting things. So we want you to stay with us. We want to give, you know, in fairness, we'll give a shout out to Shortcut. They've done some good work. Nico, good job. There's some definite. We hope you take the time to watch this episode. There's some things we'd love to see fixed, but so far it appears pretty good job. Let's let this finish. We'll give last thoughts once this rank and we're going to pause and just give it a few minutes to fix itself. And if it doesn't, we'll just come back and wrap up. We're back. We're going to go ahead and wrap up here in a moment. It finished the analysis. So, Giles, take us through it. Take us through the good, the bad. Give us your assessment here.

Yeah, I think it was doing a very good job presentationally. You're right, Paul. It was. It didn't leave the visuals very well kind of laid out. This is not ideal with stuff overlapping. Yeah, I'm sure we can do that in two minutes. Or we could ask it to fix. Has now turned the kind of major numbers at the top here into formulas and it's done that by adding this kind of calculation section here where it's doing sumifs on the raw data. Annoyingly, again, I don't know whether it's just all LLMs at the moment, but it's hard coding these dates. So rather than linking there it's hard coding one individually every sell, but pretty good. I mean, it's, it's, it's, it is.

Pretty good, I think. Looks pretty outside of the graphs, but it doesn't have near the depth of the analysis that Tabs did. Remember, it gave every product and gave a breakdown of all the expenses. And yes, there's some nice graphs here, but this feels surface to me. Presented really nice, but it's just not as deep as what we saw on the other tool. But it's better than most of them. I would probably say it's the second best one I've seen. I think I'd have to go back and look at all of them that's going off memory. So in fairness, maybe it's third, but it's one of the better we've seen. But I don't think it's the deepest analysis. I think it's more surface than some other stuff we've seen.

I probably agree. I think Tab AI probably did the best job overall. And then I think this. There was nothing else that jumped out to me from the other tools.

No, I don't think so. I mean, I think Tracelight did some good things, but they also had some fundamental flaws from what I remember with the EBITDA and some of that. So. All right, so as we wrap up again, I don't think anything's fundamentally changed for us in all of our testing here. I think our my statement, and then I'll let you give your statement. Shortcut. Did a good job, as I said before. Kudos. If we analyze it against the other tools, it's a solid tool. It definitely has areas. It's better. There's some things I'm impressed with. There were some clear red flags. It does not live up to the hype, which has always been a complaint of Giles and mine. But on the whole, solid testing, good job.

Yeah. I'm frustrated more than anything because I really want to support this tool the same way that I do the others. But I do find the overhype very annoying. I think it's led a precedent of others potentially hyping things up. So I have a bit of a personal bugbear with the approach. I understand that you have to do that for marketing, but if you just take the tool, I think it's done a pretty good job in some areas. It is not better than the best financial modelers out there in the world, categorically. And some of the mistakes. The mistakes were just shocking, but it's good. So I would probably still roughly Be in the area of. I think agent is is probably the best tool for me at the moment, bearing in mind it's on the web, which I don't like. And then I would say in some areas, shortcuts next. In some areas, I think Tab AI was probably next. There's bits like you said that I like of all of them. The pricing is really interesting because, you know, if we're comparing this versus tab AI at 30, $40 a month.

Yeah. But the Pro version, which probably could have done everything we did today, is four.

I guess that's what we don't know. Is it so it. So no.

The other ones are probably a couple hundred too. So in fairness, the pricing isn't all that different. But seeing the 14,000 for a free trial price tag is like, WTF?

I'm glad we've tested it. I'm glad, you know that we've kind of seen some really huge areas of potential in this one. I don't want it to not work. Like, I really want there to be strong competition for Microsoft. Otherwise Microsoft will just take its foot off the, you know, the pedal and get lazy. So, yeah, I hope this works. I just really hope they back off the crazy hype and marketing a bit.

And where I'd put it if I was kind of ranking them like you did. I think right now Tab AI on the whole is my favorite, I think, because Excel doesn't have instructions. I think it doesn't allow files to be uploaded, it doesn't have the Dashboard, it doesn't have all the different models. I think you can do more with Tab AI at the moment and then shortcuts, probably next. And Excel Agent. But I'm looking at the overall product, not just how well the model performed on the tasks like. And so we'll see at the rest of it. And the thing is, it could change in a month, two months, three months. And there are really some things I love from Trace Light. As I said before, if I could take something from all of them and put together the ideal product, that's what I would do.

Feels like a really nice way to end this episode.

So, on that note, we're going to go ahead and wrap up. I'm going to go ahead and cancel my subscription. You should do that so you don't see me on LinkedIn begging you to buy courses because I broke the bank. I may do that anyway for Black Friday, but it won't be because I wasted all my money. Until next time. Thank you, everybody. The Mod Squad. We are the Mod squad.