
0:33
Eric Siu explains how Babel 5 outperforms Opus at finding the right datasets, citing Zapier's CEO as an example. The model costs roughly 17% more in total accuracy score and double the price if used directly, but CEOs were using it anyway.

Eric Siu explains how Babel 5 outperforms Opus at finding the right datasets, citing Zapier's CEO as an example. The model costs roughly 17% more in total accuracy score and double the price if used directly, but CEOs were using it anyway.
Babel 5 is actually very good at charting things out or looking for the right data. In some cases where Opus might have given up on something, it'll go and find the right dataset. I think the CEO of Zapier was talking about this. Basically, if it couldn't find it in the CRM and it looked for the spreadsheet on it, it actually found the right data and then it also avoided the wrong dataset too, right? You look at this accuracy versus cost, a lot of people are going crazy about it. I've talked to engineers using it, I've talked to CEOs using it today, and it does a lot better job. And it is more like 17% more expensive from a TAS standpoint, but I think double the price if you're just using the model itself.