GLM-5.2, a Chinese open-weight model, matches Opus 4.8's performance on reasoning tasks at half the price, though it uses twice as many tokens. The comparison raises questions about how benchmarks shape perception of AI capability and cost.
Chapters
On this chart, which ones do you find most impressive? Which performance data— what shocked you on this?
The, the chart that you're showing shows SuiBench Pro and TerminalBench and a bunch of other benchmarks and shows pretty impressive performance by GLM 5.2 versus, say, Opus 4.8. What's perhaps most interesting to me, aside from the fact that you get near-competitive performance from a Chinese open-weight model against one or more of the top Western closed API-based models, is the choice of benchmarks themselves. So these are largely reasoning-intensive benchmarks where you can in principle win if you can reason over longer ranges. The gestalt with GLM 5.2 is that it takes roughly double the number of tokens to get to the same capability output as the best Western frontier models, but at half the total price. Yeah. Yeah. So the Chinese are evidently figuring out how to more efficiently, or at least more cheaply, reason.