Tim Davies tests OpenAI's o1-preview model on complex math and reasoning tasks. He walks through designing model railway tracks, showing how the AI handles intricate calculations and problem-solving with speed and accuracy.
Where I'd use GPT4 to create this ridiculously comprehensive prompt around model railways and specific types of track. Fed it into O preview and it thought for 40 seconds before it answered every aspect, including calculating the force on the track, whether it could get up the slope, the exact design, and came back with a concept for the design of a track that met all of the requirements of the prompt within 40 seconds. Just breathtaking reasoning and maths combined in a single response to a prompt, but very much doesn't deal with it's crap in, crap out. You give it a weak prompt, it's not going to do much with it. If you ask for something super comprehensive, it gives it the opportunity to do more, and the reasoning it's demonstrating is breathtaking to me. I think on those little questions there isn't really the ability to demonstrate that it's effectively still just using GPT4. Smart.