The Latest in AI + Humanoid Robots

Today on the AI Daily Brief, the latest in AI and humanoid robotics. Before that in the headlines Are we Getting a new OpenAI model soon? The AI Daily Brief is a daily podcast and video about the most important news and discussions in AI. To join the conversation, follow the Discord link in our show. Notes. Welcome back to the AI Daily Brief Headlines edition. All the daily AI news you need in around five minutes. We kick off today with a fun one, something that has gotten the Twitter AI sphere chattering A new model has appeared in the Limsis arena that appears to be some new version of GPT4. It was first noticed last night and is named Anonymous Chatbot. Now you might remember that the last time that we got a new OpenAI model, it appeared first in this sort of semi anonymous form on the Limsys arena and so people are already speculating around what this might represent. When OpenAI leaker Jimmy Apples asked what model are you? The anonymous chatbot responded, I'm based on OpenAI's GPT4 architecture. Specifically, you're interacting with a version of GPT4 that has been fine tuned for chat based interactions. This model is designed to understand and generate human like text based on the input it receives. Now of course that could be a hallucination. It's no guarantee that that actually is what this model represents, but that's at least what it's self reporting speculation is that it might be something called Q. As the whole Sam Altman controversy was going down last November, Reuters and others reported that Q Star was a new, more advanced reasoning model and there was lots of speculation that safety concerns around Q Star were part of what the rift was inside the organization. Later, of course, all the parties involved would say that it wasn't about a safety issue, although there are still many who just don't believe that. About a month ago, Reuters once again reported on the latest of Q Star, although it was now codenamed Strawberry. Information came from an internal OpenAI document that was seen by Reuters in May. Quote the document describes a project that uses Strawberry models with the aim of enabling the company's AI to not just generate answers to queries, but to plan ahead enough to navigate the Internet autonomously and reliably to perform what OpenAI terms deep research. Two other Reuter sources had viewed demos of what OpenAI staffers told them was Q, with the main difference being that it was able to answer science and math questions outside of the capacity of models like GPT4. So back to this new model. Another frequent AI leaker flowers, said Anonymous Chatbot was able to solve all my test puzzles on the first attempt. Another X user, Golden Hawk, said it can finally solve the river puzzle without some crazy and wrong solution. The river puzzle asks, if a man and a dog are on one side of a river and have a boat that can fit a human and an animal, how do they get to the other side? This has caused some trouble for existing LLMs, but anonymous chatbots seem to have no problem. For example, Llama 3.170 B has this long convoluted answer that ends up with the man taking two trips across the river, whereas anonymous chatbot answered, this puzzle is pretty straightforward since the boat can fit both the man and the dog at the same time. The man and the dog simply get into the boat together and the man rows them across the river. Once they reach the other side, they both get out of the boat. That's it. Flowers responded, wow, that's great. I just hope they didn't intentionally overfit it to the usual memes because they knew these were the first things we would test the model isn't perfect. When Feldsteam asked A farmer is on one side of a river with a wolf, a goat and a cabbage. When he is crossing the river in a boat, he can only take one item at a time with him. The wolf will eat the goat if left alone together, and the goat will eat the cabbage if left alone together. How can the farmer transport the goat across the river without it being eaten? It does ultimately get the right answer, but in a very convoluted way. Anyway, all of this is to say, and the most important part of this discussion is that there appears to be another new OpenAI model being tested right now, which, as Andrew Curran points out, suggests that something new is on the way. Next up, staying on OpenAI for a minute, the company has announced a very requested feature from developers that are called Structured Outputs, they write Last year at Dev Day, we introduced JSON mode, a useful building block for developers looking to build reliable applications with our models. While JSON mode improves model reliability for generating valid JSON outputs, it does not guarantee that the model's response will conform to a particular schema. Today, we're introducing Structured Outputs in the API, a new feature designed to ensure model generated outputs will exactly match JSON schemas provided by developers, they continue Generating structured data from unstructured inputs is one of the core use cases for AI in today's applications. Developers use the OpenAI API to build powerful assistants that have the ability to fetch data and answer questions via function calling, extract structured data for data entry, and build multi step agentic workflows that allow LLMs to take action. Developers have long been working around the limitations of LLMs in this area via open source tooling, prompting and retrying requests repeatedly to ensure that model outputs match the formats needed to interoperate with their systems. Structured output solves this problem by constraining OpenAI models to match developers applied schemas, and by training our models to better understand complicated schemas. Now this is a feature that developers I've seen are very excited about, and interestingly, although it is a technology advance in some ways, it also matches the sort of product and user experience development that we're seeing happening elsewhere as well. A product feature designed to improve the product experience of using claude. It's not some big technological advance, it just makes it a better tool because it separates the output panel from the instruction panel in a way that makes it a lot easier to use. This is not exactly the same, but it's also not totally different. This basically takes a use case that OpenAI understands and modifies the existing experience just to better match it. Now there is some technological advance here, so like I said, it's not exactly the same. But you get it. We're moving into an era where there is more product consideration for specific use cases for LLMs rather than just a big blinking chatbot window. Now, almost buried in that announcement, there was also a significant price drop. Stephen Hydell from OpenAI said, oh yeah, nearly forgot to mention the new 4.0 version with structured outputs is 50% cheaper for input, 33% cheaper for output, and is available immediately. No betas, previews or waitlists. So this of course gets at two recent critiques of OpenAI the perpetual question of cost, which to be fair to them, has been coming down precipitously for some time now. And second, the fact that recently they'd become one of those companies that announces things before they're available, leading to some chagrin among users. Interestingly, reports also came out today that back in 2017 intel had a chance to buy a stake in OpenAI. Reuters writes that over a several month period in 2017 and 2018, executives at OpenAI and Intel had discussed a variety of different arrangements, including intel buying a 15% stake for a billion dollars in cash. They also discussed, apparently intel getting an additional 15% if it made hardware available for OpenAI at cost. And here we get the problem with ROI based thinking. Intel ultimately decided against the deal, partly because then CEO Bob Swan did not think generative AI models would make it to market in the near future and thus repay the chip maker's investment. Now, I'm no mathematician, but if you look at 30% of the roughly 80 to $90 billion valuation that OpenAI commands right now, you'll see the problem of having too short a time horizon when you're making decisions around technology. But then again, one of the big stories that we keep coming back to is the tension between public market dynamics and private venture capital style thinking. There is an incredible friction there that is leading to lots of weirdness in this space as it evolves. Couple more today before we get out of here. Audible is testing a new AI powered search feature Audible has a new personal recommendation expert they call Maven, through which a user can use natural language to enter queries. The example that TechCrunch gives is I'm looking for an uplifting fiction novel with a female protagonist. For me, it would probably be something like I'm looking for a historical thriller that involves the Templars or the Vatican's entity. One thing to watch out for when it comes to figuring out where in the hype cycle we are when companies can no longer get news stories just for launching an AI feature, you will know we have entered a different phase. So far, we're not there yet. Case in point, Reddit is the latest to join the AI powered summaries as part of search. During an earnings call on Tuesday, CEO Steve Huffman said that Reddit would begin testing AI powered search results to summarize and recommend content. I am much less interested in the specifics for Reddit and much more interested in this broader trend of how search is being reorganized. It's something we've been watching in the context of perplexity, Google AI Overviews and more recently Search GPT, and seems to be, at least for the moment, a broader shift. For now, though, that is going to do it for today's AI Daily Brief Headlines edition. Next up, the main episode. Today's episode is brought to you by Venice. The leading AI companies store your entire conversation history and attach it to your identity forever. That's every question you ask, every answer you receive, every image you generate, every thought you share with the machine, it's all being spied on. If you trust all the company's hackers and NSA board members that will ever have access to your AI conversations, then rejoice for you are well served. For the rest of us, Venice is an alternative. Venice is a powerful AI app for text, image and code generation that respects you as a sovereign individual and believes privacy and free speech are not only human rights but necessary for civilizational advancement. Private, permissionless and uncensored. You can try it for free without an account. AIA Daily Brief listeners receive a 20% discount on Venice Pro. Visit Venice AI NLW and enter the discount code NLWDAILYBRIEF. That's NLW Daily Brief. All one word today's episode is brought to you by Super Intelligent, the platform that helps teams maximize AI. Super is of course the platform that we've been building that pairs fun, fast, practical video tutorials with step by step instructions to get you actually using AI and from there unlocks information about hundreds of use cases that show you how people are actually getting value out of AI right now. Now we have just launched super for Teams. This is a new add on experience that allows teams to share more information about what AI they're using, how it's working and how to get more value out of it. Whether your company is 25 or 2500, superintelligent is going to be the best platform for unlocking information about how to get the most out of AI right now. If you'd like to learn more about the Super Intelligent teams offering, go to BeSuper AI partner and send us a note so that our team can get right back to you. Once Again, that's BeSuper AI partner. Welcome back to the AI Daily Brief. Today we are talking about the latest in AI powered robots. Specifically, Figure has announced their latest robot, the Figure 2. Now for us here at the AI Daily Brief, this is obviously a related but separate area than what we normally focus on. However, we are likely also living through the last period in which AI isn't fully integrated with humanoid robots, which which could have as much of an impact on work as anything we talk about here. Separately Right now two of the most discussed companies when it comes to humanoid robots are the Tesla Optimus and the Figure 02. So what is new about Figure 02? Figure CEO Brad Adcock writes Figure O2 was a ground up redesign to achieve 6 times the cameras, 50% more battery, 4th generation hands, integrated wiring, exoskeleton structure and speech to speech reasoning. Now, speech to speech reasoning is the big thing that has been called out here. Adcock writes Figure 02 is capable of speech to speech conversations with humans, onboard mics and speakers connected to custom AI models trained in partnership with OpenAI. The default UI to our robot will be speech. This is something we've been discussing a lot both on this show as well as within the super intelligent community of how much the default UI for our interactions with AI in general will be moving to speech and voice, Adcock shared a graphic that shows on a very high level how figure works. When someone asks, for example, Can I have something to eat? The figure 02 takes advantage of an integrated system that includes OpenAI's model, which allows for common sense reasoning from images, neural network policies that enable fast dexterous manipulation body controller to output the ability to say sure thing, here's an Apple and then hand someone an Apple. Adcock also writes that figure 02 has an onboard vision language model. This enables semantic grounding and fast common sense visual reasoning from robot cameras. Basically, the VLM is how the robot takes in visual stimuli and interacts with it. The big thing about the battery is that they're framing it in terms of what it can actually do from a work perspective, adcock writes. We hope figure 02 will be able to achieve upwards of around 20 hours of useful work per day, which is obviously totally transformative if the figure can actually mirror things that are done by humans today. One of the big shifts from the figure 01, they say, is the exoskeleton structure, Adcock writes, in order to provide structural stiffness and protect against crash loads, figure 02 was designed as an exoskeleton structure similar to aircraft, where the outer skin bears the load. Now, you might also remember that back in February, figure raised a $675 million Series B. OpenAI was a partner and investor in that deal, and that partnership has clearly expanded in the time since. Alongside the announcement figure, the company also shared more details of its test with humanoid robots at a BMW plant in Spartanburg, BMW writes. During a trial run lasting several weeks at BMW Group plant Spartanburg, the Latest humanoid robot, figure 02 successfully inserted sheet metal parts into specific features which were then assembled as part of the chassis. The robot must be particularly dexterous to complete this production step. BMW says using a robot can save employees from having to perform ergonomically awkward and tiring tasks. The takeaway for many is not so much that the figure 02 is completely production ready, but that it is actually in the testing in a real world environment stage. Another big topic of conversation on Twitter, at least, is the competition with Tesla's Optimus. I personally think that this is a little bit overstated, mostly because I think that the total addressable market for humanoid robots is going to be so massively immense that while, yes, there will be a first mover advantage to some extent, there is going to be a lot of market share to go around for Tesla investors, though it might be seen more as a bellwether for how the company is doing in general. Danish on X writes, Tesla Optimus has serious competition now. As expected, Tesla is now under significant pressure from a more focused and better performing competitor figure. I spoke about this last year, including the importance of visionary leadership and good governance. Well, here is the result. Figure is backed by Nvidia and OpenAI who are betting that this will be the first real embodied agent. Now one other interesting note in the hardware space, it's not exactly robotics, but seems somewhat related. OpenAI has made a $60 million investment into Opel. In fact, the company is leading Opal Series B. Opel is a plug and play webcam which promises quality similar to a dslr. It's what you see when I'm on camera in these videos, or for example on the videos on Superintelligent. The information writes OpenAI's involvement in the funding round is surprising. Opal is best known for its $300 professional grade webcams. Not an obvious match for an LLM developer, but they write Opal plans to develop other types of devices powered by OpenAI's AI models. While it continues to sell its webcams. The three year old startup envisions developing devices that individuals can use as creative tools rather than AI powered friends or companions. Opal will be working closely with OpenAI researchers to prototype various device ideas. It is very clear from all of Altman and OpenAI's moves that they think that there is going to be an entire new generation of AI powered hardware, AI powered devices and AI powered robots. And it's a future which appears to be materializing rapidly. For now though, that is going to do it for today's AI Daily Brief. Until next time, peace.