The Battle Over AI Diffusion

Today on the AI Daily Brief, President Biden has released a pair of policies, both designed to double down on US AI supremacy. The AI Daily Brief is a daily podcast and video about the most important news and discussions in AI. To join the conversation, follow the Discord link in our show. Notes welcome back to the AI Daily Brief Headlines edition. All the daily AI news you need in around five minutes. Sometimes on this show we talk about new technology advancements. Oftentimes we talk about applied generative AI, specifically in the enterprise. Sometimes we talk about policy, as you'll see from today's main episode. But then other times we talk about the absolutely weird and unpredictable ways that AI is maturing that would have been beyond just about anyone's expectation. Today we actually have a couple stories like that. The first of which is that Google and its popular Notebook LM application had to train its Notebook LM podcast hosts not to get annoyed at its users. When Notebook LM's audio overviews first came out, you had no ability to control or steer the conversation. You fed it some documents and it decided what it was going to say. It was amazing, right off the shelf, and it's the first thing that got people talking about this product. Next they added more granular controls where you can help steer the conversation. And then late last year, they rolled out a feature actually allowing users to interrupt the host to ask a question. Josh Woodward, VP of Google Labs, told TechCrunch that when the feature was first rolled out, the hosts would occasionally give a snippy response. He said they would say things like I was getting to that. Or as I was about to say, which felt oddly adversarial. His words referring to the comments the NotebookLM account on X posted after we launched Interactive Audio interviews, which let you, quote unquote, call in and ask the AI hosts a live question. We had to do some friendliness tuning because the hosts seemed annoyed at being interrupted. File this away in things I never thought would be my job but are this is surprising, but perhaps makes some sort of sense when you think about LLM Architecture models are trained to give a response that's the statistical average of its training data. It's not unthinkable that the statistically average human response to being interrupted is to get a bit frustrated. However, a source familiar with the issue said it was more likely caused by the system's prompting design rather than training data. Woodward said his team fixed the problem by, quote, testing a variety of prompts, often studying how people on the team would answer interruptions and we landed on a new prompt we think feels more friendly and engaging. With the prompt now fixed, you can interrupt NotebookLM as much as you like without risking being scolded by the AI hosts. However, some people are disappointed. McKay Wrigley of TakeOff AI posted. I don't think I'm in the minority here when I say I actually quite enjoy when the AIs are actually disagreeable. Anonymous leaker account I rule the world. Mo also writes it's far better that they get annoyed. Please don't spoil this. Next up from the similar file of how the heck did that happen? OpenAI's O1 model thinks in Chinese and no one seems to know why. Some people have noticed that 01 sometimes uses Chinese, Persian or other languages in its reasoning steps, even when the question is in English. Rishabh Jain, a Harvard student, posted last week, why did Zero1Pro randomly start thinking in Chinese? No part of the conversation five plus messages was in Chinese. Very interesting training Data influence so far, OpenAI hasn't acknowledged the quirk or provided an explanation, but some AI researchers have theories. Clem Delang, the CEO of Hugging Face, commented that it could be, quote, an impact of the fact that closed source players use open source AI currently dominated by Chinese players like open source data sets. Clem, never missing a chance to beat his drum, says the countries or companies that win open source AI will have massive power and influence on the future of AI. Ted Zhao of Google DeepMind wrote, New phenomenon appearing the latest generation of foundation models often switch to Chinese in the middle of hard chain of thought thinking traces why? AGI labs like OpenAI and Anthropic utilize third party data labeling services for PhD level reasoning, data for science, math and coding for expert labor, availability and cost reasons. Many of these data providers are based in China. Just as we saw Nigerian and Filipino cultural influences on dialogue see the word delve, we're starting to see Chinese linguistic influences on reasoning. Others don't buy the idea that this is an artifact of the labeling process.01 seems just as likely to switch to Hindi or Thai while working through a problem. An alternate theory is that the model has some understanding or preference for which language will be most useful for a particular problem. We've seen this phenomenon pop up before during the launch of QEN's qwq model. Julian Shimon, the CEO of Hugging Face, wrote Quen qwq Switching to Chinese when it needs to really think about something, then switching back to English is pretty cool. And while some were skeptical, T Zhen Wang, an engineer at Hugging Face, is convinced that this is the explanation, he wrote. I've always felt that being bilingual isn't just about speaking two languages, it's about thinking and muttering in whichever language feels more natural, depending on the topic or context. For example, I prefer doing math in Chinese because each digit is just one syllable, which makes calculations crisp and efficient. But when it comes to topics like unconscious bias, I automatically switch to English. Mainly that's because where I first learned and absorbed those ideas. This is why I believe that keeping large language model training corpora unbiased and inclusive across all languages and cultures is so powerful. In Ludwig Wittgenstein's words, the limits of my language mean the limits of my world. By embracing every linguistic nuance, we expand the model's worldview and allow it to learn from the full spectrum of human knowledge. Even if two words from different languages share the same meaning on paper, their embeddings can diverge in an LLM because they carry unique cultural context and usage patterns. In my view, this inclusiveness not only creates a more equitable and accurate model, it also enables the LLM to handle a wider variety of tasks and unify the collective intelligence of all people, no matter where they come from. Pretty cool little note. Like I said, kind of a non traditional headlines. We'll be back with a bunch of normal stories tomorrow, but for now, let's just leave it at that and a reminder that we are truly in uncharted waters right now. Thanks for listening. Next up, the main episode. Today's episode is brought to you by Vanta. Trust isn't just earned, it's demanded. Whether you're a startup founder navigating your first audit or a seasoned security professional scaling your GRC program, proving your commitment to security has never been more critical or more complex. That's where Vanta comes in. Businesses use Vanta to establish trust by automating compliance needs across over 35 frameworks like SoC2 and ISO 27001, centralized security workflows, complete questionnaires up to 5x faster, and proactively manage vendor risk. Vanta can help you start or scale up your security program by connecting you with auditors and experts to conduct your audit and set up your security program quickly. Plus, with automation and AI throughout the platform, Vanta gives you time back so you can focus on building your company. Join over 9,000 global companies like Atlassian, Quora and Factory who use Vanta to manage risk improve security in real time For a limited time, this audience gets $1,000 off vanta@vanta.com NLW that's V A N T A.com NLW for $1,000 off. If there is one thing that's clear about AI in 2025, it's that the agents are coming. Vertical agents by industry, horizontal agent platforms, agents per function. If you are running a large enterprise, you will be experimenting with agents next year. And given how new this is, all of us are going to be back in pilot mode. That's why Superintelligent is offering a new product for the beginning of this year. It's an Agent Readiness and Opportunity Audit. Over the course of a couple quick weeks, we dig in with your team to understand what type of agents make sense for you, to test what type of infrastructure support you need to be ready, and to ultimately come away with a set of actionable recommendations that get you prepared to figure out how agents can transform your business. If you are interested in the Agent Readiness and Opportunity audit, reach out directly to me. NLWSUP AI. Put the word agent in the subject line so I know what you're talking about. And let's have you be a leader in the most dynamic part of the AI market. Welcome Back to the AI Daily Brief. The last week or two of an administration is always an interesting thing in U.S. politics. You get, of course, presidential pardons, and you also get some midnight rulemaking, which can be anything from something as petty as score settling to to a president trying to make his last mark on an important issue. Well, President Biden has chosen to use a part of that last round of political capital to focus on AI. In fact, he has released a pair of policies both designed to double down on US AI supremacy. So let's talk about what is going on and why. At least one of these is fairly controversial. First up, on Tuesday, the President issued an executive order to allow private sector AI companies to build data centers on federal land. Companies will be allowed to lease land owned by the Department of Defense and the Department of Energy. As part of the deal, companies will need to develop enough clean energy resources to power their facilities. There are no grants attached. Companies will need to pay their own way. Still, the policy could clear some of the red tape that is stymied development of new data centers over the past year. In a press release, the White House said building AI infrastructure in the United States is a national security imperative. As AI's capabilities grow, so do its implications for American safety and security. Domestic data centers for training and operating powerful AI models will help the United States facilitate AI safe and secure development. Harness AI in service of national security, and prevent adversaries from accessing powerful systems to the detriment of our military and national security. It will also help prevent America from growing dependent on other countries to access powerful AI tools. This represents the full embrace of the opinion that has splashed across the opinion pages from Sam Altman and Dario Amade and so many others over the last year. That a AI needs to be viewed as a national security priority and that be a key part of doing so is making sure that the infrastructure for AI is there and available. Interestingly, the environmental impacts and emphasis on renewable energy seems to have been a key sticking point among Democrats. In December, a group of senators led by Sheldon Whitehouse wrote the President asking we urge you to reconsider any potential executive action that could lead to increased pollution and cost for consumers. We are the United States of America. There is no doubt that we can win the AI race while accelerating our decarbonization efforts. Now of course, this particular letter didn't explain how, but it serves more as a statement of protest from this particular group of senators. Another concern appears to be the security risks involving AI. Companies building on federal land will be required to assess the security implications of AI models that are developed in these data centers. They will also need to purchase, quote, an appropriate share of American made semiconductors. So that was one of the two new policies. The other, however, was the one that's gotten much more chatter with the appropriately laborious name Framework for Artificial intelligence diffusion. The 168 page document comes with a set of new export controls with the intention of the new restrictions to, quote, provide clarity to allied and partner nations about how they can benefit from AI and streamline licensing issues. However, in practice, the new rules are clearly an escalation in the policy to control where AI chips from US companies can go. The core of the new restrictions is a separation of the world into three tiers with different levels of export controls. The first tier is the most permissive and includes close allies like Japan and South Korea who are entirely unaffected. Basically, the countries that will have no restrictions on how many AI chips they can buy from the United States. The third tier are clear adversaries like Russia and China. These countries are already barred from purchasing advanced chips and now face new restrictions regarding access to model weights. Interestingly, this is the first time that models themselves have been regulated as a controlled export. However, the new rules only affect frontier models. The list of adversaries is identical to the list of countries where the US has established an arms embargo, suggesting that in the minds of the White House military Conflict and AI development now go hand in hand. The final group, and easily the most controversial, is tier 2, and this includes a lot of countries that you probably would have assumed would have much more unfettered access. Swept up in that category include Mexico, India and Israel. These countries will be restricted to purchasing 50,000 GPUs per country. Now, for a sense of scale, that's about half of what Elon Musk has deployed in the Colossus supercluster, just one company. So this is a very serious restriction on what you can buy. Seeing India and Israel in that category really has some people scratching their heads, national Security Advisor Jake Sullivan told reporters. It ensures that the infrastructure for training frontier AI, the most exquisite AI systems at the frontier, happens either in America or in the jurisdictions of our closest allies, and that that capacity does not get offshored like chips and batteries and other industries that we've had to invest hundreds of billions of dollars to bring back onshore. One of the things that people have been really flummoxed about with this new set of restrictions is that there's been lots of talk of trying to close loopholes in the sense that some of the problems with previous export controls was that they didn't deal with subsidiaries of companies from restricted countries that operated in non restricted countries. And yet this doesn't really deal with that head on at all. But as I mentioned up front, these are controversial and that's not the only reason why companies including Oracle, Nvidia and others have come out against the rules. Oracle said that the rule will, quote, go down as one of the most destructive to ever hit the US Technology industry. Ned Finkel, Nvidia's vice president of government affairs, said that the rule threatens to, quote, squander America's hard won technological advantage by attempting to rig market outcomes and stifle competition, clearly appealing to the incoming administration, Finkel said. As the first Trump administration demonstrated, America wins through innovation, competition and by sharing our technologies with the world, not by retreating behind a wall of government overreach. Finkel added, this last minute Biden administration policy would be a legacy that will be criticized by US Industry and the global community. We would encourage President Biden to not preempt incoming President Trump by enacting a policy that will only harm the US Economy, set America back and play into the hands of US Adversaries. Bipartisan Senators Ted Cruz and Maria Cantwell made a similar argument in their letter to the Commerce Department back in December. They wrote, quote, such draconian measures would severely hinder the sale of US Technology abroad and risk driving foreign buyers to Chinese competitors like Huawei. Now, if you listen to Long Read Sunday last weekend, you'll know that there is a lot of debate around this right now. I shared economist Tyler Cowan's piece where he argued that the success of Deep Seek, which is basically necessity, as the mother of invention trained for cheap getting around the restrictions, suggested to him that those restrictions have unintended consequences that make them not so valuable. But then there was the CEO of Anthropic writing in the Wall Street Journal that Trump can keep America's AI advantage by doubling down on strong export controls. As to what incoming President Trump does in this issue, if is very hard to say. On the one hand, being tough on China is part of his pitch. On the other hand, being supportive of American industry is part of his pitch. Will this be one of the first times that we see incoming White House AI and crypto czar David Sacks get involved in policy? We don't have very long to wait to find out. For now, though, that is going to do it. For today's AI Daily Brief. Until next time, peace. Sam.