DOGE and How AI Could Infiltrate the US Government
14 Nov 2024 · 14 min
Nathaniel Whittemore covers OpenAI's personnel changes, AWS's $110M chip grants, and the proposed Department of Government Efficiency led by Elon Musk and Vivek Ramaswamy. The episode explores how AI could automate bureaucracy in healthcare and the IRS, with both optimistic and critical takes on the plan's feasibility.
Questions this episode answers
November 14, 2024.
$110 million.
$11 million each.
Up to $500,000.
40,000 Trainium chips.
Chapters
Today on the AI Daily Brief what this new DOGE thing means for AI. The AI Daily Brief is a daily video and podcast about the most important news and discussions in AI. To join the conversation, follow the Discord link in our show. Notes. Welcome back to the AI Daily Brief Headlines edition. All the daily AI news you need in around five minutes. We kick off today with a story story from OpenAI that bucks the trend that we have been seeing recently of executives leaving with an executive coming back. Greg Brockman, it turns out, was just on sabbatical. He was not pre leaving the company and as of yesterday he tweeted longest vacation of my life. Complete. Back to building at OpenAI According to reports, Brockman told staff that he had been working with Sam Altman to create a new role for him focused on addressing significant technical challenges at the company. One of the points of discussion during Brockman's time away was how he did or didn't fit within the changing OpenAI executive landscape. Brockman is a much more hands on builder than he is a manager and it wasn't clear exactly how that was fitting in the information and others had reported that there were some tensions with his leadership style and so Bloomberg's report that Brockman had been working with Altman to create a new role makes sense based on that. Now, of course, in spite of all that, Brockman does return to a dramatically transformed company. Half a dozen senior staffers have left during his leave, including CTO Mira Muradi and co founder John Shulman. Newly appointed CFO Sarah Fryer is refocusing the company on commercial applications of AI. And of course the company is looking to ship a new generation of models, which have been marred with questions about a slowdown of progress. Brockman is now one of three out of 11 co founders remaining at the company and by and large people are pretty excited. AI for success on Twitter, writes Greg Brockman is back. AGI just got a day closer. Speaking of Mira Moradi, we also got some reports around what she's doing now, the information writes X OpenAI CTO Murati's new team takes shape almost immediately upon leaving the company. Mira Muradi had reportedly begun to pitch other OpenAI employees about joining what she was building. It appears that some have taken her up on that offer, including Miana Chen, a research program manager at OpenAI who worked on preparing AI models for release, ex head of Post Training Barrett Zof and former senior researcher Luke Metz. The information writes. Chen's loss is particularly significant given that she led the launches of a number of OpenAI's models and products, including GPT 04:01 Reasoning models and Advanced Voice mode. Still, at the same time, we just don't know what Mirati's actually working on. Whatever it is, you can bet that there will be big venture checks waiting should they decide to go that route. News from another one of the big players Amazon has announced a massive grants program to lure AI researchers to their hardware. Called Build on Trainium, the program will award 110 million in credits and grants. Partner universities can access 11 million in credits each, while individual grants of up to 500,000 will be available to the broader AI research community. AWS also said that they are establishing a research cluster of 40,000 Trainium chips that will be available for research teams and students. Gaddy Hut, senior director at Annapurna Labs, the AWS chipmaking division, said AI academic research today is severely bottlenecked by a lack of resources and as such the academic sector is falling quickly behind. With Build on Trainium, AWS is investing in a new wave of AI research guided by leading AI research in universities that will advance the state of generative AI applications, libraries and optimizations. The problem is fairly stark when you consider the numbers. Meta's training cluster used for their Frontier models houses 100,000 GPUs, whereas Stanford's natural language processing group has 68 GPUs for all of its work. Still, not everyone is happy to see the expansion of resources driven by a large corporation. Os Keys, a PhD candidate at the University of Washington who studies the ethical impact of emerging technologies, told TechCrunch, this feels like an effort on generalizing a corruption of academic research funding. Then again, this is really just part of the process. By 2020, 70% of AI PhDs already ended up working in private industry, in part due to the necessary access to compute. The number of papers with industry co authors has nearly doubled since 2000. And while the government is taking steps to address the issue, like the National Science Foundation's $140 million investment to launch seven university led national AI research institutes, it still seems like this sort of collaboration is just going to be the way that things work going forward. Lastly today, another big fundraise for an AI unicorn, Rider has raised $200 million at a $1.9 billion valuation. Rider is firmly in the enterprise realm, with CEO May Habib saying, at Rider, we're not just creating LLMs that can execute tasks, but developing advanced AI systems that deliver mission critical enterprise work. With this new funding, we're laser focused on developing the next generation of autonomous AI solutions that are secure, reliable and adaptable in highly complex real world enterprise scenarios. With that, we wrap today's AI Daily Brief Headlines edition. Next up, the main episode. Today's episode is brought to you by Vanta. Whether you're starting or scaling your company's security program, demonstrating top notch security practices and establishing trust is more important than ever. Vanta automates compliance for ISO 27001, SOC2GDPR and leading AI frameworks like ISO 4200, 2001 and NIST AI risk management framework, saving you time and money while helping you build customer trust. Plus you can streamline security reviews by automating questionnaires and demonstrating your security posture with a customer facing trust center. All powered by Vanta AI. Over 8,000 global companies like LangChain, Leela AI and Factory AI use Vanta to demonstrate AI trust and prove security in real time. Learn more@vanta.comnlw that's vanta.comnlw Today's episode is brought to you by Superintelligent Every single business workflow and function is being remade and reimagined with artificial intelligence. There is a huge challenge, however, of going from the potential of AI to actually capturing that value. And that gap is what superintelligent is dedicated to filling. Superintelligent accelerates AI adoption and engagement to help teams actually use AI to increase productivity and drive business value. An interactive AI use case registry gives your company full visibility into how people are using artificial intelligence right now. Pair that with capabilities building content in the form of tutorials, learning paths and a use case library and superintelligent helps people inside your company show how they're getting value out of AI while providing resources for people to put that inspiration into action. The next three teams that sign up with 100 or more seats are going to get free embedded consulting. That's a process by which our super intelligent team sits with your organization, figures out the specific use cases that matter most to you, and helps actually ensure support for adoption of those use cases to drive real value. Go to BeSuper AI to learn more about this AI enablement network. And now back to the show. Welcome back to the AI Daily Brief. Today we are talking about the new Department of Government Efficiency and what the implications are for artificial intelligence. And just before we get into this, one quick caveat. The AI Daily Brief is obviously not a political show. We've done a little bit more political coverage recently simply based on the fact of the elections and all the discourse surrounding what a new administration means for AI. But by and large, the way that I see this show is we are about one technology advancements and actually helping you understand what's changing about the technology itself, and two real world implications with an emphasis on business. We talk a lot, obviously about how companies are using AI, how they're thinking about integrating it, what it means for the structure of different industries. In a distant third is the policy surrounding AI. Now, we do cover it because obviously it's going to have a deterministic impact on how AI shakes out. But in most circumstances it's not where I want the emphasis to be. However, for the purposes of today's conversation, I actually think that there are not enough people talking about what this new DOGE thing means for AI. So first of all, what the heck am I talking about? Yesterday an announcement started floating around X that many people thought at first was a joke. Basically, it said that President Elect Trump was appointing Elon Musk and Vivek Ramaswamy to lead something new called the Department of Government Efficiency. The statement read, together these two wonderful Americans will pave the way for my administration to dismantle government bureaucracy, slash excess regulations, cut wasteful expenditures, and restructure federal agencies. This will send shockwaves through the system and anyone involved in government waste, which is a lot of people. Trump went so far as to call this potentially the Manhattan Project of our time. He said the Republicans have dreamed about the idea of being able to effectively take a wrecking ball to bureaucracy for a long time, and that this was the opportunity. He even gave it a little bit of symbolic chutzpah when he proclaimed that the work would conclude no later than July 4, 2026, which is the 250th anniversary of the Declaration of Independence. Of course, a lot of the discussion initially was about the name. The acronym for the Department of government efficiency is DoGE, which is, of course, the original crypto meme, coin, and something that Elon Musk has long had a flirtation and frankly, a love for. However, it's also quite clear that the initiative as a whole is not being treated as a meme. Vivek, for his part, is giving up the chance to be appointed to the Senate in order to run this thing. Elon has been talking about this for some time. In one of his many interviews recently, he said, There are around 428 federal agencies. There's so many that people have never even heard of. I think we should be able to get away with 99 agencies. Anyway. The point being that this is a real thing. Now it strikes me that there are likely to be two phases of this. The first phase inevitably is going to be about some amount of cutting and just going through and trying to find areas where there's opportunities to slash. If you go cruise around Twitter or X, it's basically a crowdsourced list of all the things that people find wasteful. However, if the first phase is all about just rooting out where there's potential waste, it seems inevitable that the question of how to make what's left more efficient is going to arise as well as and that, my friends, is where AI enters the discourse AI Policy Reacher's Miles Brundage writes, surprised not to see more discussion of the intersection of DOGE and AI, as in the heavy lifting of cost reduction seems like Medicare and Medicaid rather than a bunch of small things. And that raises the question of whether AI could help on those big ticket items. Miles points out that quote, doge will coincide time wise over the next two years with AI surpassing human expert performance on a very wide range of medical and administrative tasks. Y Combinator partner Harsh Tagar writes, AI is great at automating repetitive administrative work and the government needs to reduce spending. Combine those two ideas and now could be a great time to build software to make the government run more efficiently. YC would love to fund any builders up for the challenge. Lawrence Muir writes, if I had to take a guess at a DOGE idea, the IRS could be in large part eliminated by a combination of a flat tax and fraud detection audit software powered by AI that's akin to what PayPal used makes returns much easier, disincentivize evasion, automate the process. AI entrepreneur Bindu Reddy also pointed to healthcare, saying healthcare is exorbitantly expensive and supremely inefficient in America. This is a combination of corruption, red tape, cabals who restrict licenses, and onerous regulation. Now, of course not everyone is excited about this, ali Al Khatib writes per recent DOGE News. My guess is Elon and Vivek will most likely turn to AI and tech companies for contracts to swap out bureaucrats for algorithmic systems in an attempt to retain the sprawling power of an authoritarian state with less of a headcount. Now, even beyond Doge, there's also a lot of discourse going around right now around how Elon has the ear of the president and what it means specifically for artificial intelligence. On Sunday, CNN wrote, Elon Musk exerts deepening influence on Donald Trump's presidential transition Donald Trump's mar a lago Club has been brimming in the last 48 hours with two kinds of people those angling for a job in the president Elect's incoming administration and those trying to influence him into hiring their picks for the top spots. But the one person who has loomed over it all and has exerted a great deal of influence is Elon Musk. According to multiple sources, the tech billionaire has been seen at the resort in Palm Beach, Florida almost every day since Trump won the election last week, dining with him on the patio some evenings and hanging out with his family Sunday at the golf course. On November 11, the Verge published the push for Elon Musk to lead American AI policy is already starting. The story is specifically about a public petition from the Americans for Responsible Innovation for Trump to make Elon Musk his special advisor on AI. The ARI is led by former Democratic Representative Brad Carson and said in the petition that, quote, no one is better equipped to help the Trump administration make America lead on AI than Elon Musk. Interestingly, part of the reason for this is Elon's consideration of AI safety issues, ari policy analyst David Robusto wrote in a blog post recently. Musk could emerge as a champion for AI safety in the administration. They pointed to, for example, his public support of California's SB 1047, which ultimately California Governor Gavin Newsom vetoed. Of course, there are some conflict of interest issues given that Elon runs a big AI lab. Alex Cantrowicz of the Big Technology Podcast writes, just imagine Sam Altman walking into the White House for a conversation about AI regulation next year, only to see Elon Musk sitting across the table. Still, hold aside all that and come back to this question of doge. And mostly from entrepreneurial circles, there is just tons of excitement. JT writes. What if DOGE becomes the largest application of AI agents in history? Agents could analyze budgets, process complaints, identify ineffective rules and regulations, automate administrative tasks, etc. There's a real chance at modernization here going out even more broadly. A16Z partner Sriram Krishnan writes, Vibe Shift Think this is one of the most exciting times to build new things. From media to how AI can change existing industries or making government efficient, there's a tangible excitement in the air. And while I think there are plenty of folks who are still reeling from last week's election results and of course a huge variety of opinions about this new administration, when it comes to the entrepreneurship vibe, I think that's dead on. So will we see the Department of Government Efficiency be the way that AI infiltrates the US government. Only time will tell. For now. That's going to do it for today's AI Daily Brief. Appreciate you listening as always. And until next time, Peace, Sam.
More from LARRUZ


Ep 882: Rogue AI Agents: Why Breakouts are Happening More and How Companies Should Prepare (Replay)


Ep 881: Faster AI Agents, Fewer Human Coworkers: The Overly Productive Future of Managing Agents? (Replay)


Ep 879: New: OpenAI Presence. Has The AI Customer Service Takeover Finally Arrived? (Replay)




