Vibe-Coding an Attention Firewall, w/ Steve Newman, creator of The Curve

Hello, and welcome back to The Cognitive Revolution. Today, my guest is Steve Newman, the veteran software engineer who created Writely, the startup acquired by Google that ultimately became Google Docs, and who is now the founder of the Golden Gate Institute for AI, the nonprofit behind the Curve conference, and author of the Second Thoughts Substack, which is increasingly popular among the AI-obsessive set for its grounded, Well-balanced, anti-sensationalist, and at times openly confused analysis. We do eventually get Steve's takes on some of the biggest open questions in AI, including how near or far we may be from a recursive self-improvement-driven intelligence explosion, how far behind digital AIs robotics will prove to lag, and whether or not AI will have a major impact on climate change. But the main focus of today's conversation is actually a show and tell of Steve's personal AI toolkit And vibe coding practices. I wanted to have this conversation because having spent the last few months building up my own Claude Code-powered personal productivity stack, and now an autonomous assistant too, I feel that though I am getting outstanding value from what I've built, I still stand to learn and gain a ton from seeing how someone like Steve, who's been programming professionally since 1985, is using the latest and greatest tools. As you'll hear, it unfolded exactly as I'd hoped. We walked through a dozen or so bespoke applications that have fundamentally rewired how Steve interacts with the digital world. And for me, these produced a number of light bulb moments where I realized just how much value I've still been leaving on the table. These include, among others, an attention firewall that alerts him about important messages without requiring him to constantly check email and messaging apps. A personal reading app that attempts to flag meaningful new ideas in the otherwise overwhelming number of newsletters he's subscribed to, a dashboard that allows him to see the status of his various coding agents at a glance, a Chrome extension that automates common workflows, and a universal logging solution that allows Claude to debug and fix the errors that inevitably pop up. Along the way, he also describes his strategies for information security and integrity. How he's using mobile and voice interfaces. And my favorite, his anti-token-maxing philosophy, which he sums up as, the agent's not important. I'm important. Because there is quite a bit of screen sharing, this episode is probably best consumed in video form on YouTube. But I think we do a good enough job of narrating that it should work well in audio form too. In any case, even if you don't listen at all, I encourage you to do what I did immediately after recording. Copy the transcript, give it to your Claude code or OpenCLAW, and ask it to identify the ideas we discuss that would most meaningfully enhance your personal setup. Since doing this, I've already created a new UI to help me produce the podcast more efficiently, and I'm working on a number of hooks and a personal Chrome extension. So I'll be very interested to hear what your coding agents create for you. Based on this conversation. With that, I encourage you all to subscribe to Second Thoughts on Substack, and I hope you enjoy this behind-the-scenes look at what one extremely accomplished builder is building now with Steve Newman of the Golden Gate Institute for AI. The Cognitive Revolution is brought to you in part by Google, makers of the Gemini family of models and much more. As many of you know, due to some unexpected circumstances, for the last few months, my wife and I have been homeschooling our boys on an improvised basis. And when you're making it up as you go, like we are, Gemini's image generation model, also known as Nano Banana, can be a huge difference maker. Whether it's math or reading, whenever I notice a gap in their understanding, I ask Gemini to create a worksheet on that specific concept. And then seconds later, I'm printing a sheet of 6 to 8 illustrated exercises created specifically for them. So far, I've made worksheets to help teach common patterns of silent letters, vowel pairs, prefixes and suffixes, how adding an -e to the end of words changes the preceding vowel sound, the commutative property of addition and multiplication, and more. With any luck, the kids will be back to school in the fall. But this is a teaching technique that I'll take with me into next year and beyond. Try Gemini's Nano Banana image generation model for yourself in Google's AI Studio or the Gemini app, and check out the quizzes and guided learning features in the Gemini app as well. Thank you to Google for supporting the Cognitive Revolution. And now, on with the show.

Steve Newman, once the creator of what is now known as Google Docs, now author of the Second Thoughts Substack and founder of the Golden Gate Institute for AI, makers of the Curve conference. Welcome to the Cognitive Revolution.

Really excited to be here.

Yeah, I'm looking forward to this. I think this is going to be a fun session. We're going to cover a lot of ground, and some of it's going to be a little bit of show and tell. One of the things I've been thinking a lot lately is people are so excited about going down the Claude code and AI agents and all these sort of various rabbit holes. That a lot of people are probably coming up with very interesting ways of working and not sharing them as much as they probably could because it's just so much fun to, to do and it's, it's so bespoke and it's like, at least for me, I find I've had on my to-do list like I should do an episode about my setup and I kind of keep thinking, well, I wanna do this one more thing before I actually get it done. So finally cornered you and said, all right, I wanna see what's going on. And then there's plenty more stuff beyond that to talk about as well. Maybe for starters, tell me what you're building. You've been programming since I was able to see on LinkedIn as far back as 1985 with multiple companies that you started and exited, including Writely, which became Google Docs.

What are you building today?

So, and this is all on the side because my day job is at Golden Gate Institute. And so, and some of what I'm doing, A little of what I'm doing relates to that, but mostly it's just kind of personal tools. So on the side, evenings and weekends, I've got something like 15 different projects going, mostly under the heading of personal productivity. Kind of the theme has been, you know, like so many of us, I've just been drowning, you know, over the last couple of years, just trying to keep up with everything that's going on in the world in general and in AI in particular. And I, I now know, this is a statistic I wouldn't have known until I started building these tools. I actually, I don't have the hard number, but it's, I get something like 50 Substack posts, other blog posts, newsletters, like kind of big information items in my inbox per day, plus everyone I follow on Twitter, plus a bunch of WhatsApp groups I'm in. And, you know, I was spending, I don't know how many hours per day Just trying to read, just keep it, let alone synthesize, lay out, let alone do anything else. And so the theme of everything, of most of what I've been building is manage that workload. And I realized like the first thing I built, and this is something I'd been dreaming about and muttering about for a long time, was something to just summarize. And not because a summary is as good as the original, but more to tell me what to read. Like, you know, I don't know how many posts I'm gonna get over the next few days about Opus 4.7. And I don't need to read all of them. And so the, pretty much the first thing I built was just an RSS reader that takes all the Substacks and other newsletters and podcasts and a couple of other things and precomputes a summary for each one. Actually, kind of 2 levels, a summary for each one. And so every morning I can glance through that, glance through the summaries and decide which of these am I actually gonna bother reading? Is this a new take on 4/7 or is it basically the, you know, the same as I've already read? Especially helpful for a podcast where, you know, it can be very, you know, there can be an interesting topic and it may or may not have an angle on that topic that I haven't seen before. And the, you know, the summary can be really helpful for that. So that, and then the other theme, so just like sort of distilling the information flow was the first theme. The second one, which took me a while, like I sort of had a vague inkling there was something I wanted and I couldn't quite figure out what it was. And it finally crystallized for me is— Giving myself focused time back. I probably get a few hundred every day. I get a few hundred emails, Slack messages, WhatsApp messages, whatever, only a fraction of which really need my prompt attention, but a few of them do. And so, you know, I was in the habit of, you know, probably 30 times per day, every time my brain sort of came up for air from a task, I would check my email, check my Slack chat. You know, I had about 5 apps I would rotate through. Which is lots of opportunities for me to get distracted by seeing something I actually didn't need to see for a few hours. And so a much bigger and more complicated project has been, and like it's really about 5 subprojects, is something that pulls in all the email, Slack, you know, Signal, WhatsApp, and so forth, feeds them through, and the pulling in is a big complicated mess with lots of integrations, including with some services that didn't really want to support that, like WhatsApp. Then there's like one line of code to hand each message to an LLM and say, is this urgent or not? And I've accumulated about a one-page rubric, you know, gradually exception by exception. And then the timely ones pop up on a second monitor that I purchased for this. I've gone like 40 years of engineering without a second monitor, and I finally bought one to have a rolling view of my calendar and And this like list of urgent messages. And the idea is that's, those are the only things I need to look at other than whatever I want to be focusing on right now. So it's sort of an attention firewall.

I like that phrase. And I love the idea that you had a very practical and experiential sense of what you were trying to accomplish For me, it's less time in the chair, more time exercising, and more time outside. But also, I need to sort of square that with not losing track of what I'm doing as well. So I think that's really helpful to try to get concrete in envisioning, like, how is my life going to be different if this project is successful? Lest we fall into the optimising the agent setup for the agent setup's sake, which I think is obviously very alluring for—

Well, I've forgotten because this was weeks ago or probably a couple of months ago, but there was a period where I was spending a lot of time on Claude code skills, and that, somewhat to my surprise, has settled down, and I'm sure it will unsettle again. But I'll also say I was probably 3/4 of the way building this attention firewall thing, Before I understood what I was building. You know, I was very much fumbling in the direction of something and like had to do a lot of iteration before I was able to crystallize it. And, you know, I think that's a lot of what we're all collectively, you know, we're all fumbling our way. There's no playbooks here, right? I think you said something about this a minute ago. Like, we're in the middle of a Cambrian, we're all doing our individual components of the Cambrian explosion and making things up as we go along and like only understanding in hindsight or mid, cite what we're doing. And, you know, that I would say that won't settle down for a long time, except of course, actually it will never settle down because by the time it would, there will have been the 5 new inputs and, you know, we'll be in the next round of chaos.

One big question I have on both of those projects is how are you handling context? With the newsletters, there's sort of a, question, I guess, of any individual newsletter. You could say, will this be of interest to me? Here's my interests, score it on that basis. So how are you handling context? And there's obviously multiple dimensions or layers to that, but at least 2 that jump to mind are like, how do you make sure that the information is being filtered effectively against what it is you care about, want to learn about, et cetera? And the other is sort of When you have so many things coming in and there's so much duplication, how are you managing to cross-reference these things against each other to try to tease out like what is genuinely new from each bit?

Yeah, you know, it's interesting. I'm not. It's the dumbest possible thing. It literally, like this tool literally just takes the full text of each Substack post or podcast transcript, dumps it into an LLM and says, summarize this. And like, Yeah, I've done a little bit of iteration on the exact prompt, like, you know, what kind of information I want it to surface and what I don't, but it's completely static, no context at all. Last year, I'd, you know, I'd been sort of envisioning this a little bit, and I had— was thinking in terms of, yeah, like, I want it to know everything I've already read so it can identify what's new and so forth. And I didn't bother with that in the first iteration. and I haven't been motivated to do anything about it. So, it just gives me the summary, again, with a little bit of finesse in like, you know, I think the prompt says things like surface any novel ideas, but that's going to be novel against the LLM's training data, you know, what the LLM from first principles thinks is novel. And obviously, it would be better if it could, you know, contrast that with what it knows I've already read. And to my surprise, it, it just hasn't been like, I know what I've already read. I can skim a one-paragraph summary in about 10 seconds, and that's efficient enough.

Hey, we'll continue our interview in a moment after a word from our sponsors.

I've got a text.

The summer might be almost over, but a new bombshell has entered the villa. Meet the voices of Deepgram Flux TTS. I'm Drew, low-key casual.

I'm Alexis, an upbeat morning person. I'm Haley, always cheerful.

Flux TTS has some real personalities that are ready to speak.

You can interrupt, pause, and keep talking without losing the plot. Fancy a chat? Come try all the voices free through September 12th at deepgram.com/keeptalking.

Terms apply.

You know, there's a whole other side of this where, you know, the road I, a lot of people are going down, uh, at least seemingly, and, and I have not gone down at all, is actually like responding to emails or just kind of, you know, acting on the content of my, at least digital life. And I haven't gone down that road at all. I know a lot of people are, so, and partly because it just feels a little daunting, both in the complexity of the project and the security concerns it brings in and so forth. And I'm sort of conservative by nature. Like, I don't like to use a tool unless, like, I really know I can trust it and I understand what it's going to do. So that does feel like that's a, you know, a pool I'm going to have. I feel like it's gonna be so worthwhile to jump into that I will eventually find myself forced to, but I haven't gone there yet.

I'm not conservative by nature in general. I'd say I usually, um, my attitude on computer security has been historically borderline negligent over time, but this has changed my mindset. Like, I definitely find myself being— I've always in the past been like, who really, you know, do I really have anything that valuable, or I'm not like a big target. Who cares? But now it's like, I don't know, as I give an AI access to not just everything that I've ever written, but everything anybody's ever sent me, I feel like a certain kind of duty of care to guard their information that they trusted me with and never really thought that it was going to be going into some AI that hadn't even been contemplated at the time that it was sent in. I've had my same Gmail account for 20 years. So that definitely has caused me to slow down and take a more deliberate approach to try to figure out, like, under what circumstances do I give how much access, and when do I want the thing to kind of draft something for me versus when do I think it might be more helpful for it to try to play the role of an assistant. And I'm definitely still feeling my way through a lot of that stuff as well. But it is striking that I'm like compelled to— I feel compelled to take my time when usually I would just sign up and let it rip on just about any other software experience in the past.

Yeah, and I hear you. And it's a great point about, you know, your data is also other people's data. And It's, yeah, like the trade-off between security and utility is really building, right? Like, you know, yeah, like it's getting really, you know, the, you know, OpenCLAW and every, or I don't even remember what we're supposed to call it now.

Yeah.

And I keep waiting for a shoe to drop there. I keep waiting for the stories of people really regretting their life choices around, you know, and like, There's been the one or two anecdotes that circulate, but hardly anything. And you have to think those are juicy stories. And if people were really getting burned by prompt injection or whatever, or, you know, or just, you know, you know, bots, you know, deleting production databases, deleting your email history or whatever. Again, there's one or two stories, but it, you know, I've only seen a couple. So, it's hard to explain why. things aren't— there haven't been more problems other than maybe it's harder to exploit this stuff than you'd think. And even, you know, it's not a— you don't have to have malicious problems. You can also just have sort of overeager bot problems. And, you know, I think probably part of it is, you know, the model developers and the tool developers are working, you know, they're adding classifiers and whatever. Like, they are— like, I haven't followed it closely, but it feels like every new model report card says, you know, we've, you know, reduced prompt injection susceptibility by another, X percent or whatever. And like, somehow we're keeping in front of the— ahead of the curve. And yet at the same time, everyone agrees that fundamentally this whole system is totally insecure and broken if you trust it with anything. And so like, I don't understand how that tension is gonna resolve. I think this is, you know, gonna be very interesting to keep following. But, you know, meanwhile, you know, I kind of feel like the guy in Raiders of the Lost Ark, you know, asps, very dangerous, you go first.

Yeah. I mean, even this is happening at every level, right? I mean, the model level, obviously with Mythos, we see greater utility, greater security concerns. When you give access to tools, it's the same thing. Even upgrading software has suddenly become this kind of weird damned if you do, damned if you don't, because you're like, well, there's supply chain attacks that are starting to get scary. I've seen people say, you know, don't update anything until the package is 7 days old. But then the flip side of that is, if we're patching critical vulnerabilities that just got discovered, you want those patches fast. And so, like, now do I have to, like, keep track of all these dependencies? Like, what a nightmare. So yeah, I don't know. It is weird. I think you put your finger on something there that is like, I very much associate this style of thinking with you of kind of Coming at— it's in the title of the Substack, Second Thoughts, as well— coming at these core questions from both perspectives. And just a lot of times, seemingly, we end up kind of confused. Like, there's not great answers. We can probably touch on a number of those things as we go. But is there— I mean, are we just in a— are you personally just in a total state of— confusion when it comes to, like, give— I mean, I think the security vulnerabilities are pretty real and pretty obvious. And we've even talked about this a little bit offline in terms of, like, why aren't we seeing more phishing scams? I feel like I have seen a little uptake or uptick recently in a couple sophisticated, seemingly scammy emails coming my way, but not nearly as much as one might have thought. And the same thing is true with, like, election deepfake things like, you know, that didn't really happen. Do you have a story for any of that, or are you just kind of still confused about it?

Mostly confused. You know, I think you could argue that there's just sort of a lot of precedent that sort of bad guys can be just as slow to innovate and adopt as anyone else. And You know, like, it's easy to— you know, it's easy to point back at, like, you know, in the— I think it was in the '80s that— do you remember the Tylenol scare? There was this incident, I think, in the early '80s where someone, if I remember correctly, put cyanide in a couple of pill bottles or a small number of containers of cyanide on store shelves. I don't remember whether they were tampering with them in the— like, walk into the store and tampered there or exactly. how it happened, but a handful of people fell ill. I think there were a couple of fatalities. And, and to this day, that's, that's why so many products you buy have the safety seal on them, little plastic wrap or whatever. And anyone could have done that at any point in the last however many hundred years. It didn't happen until the '80s, and then it happened once. It could still happen. There are plenty of things you buy at a store and put in your mouth that don't have that safety seal, whether it's produce or, or whatever. You know, there's just, you know, in every walk of life, there's sort of so much low-hanging harmful fruit that I don't entirely understand why most of these things don't happen. I'm glad that they don't. And so, you know, one theory is that just, you know, whatever complex sociological factors are going on there continue to apply here. Now, that's a little hard to completely believe in because we also have a lot of sort of opposite case studies in cybersecurity. Like, you know, if a server is vulnerable to a well-known attack, some script kiddie is going to get in there or some bot is going to get in there. Like, you know, there are definitely systematic bad things that happen on the internet. And, you know, going back decades, you know, I think the statistic was like, you know, if you just took an unpatched installation of Microsoft Windows and connected it directly to the internet, it would be owned within 5 minutes or something. You know, that goes back way, way, way back. So I don't know how to reconcile those 2 patterns of the world. And if anyone can shed light on this, I think that, like, I think it's a very important question to ponder, but I don't actually have any insight into it.

One kind of AI-specific story that I find at least somewhat compelling is simply that if you're good enough at AI to scam people effectively with LLM-generated phishing attacks, you could probably make honest money in a similarly easy way because there obviously is a tonne of demand from legitimate businesses for people who can make it work reasonably well. So I find that at least somewhat persuasive for the moment.

There might be a lot of—

It does still kind of remain a mystery overall, I think.

Yeah.

Hey, we'll continue our interview in a moment after a word from our sponsors.

I've got a text.

The summer might be almost over, but a new bombshell has entered the villa. Meet the voices of Deepgram Flux TTS. I'm Drew, low-key casual.

I'm Alexis, an upbeat morning person. I'm Haley, always cheerful.

Flux TTS has some real personalities that are ready to speak.

You can interrupt, pause, and keep talking without losing the plot. Fancy a chat? Come try all the voices free through September 12th at deepgram.com/keeptalking.

Terms apply.

How would you like to show us some of your stuff? I think, um, the extension or the kind of corollary of my intro is people should watch other people use computers more. I feel like in particular folks who started programming in an era where there was very classic editors and lots of command line and cron job type of stuff seem likely to me to have a kind of advantage or a little bit of a different paradigm that now suddenly becomes more relevant again as we're all using command line tools. And most of us, myself included, have very limited familiarity or attraction to that modality before. So I'd love to just peek over your shoulder for a minute, if you wouldn't mind, and learn a little bit about how you actually use AIs, and I guess even more generally, like, how you use the computer.

Sure. Yeah, let's go for it. So, okay, share screen. So I thought I'd start with showing off a few of the applications I was talking about before, and I've got 'em all lined up in tabs here. So this is that feed reader I was talking about. This is current LiveView, and there's very, fundamentally, there's very little to it. You know, this is basically the only screen I use. It's the dumbest possible thing. It's just a list of posts. And it looks like we're getting demo disease because, yeah, so the last few posts, I must have just broken something, and they, you know, they should all get, summaries within about a minute of coming in, but for the last hour they haven't, but the older ones have them. So this is the summary I was talking about. And again, so, you know, kind of my workflow here is whenever I have a little idle time and I want to distract myself, I run through this and I see, um, you know, I pick, I might go through an order or I might jump around and, you know, I look at, you know, is this something I want to read? And I can either click on it and that'll just open the original. Or the main thing I'll do is I'll go over here and hit archive. This is, you know, example of iteration, something I thought I would want to do and I almost never do. So this is an icon that will open a Claude session with that article in context so I can ask questions about it. And I actually forgot this feature was there until just now because I haven't been using it. But something I will do sometimes. So overview. This is also precomputed. It's also just a simple LLM prompt, summarize this post. But it's a different prompt that generates a longer, about a one-page summary. And it specifically says, tell me the novel ideas here, tell me the notable evidence. So I basically gave it prompts that correspond to these section titles. And mostly I either look at the first summary and I'm either going to read the article or I'm not. But if I'm either on the fence or like I feel like it's not worth reading, but maybe it is worth like getting a little— like this is my sort of 80/20 alternative to reading the post. And so that's pretty much it. There's a bunch of other stuff in here, all of which is just like infrastructure to keep the tool working, almost none of which I would've bothered to implement if I had to do it instead of an AI. But so like it, you know, every day it dumps a backup of the whole thing into D2, which is Cloudflare's version of S3. You can view the backup. You know, I would've never in a million years bothered to, and like, and this is a pretty printed view of the information in the backup. I would've never in a million years bothered to implement a pretty printed backup viewer. But, you know, that was a one sentence in one of my prompts and, you know, this helps me be reassured that the backups are really working. And yeah, it's a bunch of— and yeah, this was like a bunch of machinery for like importing all of my Substack subscriptions, which involved vibe coding a bookmarklet to like rip apart my Substack subscriptions page HTML, 'cause there wasn't another good way to get the list of, you know, my Substacks out. You know, just there's all these, like the feature set is much longer than I would've bothered to implement myself, you know, which is one of the interesting, Things I've found. But basically, you know, this is the whole tool. And then the one thing I'm gonna show you screenshots instead of the live thing, 'cause the live thing can be sensitive, is the— this is basically the attention firewall. I named it Radar for the old M*A*S*H character Radar O'Reilly, who, you know, was just always there the moment you needed him with the information you needed before you needed it. So this is the 3-hour— this is, What is on, but can you see my mouse?

Yep.

Yeah, so this is what's on my second monitor. So it's a 3-hour view of my calendar. And another theme here is like you can just customize everything. So this is not actually my entire calendar. I've given it rules about like some, like there'll be things on my calendar that are just to block off time. Like it's not a thing I'm gonna do. It's a warning to others not to book that time or things like that. Or it's like my wife's calendar that will show up in my Google Calendar view. So this is the idiosyncratically distilled, filtered version of my calendar with a bunch of shortcuts. Like if I wasn't missing this call to do the podcast, you know, I can go right here and without even opening the calendar entry, that's the button to join the Google Meet. That's the button to open my private notes of what I would discuss in this meeting. And that's the button to open the shared document that— and the team we would all be in during that meeting. So these are all just little vibe-coded rules. Like, it knows if the calendar entry has this title subject line, that that's a recurring meeting we have internally. And this is the doc I always want to have in front of me when we're on that call. So just, you know, lots of little idiosyncratic things like that. And then the other half of it is the, you know, the attention firewall. So These are the classifications of events. A lot of them, you know, like urgent and midday are zero because it's easy for me to stay on top of those now. And so for each one, it's, you know, it's kind of like what you'd see, the inbox view, but with a summary on each one. And, and if I click on one of them, I get this ugly little toolbar that's full of keyboard shortcuts. And again, idiosyncratic, like forward means forward to my wife. because we're on a lot of shared, like, you know, Amazon and PayPal accounts and stuff. And I'll get, you know, notices that actually she would care about. So one button, like, you know, forward and archive. And one other theme here, I'm pretty fast and loose in the way I develop this stuff. I like everything. I have no staging environment, everything. Like whatever automated tests my exhortations have caused Claude to build, which I don't know, It says it has a lot of tests and it says it runs them, and I kind of believe it, but I just push to production all the time because I keep the stakes low on all this stuff. Like, all my messages really live— they're where they've always been in Gmail and WhatsApp and Slack. This button, like, if I want to reply, I can do lightweight replies here, but if I want rich text formatted reply or anything Even slightly complicated. This means move it to my Gmail inbox, but it's always been in Gmail. This is just a label change in Gmail. So if this totally falls down, if I, if Claude has the bright idea to delete my production database or whatever, everything's still where it's always been. I just lose the nice interface to it. And by the way, that's never happened yet in the couple of months I've been working this way. Feels much longer.

Knock on wood. Yep.

And then you can see like every one of these tabs is like some other part of the toolkit I've built. You know, I don't know how much of this we wanna go through, but there's just like, it's so easy to build tools. And so I just keep adding to the pile.

I'm interested to go through some more at least. And 'cause I do think people, again, just benefit from seeing what other people do and get inspiration from it. Maybe a couple questions to kind of, Prompt you as you go a little deeper. When you're coding, is it all Claude? Is, is everything Claude? Is there a place for Codex in your workflow? Are you keeping this— when you talk about like all the originals are still in their place, but is there a sort of shadow database that you're pulling them into and then there's also stored there? Or are you just kind of doing a runtime call to like get the most recent stuff? And, oh, I had one other one. Oh, and why Cloudflare? Well, you know, what is it that you like about Cloudflare specifically?

Yeah, so I'll answer the last one briefly 'cause otherwise I'll forget. I think basically I had some long conversation with, this was a key decision at the beginning, kind of where to host. And so I probably, I'm pretty sure I hit Gemini, ChatGPT, and Claude and kind of, you know, like, I wanna build a set of web apps. I want, you know, I'm an experienced developer, but I don't wanna get my hands dirty and I'm kind of rusty and this is the kind of stuff I wanna build. Don't care too much about cost because it's only one user. And like, I gave it a whole bunch of context. And what stack should I use? Hosting provider, programming language, frontend, backend, CSS library, whatever. And I let all 3 of them spew, and then I like pasted each output into the others and had them critique. A level of, like, a level of effort that I don't normally bother with. And by the way, I've, I've more recently built a skill to automate that. which I had forgotten I'd built and I need to use that more. We have such an embarrassment of riches of both tools other people have built and tools we built for ourselves now. But anyway, so I did all of that and basically that rose to the top. Also, like, I had kind of the idea in my head that anything Cloudflare does, they probably do pretty well. I wouldn't defend that, but that's just sort of my spidey sense from things I've read on Hacker News over the years. So Just kind of, yeah. And I've been happy with it. Like it's, you know, sort of just, there's enough of a toolkit there that it has process hosting, it has cron jobs, it has queues, whatever. It has just enough of a toolkit that has databases to do everything I want, but so much less complexity than something like AWS and like mostly pretty cheap for small-scale usage. And then, yeah, so why don't I, I'll like just kind of speed run through the suite here and then talk about the development process. So this is a tool I very specifically pointed at a Hacker News comment thread, and it has this some whole workflow that it reads the linked article, reads all the comments, identifies themes in. So this is, I pointed at, I haven't read this what we're looking at yet, but you know, this morning I pointed at the 4.7 announcement. discussion on Hacker News. These are themes that emerged in the Hacker News comments. People complaining, as people always do, about an existing model getting dumber. You know, should you trade? I mean, you can see these here. I haven't read them. But so it identified themes, gives a summary of the article, a summary of the overall comment thread. And then I can click on one of these themes and see all of the comments that it fell under that theme. And a comment can be tagged under multiple themes. So I don't use this all the time, but it, you know, sometimes it's handy when there's, 'cause you know, those threads can be very heterogeneous. There'll be, you know, a section that's really interesting and another whole section that's about something I don't care about. And you know, it's hard to find the part and it's all entangled together. And by the way, again, you know, idiosyncratic, you know, like there's all kinds of integrations that I've built 'cause they're so easy to do. So here, Yeah, I'll open up Hacker News. I'll click on something and I, I don't know whether you can see, yeah, it looks like you can see this. So this is a Chrome extension where I can, it says saved in Notion, but that the word Notion there is kind of out of date. This takes the current page and I can add it to my to-do app that I'm gonna show you in a moment. I can add it to the reader app that I just showed you, or I have like certain sections of my Notion. tree are whitelisted into here. Mostly, I have a page full of subpages of notes on blog topics I might write about someday. And so there's a whole little, like, set of heuristics for, like, kind of what gets shown here, and I can type and filter and whatever. And if I throw this into Reader, then there's a special rule that says if I put a Hacker News discussion thread into the Reader queue, It will feed it into this tool. And, you know, this takes a few minutes. So in the background now, it's building a summary. Okay, Speedrun. So this is a view of my Gmail spam folder sorted by recent. Like, I actually don't remember the sort order, but it's not by date. It's by these columns in some order, which I find is super handy for skimming through it. Like, for whatever reason, I get a lot of emails that are addressed to me@aol.com, which, spoiler alert, is not my actual address. So when I'm scrolling through this, it's very easy to, you know, jump past that entire— this is just a little idea I had one day. It'd be easier to read, plow through my spam if it were sorted. So implemented that. This is the other thing that goes on the second monitor. It's the status of each of my coding agents. So blue, means it finished a task. And this is based on— there's like 8 different pieces to this held together with, you know, baling wire and whatever. So there's a little web app that's running this webpage. There are Claude Code hooks that are reporting to the web app when status changes. If I click on one of these buttons, it will open that terminal tab, which involves AppleScript and something called Hammerspoon, which is a macOS utility that I don't even know what it is, but Claude told me to install it and I believed it, that somehow glues these things together. And there's a Chrome extension in here somewhere. Oh, so that I can do screen shortcuts. I hit Ctrl+J and, oh, you can't see it here. This only works in Safari, which is not the window you're looking at. But if you can't see it, but there's a Command key I can hit and then these light up with numbers 1, 2, 3, 4. And if I type that number, it'll open that terminal tab. The red ones are there's no active agent, but in my to-do list app that I'm gonna show you in a moment, I have to-do entries for that app. So it's also integrating with the database from that other app. And there's other statuses for the agent is busy working or, or it needs to ask me a question. So that's that one. And that's like, there's not much to this. That, that's my entire agent management toolkit. It's just this one little thing with the color-coded buttons, but it, Again, it's sort of the attention firewall thing. I don't need to look in on my terminals all the time. I can glance over at this on my second monitor and my brain has already internalized the color coding and I know whether anything needs my attention or not.

And just to make sure I understand the structure of that, 'cause that's maybe something I wanna do. I don't really use hooks much at all. This is, I think hooks and cron jobs and these various things are like, they're not instinctive for me. But so the, tell me a little bit more about the hook. Like it's sort of when Claude finishes, it reports to this app in the cloud what its status is.

Ex—

exactly. That's it. And this is the only use of hooks I'm making, I, that I can remember. And I don't understand much about it. You know, I, I basically told, like I had a little conversation with Claude at some point. I want a view of which agents are busy and blocked. Let's brainstorm ideas. I don't remember whether it suggested hooks or I did. It said, yeah, I can do this with hooks. It's not perfect. Hooks don't quite get enough information to do a perfect job of this, but it works well enough. The short version is, I've got this cloud app, it exposes an API, so the hook is just runs curl or something to hit the API. And so in real time, and then there's a push note, server push notification from that web app down to this webpage. And so I get real-time little color updates as the agent starts and stops.

Is this like a bunch of different repositories? I mean, I assume this code lives on GitHub as well. How do you organize it into Probably Ashish is about— Mono repo.

Yeah. So there's about 15 projects. You know, each app I've been showing you is its own project. And by the way, I deliberately broke it down into projects, A, to keep the context manageable for the coding agent. And it's not like I tried different approaches and found that this was just my gut. So my gut was like microservices, basically, like keep each project as small as possible so the context is manageable. Which was probably more important in the ancient days of January when I started this than it is today. Each has its own GitHub repo. Yeah, they're on GitHub. Each has its own database backend and so like, and its own like little project or whatever in Cloudflare. So they're somewhat isolated to one another, but they talk, they invoke each other's APIs a lot. And I really, I hadn't really planned this, but it turned out they're all on my hard disk. It's actually on my Mac. All of the Claude coding is in a Docker container. So I run Claude in dangerously skip permissions mode, but it's in a Docker container. All of these projects have their repo directories next to one another under one home directory in the Docker container. And so they can see each other's code. And sometimes at first I would like, if there needed to be an API update, I would like ask the one agent to like tell me what I should tell the other agent and I would like manually copy it. But then I realized I can just like, Okay. Reach over into that other app, give it the API, and use the API or whatever.

Yeah, that's interesting. I think I'm following a fairly similar pattern, although probably in keeping with my generally less structured personality, I kind of start with everything in one repo. But then over time, especially if I want to share something, Then I'll split it out into a separate repo. So, it's kind of anytime I want to just try something, it kind of goes into the sort of personal private monorepo. But those things are at this point promoted.

How big is that monorepo?

I mean, the big thing is for me context exports. Because I have gone basically 5 years back into all these different channels. And that has added up to roughly a gigabyte with all—

Oh, so you have a lot of content in that repo?

Yeah. And I'm not sure if that's quite the right way to do it either. But I did want to have some backup. And I was like, where, you know, where should I back this? It could be Google Drive, or I don't know, I just decided to go with actually putting it into GitHub. It's like a, you know, large file LFS or whatever that's called. Aside from that, it's not that big. You know, I, I would have to run a script to know how many lines of code or how many tokens or whatever it is, but yeah, it's manageable besides the, uh, yeah. Besides what I call the deep context database.

Yeah. Yeah. So yeah, the, the repos that I've, my GitHub repos only have code. All the data is in Cloudflare databases. People talk a lot about like the agents really understand how to look at file systems. And it's like, that does sound like a good approach, but I, I just haven't tried it.

I actually have a— it's a SQLite database that just runs locally. So, it is probably similar in terms of like, you know, it's a query action for the agent. And another thing that I do that's kind of similar is I have sort of the top-level Claude file point to other Claude files so that if it does need to kind of know what's going on in another project, it can still go see that. I'm trying to mostly make that kind of one directional because some of the projects that I do split out that I want to collaborate on, like one salient one is tools for the production of the podcast that started off intermingled with my personal email and history and communications and all that stuff. And I was, okay, well, I want to share this with a couple people so we can work together on it. Obviously I don't want to share my entire email history. Not because I don't trust anyone, but just 'cause that's, you know, what the people who've sent me those emails I think would want me to do. And so splitting them off, then I'm like, okay, how do I want Claude to— I don't think this is like robust security, to be clear, but if I start Claude in the main one, it has pointers to the other one. But if we started in the other one, it doesn't have obvious pointers up. It could, you know, look around and get outside of its immediate view, but it's at least not like instructed to do that. And then also if somebody else clones that separate repo, then they're not gonna have the main one anyway. So it, and that, you know, on, on their computer, it, it just wouldn't have that kind of access. But, okay, cool.

Yeah.

Helpful. And then, yeah. And so then you asked him like, am I mirroring data or what? So yeah, I, so I built one of the projects is called Mirror, by the way. I'm only just now realizing that everything I've been talking to, you know, half the listeners will only be listening and not seeing. So I'll, I'll describe a little more. So this is just listing all of the different data things I've integrated with to pull data out of. So it's pulling my Google Contacts, Google Calendar, sorry, Contacts, Google Calendar, Gmail, WhatsApp, Slack, Twitter, Google Docs, Signal, and SMS messages off of my phone. And so this is, again, you know, the kind of thing I would've never built myself. There's this whole status dashboard of, you know, how many records have been imported and how's that going and whatever. I don't even look at this much. Like, I only used this briefly when I was first getting it working. But so the idea is like, now I have this, I'm building up this rich database of all that content that I can use for context. I haven't actually done much with it other than driving the real-time inbox view. But, you know, and there's a whole, you know, web UI for searching and, you know, viewing backups and all this toolkit, which again, I used briefly while I was troubleshooting to begin with, then it's done. There's like—

Is that real-time view, by the way, is it polling? I mean, because I've done some of these integrations and some of them have been quite painful. I use Beeper Desktop to try to like aggregate a half dozen or so of them. That's also kind of painful. I feel like Beeper Desktop is, um, good idea, crashes a lot for me, and I don't— I haven't gone as far as getting pings in. So, if I was— if I want to take inspiration from this and I'm like, oh, how do I get to a real-time view when what I currently have is a batch process that I run a couple times a day to kind of update my database? What have you found in terms of what actually works well for getting closer to real-time, if not fully to real-time?

So, this has been far and away the hardest part of everything I'm presenting and a lot more grief, like the far and away the biggest time sink. And there's 8 different solutions and, you know, just each one was different. It is generally pretty real-time. And I, you know, I pushed to get that 'cause I wanted to have this attention firewall inbox view. So like Gmail, like there are great APIs, they're a pain to use, but that's Claude's pain, not mine. And so yeah, there's some kind of real-time sync on, I think the calendar, is also like, yeah, there's like a— there's a sync. Google provides a sync API for the calendar. I don't even remember about contacts, but that doesn't need to be real-time. WhatsApp, there are a bunch, as it sounds like you found, there are like lots of bad solutions for WhatsApp, and it's hard to find a good one. But it turns out, and I hope that no one from Meta is listening to this, but I mean, you know, what I'm about to describe is not a secret, or I would've never found it out. If you install WhatsApp Desktop on your Mac, and I imagine on Windows, It is obviously syncing down all of your messages. Turns out it stores them in an SQLite database, which is not encrypted, so you can read it. So you're just— I'm just piggybacking off of WhatsApp's own real-time sync. There are a lot of WhatsApp integration solutions out there that actively talk to some internal WhatsApp API, and there's a lot of stories about accounts— people getting their accounts banned, and other stories of people saying, I don't know what you're talking about, it's fine. You know, so like I don't know exactly how dangerous it is to use, you know, those kinds of hacks, but I didn't want any dangerous. But this is, you know, there's no way for WhatsApp to know that you're looking at its read-only access to its database file. So I have just a cron job that runs probably once a minute, I don't remember. And this is on my Mac. So again, you know, there's pieces of this everywhere. There's on my— there's inside the Docker container, there's outside the Docker container, there's up in the cloud, there's on my phone. So this one is running on my Mac outside the container, looking at the WhatsApp SQLite database. Slack is another API integration. Twitter is— Twitter is the worst, hardest one. I found some very shaky fly-by-night— fly-by-night's an exaggeration, but some very kind of shady borderline-looking service that will let you query Twitter. And I don't know how they do it and I don't want to know. It's not like reading my feed, which would be nice. I have to manually pull every individual who I follow, but that's only about 80. And so this is the slowest one. It probably like, it rotates through them about once an hour. It would start to cost noticeable money in API fees if I were pulling more often than that. And this was like glitchy to get working, but they're all working now. Like, you know, it's not like they break every day. Google Docs again is an API. Signal, I don't remember. And SMS is an Android app that's watching notifications on my phone. Signal might be similar.

The new Twitter API, I think, is gonna be probably a big hit for them in as much as it is a quite painful one to try to make work. I had a version of Twitter that was basically using a headless browser with my login, and it would sort of try to use the cookie that I had most recently logged in with for as long as possible until it expired. And then you'd have to kind of re-auth and whatever. And that worked like, okay, it wasn't terrible. Certainly wasn't super reliable. But now I'm like, you know, I might just sign up for the paid API. And even though it's gonna, you know, cost me a few.

Yeah.

sense to do a few things, it's probably—

All right. I didn't, I didn't realize they had an official API that would work for this. That didn't come up in my research. I might've been overlooking it.

It's been, I think maybe the last 2 or 3 weeks, and I'm not even sure if it's like fully GA yet. But the big difference between their previous version and now is there's not a big fixed cost to enter. It is, it's kind of priced to I think it's honestly pretty— it's probably pretty effectively priced for them, where it's like, it's not super cheap such that you're going to want to go really mine data, or if you do, you're going to have a pretty good reason for doing it. But it's also not so expensive that if you want to get your own feed a couple of times a day, that you'll be afraid to do that. So I think they've landed at a pretty good spot that will allow people to have access without without them having to fear that you're gonna run off with the entire fire hose, what have you.

Yep, yep, yeah, that makes sense. Yeah, so if I were doing this again, I would use that, and I may switch to it, um, like the next time this one breaks. And then just kind of run through to-do list. Like, there's stuff in here, repeating event, like repeating reminders and all kinds of things, but they're like idiosyncratic to me. But at the end of the day, it's not that complicated. Um, this is just like a little deep, you know, I talked about Wanting to— I want to put myself in a position where I can be kind of cavalier in the development and just move fast and break things, knowing that there's nothing too valuable to be broken. The to-do app would be the one where I'd be most sad if I lost the database. So this generates a backup every 5 minutes if there's been a change. And unlike all the other backups, which are just dumps into D2 file storage, this is live synced to GitHub. So I wouldn't even need to do a restore. I can just— open github.com, navigate down and see my to-do list, a static version of it, if the to-do list app ever glitches. This is the payload for the Twitter integration. So it's just a feed reader with just like a bunch of little details like deduping retweets and other things like just to make it, and like it auto-expand, like instead of only showing the first 140 or 280 characters, it like auto-expands everything. So just like little fit and finish Things that I prefer relative to the default behavior of the Twitter app. There's some infrastructure under this. And one of the things, by the way, this, I looked at this morning, it was broken and I just told Claude to fix it. Let's see if it worked. Yes, it did. All of these apps, part of how I support like development velocity is all of these apps feed into a logging service. And I found it annoying enough to configure with commercial services that I just built my own, had it build its own dumb little logging service. So this is just an SQLite database hosted on Cloudflare. All of the backends log there, all of the browser frontends, the JavaScript code logs there, all of the Android apps log that, like everything logs there. And there are like massive exhortations and code review rules about this in my Claude.md. That'll log errors, that'll log you know, every time you modify the database that, you know, and so then virtually 100% of the time, remarkably close to 100% of the time, if there's something wrong, hey, this event's on my calendar, but it didn't show up in my calendar mirror view, or, you know, or like, you know, or just, you know, whatever thing. Like, how come, how come those summaries, like none of the new, blog posts that have come in since noon, have a summary. I can just tell it debug this and it has the data to figure out what went wrong. I use— there's a very popular Claude plugin called Superpowers by Jesse Vincent. One of the skills in there is— I'm pretty sure this is his from there— is called systematic debugging. So I just tell Claude system— you know, /systematic debugging, one sentence description. And from my Claude MD, it knows it has logs. It's been very loudly instructed to look at the logs, not to guess, but, you know, look for evidence. It works so well. Yeah, if I had like one concrete, here's how to do agentic coding good piece of advice for people, especially, you know, sort of personal projects as opposed to in the context of, you know, a professional software development operation where you have production practices and so forth. But if you want to go to the trouble of doing anything more than just typing prompts into Claude, if you go like, if you're gonna do one sort of infrastructure thing to make it work better, it's have everything log including the front end. Like all of the moving parts should generate logs in one place. It's annoying to have to build that place yourself and there's probably a better answer, an off-the-shelf answer, but I'm just not sure what it is. And then, Vigorously remind Claude that it doesn't have to make guesses about what's going on.

It can go look.

Yeah, cool. There's, I mean, there's a couple, there's quite a few, but the amount of frontend that you—

I think that, you know, there's more, like this is a summary of all the cron job, gives me a daily summary of everything in the logs. But, you know, those are some of the high points.

So how many, when you're actually sitting down to code, how many agents are you running in parallel? I'm getting the sense that it is all Claude and—

It's all Claude. It's kind of like, in some ways it's a very simple vanilla setup. I'm using the, the built-in term, like macOS Terminal app. I basically have one window with one tab per project that I'm, you know, I, I open the tabs when I need 'em and close them if I haven't been working on that project for a while. And, and then if there's Anything going on in that project, either the agent is working, the agent is blocked on me, or I have an entry in the to-do list for that project, then it has a bubble here. And so when I'm work— when I'm coding or when I'm Claude-ing, which is not all that often these days, like it was more— went through a period of about a month or two where it was pretty vigorous, like maybe 15, 20 hours a week. mixed in with other things and mostly pushed to the weekends. Nowadays, it's maybe more like half an hour a day. But when I'm doing it, I'll get— I'll be bouncing anywhere from 0 to 5 parallel agents. And I'll just kind of look at my to-do list and like, oh, like I've got active to-dos for like, you know, I made a note about something I was annoyed in, in this app. And I've had a longstanding idea for something I wanted to add to that app. And I just noticed a bug in that one. And I'll like just throw out, you know, I'll tell this one systematic debugging, fix this bug. And I'll tell this one, You know, here's a small feature. I have another skill that I don't even remember whether I wrote it or it's part of superpowers, but it's just, here's my description of what I want, figure out how to do it, deploy it, commit it, push it to GitHub, like end to end. Like, don't ask me any questions unless you really need to. I have a different skill for, you should probably like have a conversation with me about the best way to go about this. Yes, I can get up to 4 or 5 of those running. One kind of process change I went through halfway through this journey is we all, everyone talks about you gotta keep your agents fed, like, you know, token maxing, like, you know, if the agent's waiting for you, you're wasting time. And like, I kind of went down that rabbit hole for a while and it, it's very stressful. And then, and then I realized, wait a minute, like the agent's not important, I'm important. And that kind of wasn't true at first because when I first started Claude coding, I had trouble using more than one agent at a time. I was initially only doing one project, and I didn't want all the complication of work trees and 3 different things going on in the same code base and whatever. So there really was a sense that I had a long list of things I wanted it to do, and I was mostly sitting around waiting for Claude. When I was engaged, when my brain was in coding mode, I spent— I was mostly waiting for Claude, and so it was a real shame to let Claude be idle. Once I worked my way around to breaking things into multiple projects, I don't spend much time waiting for Claude anymore, either because I have another project I can tell it to work, I can start preparing its prompt for, or I've like gotten good enough at, okay, while it's working, I'm going to go, you know, read my— RSS queue or whatever. So now I think in terms of I'm optimizing my time, not Claude. You know, I'll give Claude its next prompt when I'm good and ready, you know, when it's not an interruption to my mental workflow. And having this little status bar and having the, you know, the view of my inbox of, you know, whether there's anything urgent I need to look at and, you know, having all those tools makes it easier for me to kind of put my attention where I want it to be, whether it's on give Claude its next prompt, figure out Claude's next prompt, or something else.

Do you mind sharing your token budget these days, or token spend?

Yeah, so I don't know, which means it's small enough that I don't have to know. So I'm on the $200 Claude plan. I recently signed up for the $200 ChatGPT plan, mostly 'cause I wanted ChatGPT Pro, not 'cause I was feel like I tried Codex once, like a month ago. I gave it one prompt. I don't remember what it was. One coding prompt. It behaved abysmally. And I said, nah, that is not at all a fair test. Like, you know, update, you know, take that as a base update of 0.002. Like there's no update there, but I just, Claude was working well enough that I wasn't motivated to push harder. But I'm really loving ChatGPT Pro. I don't abuse it for the, like, I signed up for it for, I forget, some meaty research question, but I'll abuse it for like, I'm driving up the San Francisco Peninsula to meet a friend. My friend's taking public transit over from Berkeley. Where should we meet for lunch? Like, do a whole Claude, you know, ChatGPT Pro's worth of investigation into that. It's really handy actually. But in terms of coding spend, it's, it's all fitting within that. And I keep getting, I have Claude set to like purchase credits in $30 increments. And I've been getting the, you just purchased another $30 more often recently. Like maybe I'm getting them a, it's up to 2 or 3 times a week, which is enough that I should look at it. I think that's mostly generating all these summaries and stuff. And again, I'm really profligate. Like I'm using Opus to generate these dumb little summaries and whatever, 'cause like why not? It's not that much money. And, but I do have the, like if I hit my pro, you know, subscription limit, then like flip to burning API tokens. So maybe that's some of it, but I don't think so. The long answer, like long story short, I think all of my coding fits in the $200 plan.

Yeah, gotcha. Cool. Any, uh, any other tools you would shout out? You mentioned the, um, Superpowers, which I've heard of but not used, so that's— that goes on my to-do list coming out of this conversation.

Yeah, so yeah, so Superpowers is a very nicely, very elegant little package of Claude skills. It might be ported for Codex also, I'm not sure. That's the only thing I've really installed, like set of skills I've installed, and I can't— yeah, nothing else comes to mind. Again, you know, like, yeah, like there's all these weird little utilities that Claude has sort of grabbed on my behalf, like that hammerspoon thing, which is, again, you know, some deep, you know, like deep, like, you know, Hacker News geek labor of love, I think, having glanced at it for 3 minutes and not really knowing what it is. But it's one of these, like, labor of love, incredibly arcane, toolkits that has just like 9,000 integrations through AppleScript or something with like anything you can automate using a macOS API. And, you know, Claude installed this entire giant thing just so I could click a button on the Juggler app and it will open a terminal tab. But so like— I was wondering how you did that. I'm not sure what they are, but in terms of things I interact with directly, it's really bare bones. It's the built-in OS terminal app and it's, Claude code and the superpowers. And I feel silly about that. Like, there's such a wealth of tools out there, but I keep not encountering reasons to try anything more.

What I do these days often is when I see something that people are excited about or, you know, whatever, that's the viral thing of the moment, I will ask Claude to dig into it and see what about it or what ideas in it might be useful to us. So rather than a direct install, it's kind of like a scout it out action first. And then rarely is it like, okay, actually, yes, let's pull that in. And more often it's like, oh yeah, there's a couple ideas here that were good and we can kind of apply them to our own. tower of Jell-O in our own way and probably get 90% of the benefit of the core ideas. And I feel better about that also from a security standpoint, which is so out of character for me to even be thinking about that at every turn. But I do feel like running it through that filter gives me confidence that I'm not doing something totally crazy.

Yeah. Oh, that's a great point about security. And Yeah, like, yeah, that seems like a very good approach. And I have a whole document, like a list of links piling up of things like that to look at. And I never get around to looking at it.

What's still hard?

Are you—

I mean, you said kind of those, some of those gnarly integrations of things that don't want to be integrated with. And that's like hard on the level of like, you're borderline hacking software that doesn't want to be— I don't know, WhatsApp sounds like it's kind of open to being read that way, but it's not like, It sounds like that's not even documented, right? So that's like definitely a—

Yeah, definitely. Um, Claude was doing a lot of spelunking in the database schema to try to, you know, figure out like, and what's, what's a reply versus an original message? And like, how do you go from like a user ID to a username? And like, yeah, the integrations were far and away the worst part. And I, and I have to think, you know, and like, of course, There are all these solutions for this, but people are, first-party providers are building MCPs and other APIs. And there's all these, there's Tasklet and all these other services out there that are, and Claude, Cowork, and all these other, everybody's building the integrations. And I have to think that's where a lot of value is gonna be. But if you're, yeah, if you're just coding your own solutions, that's been really the hardest part. For me, as someone with a lot of software engineering background, but rusty and no like, you know, kind of specific experience with the details of all, you know, everything that's going into these apps, you know, there's a lot I did to set up Flare and hosting and like connecting, you know, understanding how to connect an Android app to a, you know, through a Docker container into a web app and everything, which wasn't hard 'cause I know how all that stuff works. I don't know how it would've been otherwise. And then, you know, I think, but the, the main thing that's hard is not getting complacent. There's always the next level of productivity. And it's, you know, like it's so hard to unlearn the habit of the world is the way it is and your tools are the way they are. And like every now and then maybe there's a new release or you might look into a new, maybe I'm gonna switch from Google Docs to Notion or whatever. But mostly, you know, your toolset is just static and just like unlearning or unlearning the idea that you have to adapt your workflow to the tools rather than the other way around. And then figuring out what to do with it. Like, another thing I've always assumed I would do and I haven't done is something that works more with the detail of, so like, you know, I've got this sort of, unified inbox. But, you know, so, you know, one email I get every day is the San Francisco Chronicle daily newsletter. And there's like, it's this long scrolling thing full of news items and ads. And I don't wanna see the ads and I don't wanna see the food updates and I don't wanna see, you know, the, the, you know, the sports articles unless they're about the Warriors. And, and like, but I do wanna see this and this. And I'd always assumed I would write some filter to show me just those parts and like multiply that times, 50 other examples of email that I get regularly, and I haven't gotten around to doing it. And maybe that's a good choice that I'm like subconsciously deciding that it'd be more trouble than it was worth. I think probably not. I need to like motivate to, and like, but it's a little like, I don't wanna have to build 50 features. So I have to come up with some conceptual framework for how I can get it to the point where I just sort of say 1 or 2 sentences about each one to Claude and Claude can figure out what to do with it in a way that I will trust that I'm still seeing the information I need to see. And I just like haven't motivated to take a step back and, and I probably need to dive in and fumble around and do it wrong the first time. And like, and then I'll, you know, eventually I'll settle in on a good way of doing that. So it's that push to actually take advantage of all the new opportunities and do the exploration. Another habit I've been having, like, My whole software engineering career, I always worked very hard to think things through, understand the problem upfront, measure twice, cut once. Really understand the problem, make sure you've pulled out all the details of the use case, go and talk to the person who wrote the spec to find out what they forgot to put in, think through the 4 different ways you could structure the code, do all that work upfront. So then when you have to do all the long tedious work of writing and testing and debugging the code, that you kind of get it right, right-ish, the first try. I think that's totally wrong now. Like, the just dive in, do it wrong, throw it away, redo it is so much the better approach now. It's not at all my nature. And so I've been having, like, relearning that also is what's hard for me.

Do you have thoughts on when to revert? This has changed for me And it's probably gonna change again. We just got 4.7 in the last few hours. So recognizing it's a moving target, I don't know, 6 months plus ago, I would've told people that it's often easier to get the thing to work once in, or in one shot than to have it fail and then figure out how to fix it. So I used to advise if it's not working and you're kind of stuck, if you're like looping at all, Revert back to the last known good state, try that prompt again, maybe say, here's kind of a bit of what went wrong last time, and you'll probably have a better chance of getting it to work that way versus trying to get out of that stuck state. These days, I don't feel like that's as big of a problem. I haven't found myself doing that recently. Do you have rules of thumb or best practices for when you would press on versus fall back?

It's interesting. I almost never find myself falling back, which is shocking, and I don't particularly understand it. I think some of that is good prompting. The superpowers package, there's— I forget the names of the individual skills, but one of the main themes of that is there's a skill in there that basically gets Claude to do a good job of thinking things through and run the big decisions. past the user before it moves forward and so forth. So some combination of the models are getting really good. And I didn't even start vibe coding until 4.5, Opus 4.5, and then pretty soon it was 4.6. So I've been working with very recent good models. That's my experience. So between recent models, that Superpowers plugin, and I do— I never look at the code. I don't need, like, all this code is TypeScript. I don't know TypeScript. I literally never look at the code, but I do think about the high-level decisions that Claude is making. And so somehow between just the models being good, the prompt, and me helping it ward off, like, avoid a few false paths, I almost never end up just giving up and reverting. You know, I definitely think, It has happened. I can't remember specific examples. Definitely, it is a thing that a model can just wind up thrashed down a bad path, and then reverting is a good idea. But yeah, it just doesn't happen very often. Also, these days, I'm mostly making incremental changes. There was a lot of big push a month or so, 2 ago, when I was building all those integrations, importing from WhatsApp and whatever, and laying out— these days, mostly, I'm just add a new feature, add a new feature. It's not making architectural changes. And it just doesn't go that wrong.

Maybe last practical question, and then we'll like zoom out and try to take stock of what all this means. Any voice or mobile strategies? Like for me, again, I wanna get out of my desk, I wanna be on my feet instead of my butt. How do I do that? It is still a work in progress for me, for sure. Any tips in that direction?

Yeah, so I mean, I see people talking about, you know, like the remote control or whatever in Claude and like all these, and like terminal emulators in their phone. and stuff. And those articles go in the pile of really good ideas for improving your vibe coding skills that I pile up and never look at. And then I realized, what I was saying is I don't want to optimize Claude's time, I want to optimize mine. When I'm out for a walk, and I do that too, I get out for walks a lot, both physical and mental health, I think it's really good, and to give yourself brain space for deeper thought. I'm a big fan of that idea. But so, you know, I don't go out for a walk so I can get 5 more prompts in. I go out for a walk so I can be in a different headspace. And so what I've settled into that I really like is the— what I will do that's sort of work-ish while I'm out walking is I'll have some project I'm working on. Maybe it's the next blog post I wanna write or, you know, next piece of analysis I wanna do. Maybe it— but maybe it's the next like app I wanna build in Claude.

Mm-hmm.

I'll just like, it'll be percolating in my head while I'm walking, and then I'll pull my phone out, and then I'll just dictate a brain dump of ideas about whatever it is. So if it's an app, you know, okay, so I want, you know, I'll just ramble out feature lists and design decisions and design questions and, you know, whatever, just brain dump of high-level thought about it. And then this is a simple trick I, somebody I read somebody talking about that's worked really well for me. So you just take that brain dump, and you paste it into whatever LLM and you say, organize this. And, you know, you pretty much just literally say, here's my brain dump, like, turn this into a Claude code prompt. And I usually then won't even bother to read what came out. Like, I've found, like, it's usually good enough that I would rather wait to note it. Like, hey, you did this wrong. Like, it's more efficient for me to let it go through all the work and then notice, like, no, you misunderstood my brain dump. I wanted, This to work this other way, rather than rereading its 3-page cleanup of my brain dump. Yeah, so that's what I do remote. And what I've said, like, this feels ridiculous, but the actual toolchain there is I open the Gmail app on my phone, I click compose, I type my own email address, I click in the mail body, and I click the dictation button on the built-in keyboard. And I am sure this is not the best way to do it, but it's always there. It always works. I don't have to worry whether the recording recording got saved, you know, so that's my process.

Cool.

So one thing I'm gonna do after this is take the transcript and run it through a planning session and say, you know, go figure out all the good ideas here that can apply to our setup. And I definitely think there are gonna be several at least. I mean, getting some hooks going, I'm struck by the fact that I have built Almost no custom UI for myself at all. A lot of skills, but basically nothing that sort of presents things to me. And I'm realizing now, like, that's a gap and a half, you know, even just in terms of like producing the podcast. I've started to do more. This is one of the classic paradoxes I find of AI where I'm like, I wanted to be more efficient. What I ended up was doing more in maybe the same or maybe even a little more time in some cases, because one thing I'm doing now that, like, I do get some positive comments on, but mostly nobody cares, is making a custom song for every episode. And that there's a time factor there where I got to listen to the song to figure out which of the versions I like. So it's definitely not a time saver. I do enjoy it. I make art, YouTube thumbnail type stuff, and make clips, video clips to help promote the thing on Twitter. And I realized I should have a UI where I can go look at what's been produced. I'm like still digging around file systems and sometimes I'm like scrolling back in the terminal to go find the links that it, you know, printed out above. And looking at your setup, I'm like, boy, was I dumb for not thinking of something a little bit more like that sooner. So this is why I wanted to do this, cuz I think I, I was like pretty sure that there was gonna be a few. Not even like technical unlocks, cuz like I probably don't need, uh, there, there's almost nothing, you know, probably that we've talked about here that Claude can't figure out how to actually implement for me without even, you know, needing to, um, get into the details of what you've done. But just the conceptual sort of scales fall from the eyes moments are quite useful.

Building your own UI is really powerful and I feel like most of the energy is not there. You know, there's Claude Code and there's Cowork and there's, you know, Codex and like, you know, Gemini, you know, like Antigravity and whatnot. You know, so there's all these different tools for coding and for more general agentic workflows. And there's Cowork and the other tools that integrate into you, but they're all things you throw commands at. And that works really well for a big task. Go write this app or go, you know, reformat these 800 PDFs or whatever. But it doesn't work very well for tiny actions. Like you were just talking about, you know, go find this one file or whatever. Like you're not gonna tell— it's annoying for you to have to go and open the file directory and navigate down and find the file, but it's not really gonna be any faster for you to prompt cowork or whatever to do that. So when you've got all the little tiny fine-grained things that we all do every day, it's hard to get value out of agentic tools, whether they're command line or otherwise. But where you can get value is in a UI. And yeah, so I think that's sort of the other, like we're all like, we're getting like everybody's leaning into these tools for verbs, go do an action. But you know, an app is sort of the noun side of it. And that's less explored.

Chrome extension also is another one that jumps out at me as like, mine's probably different than yours, but there's definitely gotta be. And I took this note from Zvi too, but I still haven't acted on it 'cause he's also got a, Chrome extension that he uses to like, I think also collect notes and reformat and, you know, move things around. Yeah, I know.

But he mentioned that and, and you can't, yeah, I mean, his is probably more sophisticated than mine. You can just imagine exactly what his, you know, seeing the format of his newsletters, you can imagine exactly what he's doing. And I'm sure that's a big time saver. And yeah, I have, you know, I have more, you know, bunch of little Chrome extensions. Like I've got, every time I join a Google Meet, I need to switch accounts cuz it always opens on the wrong account. And then I always wanna hide my own window. And then you need to acknowledge that your video's still being sent. There's just like 5 buttons I have to click every time I join a meeting. And I built a Chrome extension that clicks the 5 buttons for me and it saves me 15 seconds, 3 times a day. Took a couple minutes to write. It's awesome.

So let's do that zoom out. I don't know this story too well, but your last company was acquired in 2021. Correct me if I get any of this wrong. And then you basically had created a better under-the-hood technology that a bigger company that had more customers wanted to use to rebuild its product for the future on the new and improved technology that you had developed, right? So then you became, in the acquiring company, responsible for actually making that happen. These projects I've never done one personally, but they're like legendarily excruciating, right? Because it's like, you got a zillion features. There's, you know, it's like I have a 100-year-old house, and I sort of feel like it's a similar thing where anytime— I always try to use a light touch around this house, because the second you peel one layer, you know, you don't know what you're going to find underneath. And a lot of it's better off left alone. So that, I'm sure, was maybe a rewarding slog, but I'm sure it was quite a slog in many ways. How would that be different today? Would it be very different, a little different? Like, how does— I mean, we're doing all this is like stuff that everything we've talked about so far is stuff we wouldn't have done before. But if you're going to go back and do that, something that you did actually do before, you know, that was like a big priority, how would you expect that to play out differently now?

Yeah, it's a great question. And the thing I can say most for sure is I don't know. Like, I'm sure me trying to talk about it now versus actual, like, I would find more ways that it would be different if we were actually doing it. But the thing that comes to mind is that was a, yeah, I mean, that was a very much a like, don't move too fast, please don't break anything kind of a project. So yeah, we were swapping out the data storage and query engine from the flagship product of this company that was getting ready to IPO If there was one thing they did not need, it was disruption in the production service. And, um, you know, if they were a security company, they just very briefly, they had an endpoint agent that was installed on, you know, millions of customer laptops and servers and other computers and ingesting data from all those things and integrating with a bunch of, you know, cloud services that their customers were using. So pulling in massive streams of, you know, I think trillions, you know, certainly many billions, probably trillions of events per day and like needing to store those for months and be able to query them rapidly and so forth. So, you know, serious piece of distributed systems engineering had to work at high reliability and, you know, kind of accuracy. And we were swapping the query engine out from under it. What we would not be doing today is, you know, kind of vibe coding the actual implementation of that. In a year or two, I wonder, because things are moving really fast, but not, not today. But a huge part of that project, and exactly to your point, was there was just so much we didn't understand. So you had 2 different teams. There was our team that had built the new engine, and there was the acquiring team that had built the old engine and had built the product, or rather suite of products, on top of the engine. And so, no one had a full picture. And actually— and there was a lot of the existing product, the acquirer, it had accumulated a lot of sort of croft and arcane knowledge and sections of parts of the system that no one understood very well, walls that hadn't been opened up in a couple of years and whatever. And so, we had a bunch of— And so, for example, one of the things we were being asked to do early on is estimate, come up with a budget estimate, how much Should we plan? We're going public. We have to provide forward-looking financial projections. What are we gonna be spending on AWS next year after we've done this port? And we were like, I don't know how much data and how many queries. And then we needed a lot of details on that, right? You know, a query that looks at 1 day of data is very different than a query that looks at 30 days of data. A query from a huge customer with a lot of data is very different from a query from a small— a complex query is different than a simple query. And we couldn't get that. It was very hard to get that information. No one really had it. You know, maybe there were one or two senior engineers who kind of understood that stuff, but they were really busy and couldn't take time to answer our questions. So there was a lot of trying to get access to the right systems, manually poking around, looking at logs and running queries and understanding what is even going on here? What is the shape of this data? How often did it— what are the query patterns? How, you know, And, you know, and then lots of detailed questions underneath that. It would've been so amazing to throw Claude Code at this and say, here are 100 questions I have about the data. Go write 100 tools and run 100 sets and do 100 investigations and give me 100 reports and then give me a distillation of those 100. And like, look at all of them and tell me which of the 100 reports I should probably read. And come up with a cost estimate and explain to me how you arrived at it and let me poke holes and figure out where you've— none of that work touches production. If that goes wrong, it's on our responsibility to not trust it, but it's not going to take the system down. You can much more just let Claude try or whatever agent. I keep saying Claude, whatever tool, let it try things. Data gathering. This is a theme I've seen come up, a number of people talk about where There are so many things around the production system, internal tools to let you look at your own logs, look at your own data, see what's going on, look for bugs, look for patterns that are not production-critical systems, 'cause they're just informing you, the human user who can still apply judgment. And that would've saved us a lot of time there. And we would've done a lot more of the investigation. You know, it's just, it's hard to do that that stuff manually.

How would you hire differently today if you were trying to build a software team for the Opus 4.7+ era?

Yeah, I mean, this is another— I'm sure I don't know. And like, we're all sort of iterating and learning very rapidly. But, you know, one high-level theme— 2 themes I'm going to point out. One is, you really— I suspect what you really want now are people who can think outside the box. 'Cause there's no box anymore. You know, the box is established practice. There are a lot of engineers, you know, who've made their careers, you know, I've read the design patterns book, I've read the like manual, like the style guideline for React or whatever. Like, I know, I know this is a good database design pattern and that's a design database pattern. You know, we have decades of industry experience telling us this. You know, I've learned to understand when that pattern is good and when that pattern is bad. I've seen it all before, and or I've read from people, studied from people who have, and like I know the right way to do things, the established way, and I'm going to do that. And that's all out the way. I mean, you can keep doing that today, but then you're not taking advantage. So we're all you know. I think you said something earlier in this call about how we're all figuring it out. We're all you know doing new things. We're all you know downloading, you know telling Claude did install gestalt. extract Gestalt summaries of what everyone else is doing. Like, it's all new. Oh, I should build— I should start building custom UIs. I hadn't been doing that. Like, what's the— you know, there's no best practice that I'm aware of. Certainly no, you know, established best practice with a history behind it of how to vibe code your own UI tools to your custom workflow. So we're all making it up as we go and all kind of idiosyncratic to— no one's distilled the big patterns yet. So— what makes sense for me isn't gonna make sense for you, 'cause you have different tools, different needs, different situation, different skills, different preferences. And there may be some pattern that's gonna underlie a lot of what we all want, some set of design principles, but no one knows them yet. And so it's— and we're all— people are posting things, but then they're all obsolete a week later, and they're not at the sort of level of depth and— quality of, you know, universality of, you know, what's kind of emerged, gradually emerged over decades of, you know, more traditional software development. So yeah, being able to think outside the box, being comfortable navigating without a map, I think is really important. And then this, I'm just guessing, is that communication skills are really important because, you know, one thing I'm not— I don't know what it feels like to be doing professional production, running a software company today, 'cause I'm not doing that right now. But what I hear from the people who are is that what used to be a team is now a person. And what used to be 3 teams is now 3 people. And so, because everyone's running their own suite of agents, and so the— The amount of, coordinating with other people. Each person needs to do a whole team's worth of coordinating with other people. And my guess is communication skills are important. And that may also overlap with, you know, like there's some overlap with being a good communicator with another person and being a good communicator with an agent.

Yeah, I would think quite a bit, certainly in the software domain in particular. Yep.

So what do you think?

One thing you've written about notably is the importance of threshold effects and phase changes. And it seems like we've passed some important thresholds if we're already at a point where what used to be a team is now a person. I'm looking back at all the tabs that you showed, and it's like that In some sense, it seems bullish for infrastructure. It's bullish for GPUs, it's bullish for Anthropic, it's maybe bullish for Cloudflare. It's probably bearish for the app layer broadly, because one thing you didn't see is any SaaS app, right? In any of that, it was all just your own stuff.

Do you think we're—

have we already passed thresholds where the sort of software engineering jobpocalypse is inevitable? Or do you think there are still thresholds to come? Or maybe we're just like, somehow there's gonna be so much demand for software. I have a hard time seeing that one, given how easy it is to create one's own little nest. But like, what do you think the future of the industry looks like? And are there any kind of key moments or key unlocks that you're still looking for before you would kind of change your expectations?

Yeah, great questions. I don't know. Yeah, like this is one of the big questions, right? Like the number of engineers we need per line of code is plummeting. The number of lines of code is soaring. Does that add up to more jobs or fewer jobs today, in 3 months, in a year, in 2 years? Yeah, I don't know. I do believe we are gonna be building so much more software. that it is possible that Jevons paradox is gonna maintain its strong track record and number of coding jobs will go up, not down. The nature of the job will certainly evolve. And almost to the point where maybe a few, you know, some years down the road, the accurate statement will have been just like in the transition from horses to cars, I imagine, you know, number of— transport-related jobs increased, but they were not at all the same jobs. You know, maybe that basically software engineering is dead and full-stack product manager is the giant new job market or something. Or, you know, maybe that in some way it's different jobs and it may not always be the same people doing 'em. And so I don't know, but I think it is very plausible, maybe even probable that the number of jobs isn't gonna go down, at least until, you know, we may get to a point where just like, all the jobs, or at least all the non-physical jobs start going away 'cause like AI is just better at everything. Short of that, I wouldn't be surprised if there's still lots of people somehow involved in, you know, human beings involved in software development. But, you know, but since, so what does that mean for like SaaS companies or whatever? Like you didn't see me running any SaaS apps, partly just 'cause I didn't bother to show that part. You know, people have seen Slack before. So I'm still using Gmail, I'm still using Slack, I'm still using WhatsApp, but I'm mostly using them as a backend service. I spend less time in their UI and I care less about their feature set. And so this is gonna be really like, this is another, this is a tug of war that's going on right now. And we're seeing this play out, right? Like a lot of companies are flirting with cutting off API access. You know, Slack has talked about this, you know, companies don't want you Using it, they don't want your agent, your Claude, or whatever third-party agent in their app. They want you in their app. You know Amazon restricting shopping agents and whatever. And so like there's a real tug of war here. It's in the service provider's interest probably to keep you in the app because then you're more kind of locked in. You know there's you know there's more you're getting more deeper value out of the app. You have more of a relationship with the app. But it's in the user's interest to be able to use the best agent for the job, whether or not that's the you know, first-party agent or a third-party agent. And, you know, I don't know how that tug of war plays out. You know, Salesforce may decide to really lock down API access to Slack. So you, you're like, your Claude can't talk to your Slack, my VibeCoded app can't talk to my Slack. And if they do that, their customers may like roll over and spend time in native Slack or they may move off of Slack. And, I have no idea how that's gonna play out and it's gonna be differently in a lot of different domains. There is gonna be, until several revolutions from now, the, you know, until things have really changed a lot, we're not gonna be vibe coding our own private infrastructure. There's gonna be a need for, you know, Amazon S3 and Google Spanner and like the big data backbone apps and probably the next level up from that, you know, the Slack and the Salesforce and whatever. Maybe not Salesforce as a UI, but Salesforce as a place where data lives. Or if not Salesforce, then at least certainly the, yeah, the like broad database level, like that stuff is not gonna go the way of, is not gonna go Vibe Code until everything is, until just, you know, you have a, you know, Jeff Dean, you know, on the command line. And that'll be a while. I'm being very vague because—

Long neck Ilysses.

That's not the next shoe to drop. And then, you know, you also, you, you talked about Threshold.

How close is Mythos to Jeff Dean though? Do you have a— how close is Mythos to Jeff Dean?

I only know, you know, you know, what they said in the model card and whatever. I think still not very close. Actually, let me come back to that. I want to talk about threshold effects for a second, then I'll come back to that.

Sure.

I don't know what specific next thresholds I'm looking for. I can't guess what it's going to be, but I was thinking about this a little bit. We all talk about AI capabilities and like, oh, 4.7 just dropped, what new thing is it going to be able to do and whatever? But we don't All of us in our day-to-day, as we're engaging with these tools and as we're living through the impact of these tools on the world and the environment we're in, whatever, we're not really engaging with model capabilities. We're engaging with a whole complicated ecosystem of what could the model do if you prompted it well, and how well are people prompting it, and who's using it and who isn't, and what second and third and fourth order implications does that have? And I think this is where the threshold effects come from. You know, like, the ChatGPT launch was a moment. MultBot was a moment, not because that was the day that the scaling curve crossed some threshold, but because that was the contingent moment when capabilities had gotten far enough and there was a little bit of an overhang, and then someone happened to do something and they happened to do it in a way that caught people's attention and Yeah, I think it's— maybe it's a little bit like there have been coronaviruses circulating in bats that, like, have an R of 0.9 in human beings. Like, every now and then one will cross to a human being and maybe infect 2 or 3 more people and peter out. And then one day there happened to be one that had an R of 1.1, and, you know, it infected a couple more people and a couple more, and then it was evolving and getting better at spreading in humans. And so that was a threshold effect where suddenly COVID exploded through the human population. But only because of the dynamic effect. It wasn't about what that virus did in one person. It was about the way it went from person to person to person. It was the forward-evolving system of people and virus that had tipped over into a new domain. And that's just— and like on a more complicated level, that's what's happening with AI. You know, like a lot of people— like I'm part of a big cohort of people who started Claude coding in December. Because 4.5 was out and we had— and it was the December break. And yeah, like a lot of this, like it wasn't just because of like a specific new capability. It was, you know, I was reading other people saying that 4.5 is worth trying.

So going back to Mythos and Gifteen, and maybe generalizing the question a little bit, obviously we haven't— either we haven't or we're sworn to secrecy in our access to Mythos. I haven't. You may be sworn to secrecy.

I haven't.

Here's another quote that I pulled from Second Thoughts. AI's impact is the product of 8 separate factors: pre-training, post-training, inference compute scaling, agent scaffolding, app design, user aptitude, workflow refactoring, and adoption. All 8 are advancing, some quite rapidly. They will multiply out to a— that will multiply out to a blistering pace of change. It's a little silly to be speculating too much about a model that we haven't seen, but it does seem— I think the thing that stuck out to me the most that did have me thinking, like, geez, I don't know, maybe it is kind of entering Jeff Dean territory, or at least could be sort of a major Jeff Dean multiplier, was the Nicholas Carlini statement that he'd found more bugs in the last few weeks with Mythos than I think he said the entire rest of his, I don't know, 15, 20-year storied career combined. So maybe I was asking the wrong question because it's less a substitute and more of a complement or more of a multiplier effect. But so to juxtapose that quote, I've also kind of felt at times in other things that you've written and in some conversations that you've been, like, sceptical of the most singularity is near kind of takes. Where are you now? Are there places where you still see reason to be meaningfully sceptical? Or are you kind of like, yeah, we're headed to Geoff Dean territory at some point, and it's just a question of exactly how many generations and how many months that may be?

Yeah, we haven't seen the model. And so I'm going to say this. I'm going to talk about why I still have some scepticism. And I want to say before I forget, it's getting a little harder to maintain the courage of my convictions here. But the way I think about it is, like, people, like, the tug-of-war of conversation is, you know, like, it's either like, no, like, these things, like, still aren't that capable. Like, you know, like, singularity is really, you know, like, AGI and whatever is, without quibbling about definitions, is really far off. Or are you kidding me? Like, you know, Mythos found vulnerabilities in everything. And yeah, Nicholas Carlini said that. And, you know, like, look at all these amazing things they're doing. So it's like you either have to say the models are amazing, we're basically at AGI, or the models have all these flaws, we're so far from AGI. And what I think is the models are amazing. we're still far from AGI. The point is, well, and I— that term has gotten so useless, but so, like, you know, something that's, you know, it's Geoff Dean and it's Terence Tao and it's, you know, pick your whole, like, something that's all the smart at all the things and in all the human ways, I still think we're quite a ways from. Now, as someone said, you know, I think it was Helen Toner, you know, long timelines aren't what they used to be. And, you know, Quite a ways might only be like 5 years now, which is a remarkable thing to say. But I still think it's some distance away. That can be the depth and range of human capability, the kinds of discernment and judgment and depth of pattern recognition that goes into human expertise in whatever field. I think is we've— it's hard to remember how much that encompasses. And so we see Mythos that can just— is an absolute beast at identifying certain categories of security flaws and, ooh, big new— like big scary new step, actually piecing together working exploits for many of them. That's really impressive. Score a— put 300 points on the board for models. But I think this, all the smart at all the things is like 50,000 points. It's just we forget how far off that still is, in part because all the easily— you ask it a question, it has an answer. It's hard to dig down deep enough into the model now to get to the point of lack of capability. You're not going to get there in a chat session. You're only going to get there in some really serious work. I think there's a little bit of a blind spot. We don't ask it to do the things it can't do because it can't do them. We don't see people talking about it do them. I find it harder and harder to articulate what I mean, but I just have a strong sense that there are whole categories of things that AI still really can't do that we just don't even think about when we think about AI. A lot of it has to do with context. AI couldn't have a dinner conversation with my wife for me, obviously for 100 reasons. Some of that is just dumb reasons, like it doesn't know the history. But I think therefore we don't also think about all the really subtle capabilities that it's probably missing. That was kind of a silly example. But again, I find it frustratingly hard to come up with good examples of what I'm talking about, which makes me worry a little bit that I'm full of it when I say this. But that is my gut.

I find it harder and harder to come up with reasons not to think some sort of singularity is near. Obviously, the physical world is lagging. So, I mean, that's like one Massive category. Although, you know, you look at some of these, it's harder to evaluate. We don't typically get our hands on the actual humanoids in the same way, but some of the videos are starting to look pretty impressive. I think they're probably still, you know, a ways away from coming in and doing plumbing in my 100-year-old house, but they can handle rough terrain anyway at this point. That's pretty clear.

You know, I'll tell you a few specifics, some questions I have, because yeah, it's Yeah. Again, it's getting harder and harder to confidently say that we're not on the cusp of some recursive self-improvement takeoff. 3 specific things I think about, let's see if I can remember all 3. The first is clearly the models are roaring through software engineering and into other AI R&D, like experiment design. And so forth. One thing I just don't understand is how deep is that rabbit hole? What I would love for someone who really knows, you know, there's about a thousand, probably about a thousand people in the world who could do a good job of this, but most of 'em are in a position where they can't do it. What is, and maybe it's even a smaller number, what really goes into making the models better? Okay. We know there's a lot of just coding. We know there's thinking about ways to tweak the learning algorithm or the data curation or whatever. We know there's designing RL environments. But what really do you need to know? What's the set of skills to build an RL environment? What's the difference between a junior developer and someone who's been building RL environments since the beginning of the— project that became O1 and has several years of experience at it. What taste and judgment and discernment of what makes a useful RL environment that's really going to push the model's capabilities? What subtle judgment do you need there? What other things? Is there just some other big aspect to it, like knowing how to manage? Is it still important to have the 10,000 human experts weighing in on a bunch of different subjects? Is there some very high-level skill of what questions to ask the human experts and how to manage that? How much is feedback from people using the models and what are the high-level skills in making that happen? Like, what is the list of capabilities that have to be checked off for the models to really automate their own improvement? And are there sections of that that don't look very much like continuing to get better at coding? I don't have a feel for that. And I wish I did. You know, I wish we knew more about what are the higher-level and more obscure corners of making models better. So that's one question. Are we— you could tell a story that we're within a year of automating AI R&D. You could tell a story where somewhere in that ramble I just went through, there's some pieces that are going to take significantly longer. I don't know which. Then once you're, like, supposing that hill gets climbed, so now we're going to have agents that are, like, superhuman at coding, superhuman at math, superhuman at all the, like, sort of easy, you know, objectively gradable, whatever stuff. How easily does that generalise to, you know, superhuman at marketing and business strategy and, you know, managing a team and teaching a class and, you know, and just, like, a lot of softer skills and fuzzier skills? And I don't know, product design and physical and mechanical engineering and just like all these other things that aren't physical world tasks but bleed into the physical world or the social world. Like, how easily does that general— like, when we automate AI R&D, are we then going to like slam to the top of all those other skills? Or is there some like AI as normal technology factor that's going to get in the way? And then the third is, you talked about robotics. And I hear a lot about, like, don't get too impressed by the videos because it's a very big gap between a robot that can be scripted to do a predictable thing once versus a robot that can incorporate tactile feedback and have real-time reflexes and whatever and deal with the messy task over and over and over again in its messiness. But so does that mean we've got another Rodney Brooks 30 years or 50 years of whatever, or— And I'm not sure I'm characterising him accurately, Rodney Brooks accurately, but do we still have a long, long, long way to go? Or is the superintelligence that we were just speculating about going to then slam through the rest of those tasks as well?

Yeah, certainly in robotics, a 50% success rate on tasks will not cut it in one's home, nor will an 80%. But we do see the self-driving working at a level that is now the thing that I cite to my dad, who's a sceptic of self-driving, is when the insurance companies start offering you discounts for using it. Now you kind of have to believe the hype, right? I mean, they are very incentivised to be very sceptical about any and all such claims.

I'm a big believer. Yeah. I feel like Waymo at least has arrived. I'm less clear about the other providers, but certainly Waymo has. And that's a very solid existence proof. It's clearly safer. There's edge cases where it maybe isn't, but on balance, I would much rather Waymo be driving than me driving. I would much rather Waymo be driving than the people around me. But again, so that's a question. So that took decades and decades. It took— there were over and over and over again, there were overly dramatically overoptimistic predictions. We're still not all the way there. Waymo is still not in public service in the rain, I mean, in the snow. And there's all kinds of edge cases that haven't been crossed yet. And so one story is, okay, so we've got another 30 years to go on robotics, if you go by that example or something, or I don't know, 30, but a long time. The other story would be that, and by the way, that's still a fairly limited domain and one where, okay, I give up, I'm going to pull over and stop, is a button you're allowed to push. You can push that button more than once. In some ways, it's still relatively controlled domain, limited domain. There's only about 2 degrees of freedom on a car, fast, slow, left, right. That's the number of degrees of freedom in one finger. You could tell a story that That means robotics is hard. Or you could, you know, the other story would be, yeah, robotics is hard, but we're going to have superintelligence and it's going to plough through the hard. And I can't rule that out, but it's not— I don't feel like it's demonstrated.

Yeah. Okay. People should subscribe to Second Thoughts for more of your evolving thoughts as we go. One little aside just to check in on is the relationship between AI and climate. I actually just learned in preparing for this conversation that prior to focusing your sensemaking abilities on the AI space, that you were focusing on trying to make sense of the climate questions. And one of the posts from the climate era of your writing was basically saying, it seems like AI is not going to be a big deal for emissions. And I did an Andy Maisley episode basically trying to make that argument from a bunch of different angles. Have you seen anything? This could be a very simple, like, yep, no big change answer, but has there been any change to your worldview about the intersection of AI and climate?

So I don't follow this as closely as I used to. My sense is I was a little bit wrong because I didn't anticipate just how rapidly basically data centres were going to scale. So, and I was over— and I think I over-indexed. Yeah, like 2 things have changed for me. One, yeah, one is just, yeah, electricity usage from AI has increased substantially and seems poised to really get, you know, like we're, it's an exponential and, you know, every year the exponential is much more dramatic than the year before. And the other thing I did not see coming is, In the like sort of land rush to get more gigawatt capacity for data centers, the hyperscalers are, to my understanding, I'm not following this closely, are really backing off on their climate commitments. There was a lot of really good talk and action, like Microsoft, Google, a lot of the hyperscalers were doing really good things for climate. They were, you know, early purchasers of various forms of clean power, of like of real hard offsets. And they, Again, to my understanding, I'm a little fuzzy on this. There, you know, certainly we have examples like, you know, xAI opening the Colossus data center and just like, you know, trucking in the quickest, least efficient gas turbines they could find. And I think like the other, like the hyperscalers are also doing that as well. Like they're building, you know, getting whatever power they can, even if it's gas or something. I think certainly it seems like there's some of that going on. So those add up to AI is using a lot of power, a lot of it isn't clean power that's not good for the climate. I still think that's, even from a climate perspective, I don't feel like that's the main story. The main story is AI is gonna reshape the world and it's gonna be the like broader effect. Like it's either gonna like lead to advances in material science and, you know, other things. And we're just gonna like, We're going to really, really solve batteries and we're going to like find more and we're going to find ways of like turning all of our messy petrochemical-based chemical processes into cleaner electrochemical processes. And like, you know, if AI increases emissions from electricity production by 20% globally, which would be huge, right? You could also see in that world where it's making overall, the overall planetary industrial base 20% more efficient. you know, like micro-targeting, you know, like robotic agriculture, micro, you know, using robots to kill insects instead of pesticides and like more carefully targeting fertilizer and all these things. So like, it'd be easy to see the reduction in emissions from the rest of the economy outweighing the emissions from generating electricity, especially because, you know, my sense is in the long run, solar primarily and various other clean technologies really are like, we're not gonna be building a terawatt of gas generation capacity. for the terawatt of someday of data centers. Like that's gonna be cleaner. Like the technologies that are gonna make economic sense at scale are gonna be clean. I still seems to me. So in the big picture, in the long run, I feel like it's gonna be probably good for climate, but also just sort of generally like it's gonna completely, AI's gonna roll the dice on the whole world and, you know, climate is, you know, gonna be along for that ride, whatever direction it goes. In the short run, you know, we may be burning more fossil fuels to power more data centers.

Cool.

Thank you.

Great answer.

And that note on rolling the dice with the whole world is maybe a good segue to the last section I had for you, which is basically, what's going on with the Golden Gate Institute? I've had the good fortune of being able to attend The Curve the first 2 times that it's run. That's been a well-loved and much-discussed event, but it's not the It's certainly not the totality of what you guys are up to. So tell us kind of what the mission is and the range of activities and how people can support or find ways to get involved or get on the Curve waitlist or whatever the case may be.

Yeah, so the Golden Gate Institute for AI is a nonprofit I co-founded last year. And basically our mission is, you know, as you said, as we, you know, get ready to reroll the dice on the whole world, As AI, you know, is moving forward so rapidly and having impacts and promising further impacts, and we're all having to navigate this, you know, individuals, consumers, you know, business leaders, policymakers, civic organization, you know, civil society, everyone either has or is going to have some role to play in how AI plays out. And certainly is going to have to be preparing for and reacting to and steering, you know, navigating through a lot of changes, direct and indirect. So there's a lot we all have to collectively figure out, and it's really hard. You know, you and I just had a 2-hour conversation about, you know, how much trouble we're having keeping up and predicting what's going on. And, and that's sort of both of our jobs. It's really hard to make sense of all this. And so our mission at Golden Gate is to try to contribute to that collective sensemaking project. And the main way we do that is, or the problem we're trying to address is that there are so many different pockets of knowledge and expertise and viewpoint. You've got, you know, understanding what's happening with AI is a computer science and machine learning question. It's an economics question. It's a cybersecurity question, it's a biosecurity question, it's a labor market question, it's a political question, it's an education question. And no one person, no one group has all of the even information, let alone all— or perspective, let alone all the answers. And there are all these isolated pockets of people in a particular field or people in San Francisco versus people in Washington, D.C. Or people on the political left and people on the political right, all these groups sort of figuring it out on their own and not engaging necessarily with the other groups. And so, our mission is to bridge those gaps. And we do that through publications like my blog, Second Thoughts, but a lot of it we do through getting people together in person. And you mentioned The Curve, which is our kind of flagship activity. It's a conference we've been running annually Where we get together about 350 people from every one of those communities, you know, just from like every, you know, walk of life and walk of certainly of the, the, the broader AI cinematic multiverse. And, and we've found that, you know, when you get people together face to face, it, you know, this is, it's trite, but it's true. It just, it really changes things. Like people who have been yelling at each other on Twitter. or more often just ignoring each other. They'll have a conversation, they'll find things they have in common, they'll remember that the other person is a human being with reasons for their viewpoints or whatever. And we really see things coming out of this. We see, you know, we've seen, you know, coming out of the conference, we've seen, you know, projects come together and, you know, new working relationships, but also just, you know, more engagement with, you know, just kind of breaking down some of these barriers between the groups. So, you know, what's helpful? I should have a better answer to that, you know, to mind, but You know, we're gonna— we're about to announce the date for our, uh, for this year's conference. It'll be, um, spoiler alert, it'll be October 2nd through 4th. And so, yeah, like, go to our website or subscribe to the blog, Second Thoughts. There'll be an announcement of that. And, you know, read the blog, and if you're interested, and, you know, we're always looking for engagement, you know, people to, you know, comment or reach out. You know, a big part of what we what we're able to do is a function of our network. The more people we're connected with and the more directions we're connected. So for example, it's been hard for us to really connect with some of the communities outside of the US, first and foremost in China, but also every other part of the world. We'd like to build our network more there. We're not as connected as we'd like to be in the robotics industry, just for another example. So, you know, if you're just interested in what you're doing, get in touch, apply to the conference if you're interested. And we're going to— we're very small, but we're expanding. We've been growing the team. You know, we're running the curve this, you know, again this year. We're hoping to run it twice next year. You know, a year is a long time in AI. My colleague Taryn was joking that we probably need to double the number of curves every year going forward. And so yeah, we're, we're gonna be doing more. There's gonna be more opportunities to, to get engaged. Um, so just first and foremost, if you, if you follow us, then, uh, then, you know, we'll be talking about these things.

Cool. This has been excellent. I'm looking forward already to adding many, uh, enhancements to my personal productivity setup based on all your examples. Anything that I should ask or anything you would wanna leave people with before we break?

No, that was great. I was just gonna say this has been a ton of fun and it's, yeah, you know, I, I'm just gonna say, I, you know, I love the podcast. And I, you know, it makes it just, you know, it's been really fun to get to be on this side of the microphone because, you know, you ask really great questions. And these are, you know, you've gotten me thinking about a lot of things. So, you know, thank you. Thank you very much.

That's very kind. The blog is Second Thoughts. Subscribe. Watch out for The Curve coming with apparently doubling frequency going forward. Steve Newman, thank you for being part of the Cognitive Revolution.

Thank you. On a Saturday, mess around a while. Nothing that I have to do, nothing but a smile. Kettle singing on the stove, pen behind my ear. Every little thing I want coming into clear. Idiosyncratic, that's the way I am. Build it like you mean it, break it if you can. 100 little sparks dancing through my mind. Nothing I gotta finish, nowhere I gotta be. Team O-1, Team O-1. 100 hands, I'm having fun. Team O-1, Team O-1.

Team O-1.

Build it up before the morning. I wanna say I'm talking to a track. City is a melody, sky's a shade of blue. Every little drifting thought paints the whole thing new. Idiosyncratic, that's the golden rule. Build it 'cause you love it, build it 'cause it's yours. 100 little feelings rolling down my spine. Nothing left to prove tonight. I'm feeling just fine. Team O one, team O one, hundred hands. I'm having fun. Team O one, team O one, team O one, team O one. Build it up before the morning sun. It ain't about the doing. It's about me. It's about. Building up before the morning sun. Idiosyncratic. Team 01. Don't need a crew, just me and you. Team 01, Team 01, Team 01. Building up before the morning sun.

If you're finding value in the show, we'd appreciate it if you'd take a moment to share it with friends, post online, write a review on Apple Podcasts or Spotify, or just leave us a comment on YouTube. Of course, we always welcome your feedback, guest and topic suggestions, and sponsorship inquiries, either via our website, cognitiverevolution.ai, or by DMing me on your favorite social network. The Cognitive Revolution is part of the Turpentine Network, a network of podcasts, which is now part of a16z, where experts talk technology, business, economics, geopolitics, culture, and more. We're produced by AI Podcasting. If you're looking for podcast production help for everything from the moment you stop recording to the moment your audience starts listening, Check them out and see my endorsement at aipodcast.ing. And thank you to everyone who listens for being part of the cognitive revolution.