AI Is Transforming How We Interact With Computers
2 Mar 2024 · 9 min
Nathaniel Whittemore breaks down Vinod Khosla's argument that AI will flip how we use computers: instead of humans adapting to software, AI agents will adapt to us. Low-latency voice and silent speech interfaces will replace traditional apps, with devices like the Rabbit R1 and Humane pin leading the shift.
Chapters
Today on the AI Breakdown, we're looking at how AI is going to change the relationship between people and computers. The AI Breakdown is a daily podcast and video about the most important news and discussions in AI. Go to breakdown.network for more information about our YouTube, our Discord and our newsletter. Welcome back to the AI Breakdown. It is of course, a long reads episode of the Breakdown. And today the inspiration piece that we will be drawing from is How AI Will Change Our Relationship with Computers. It was published in the Information and was written by venture capitalist Vinod Khosla, who has been one of the loudest proponents for artificial intelligence. The key idea is right there in a subheader. We've always adapted to software. Now AI is enabling software to adapt to humans instead. So I'm going to read a few sections of this and then we'll have a discussion. Vinod writes, There's a lot of buzz about AI hardware and gadgets. I want to discard these terms. They're misleading what you call gadgets or hardware. I see as facilitators of a new era in which low latency voice becomes the primary way users interact. With smart AI, these devices are support infrastructure. This isn't just about devices, it's about a fundamental shift in human computer interaction. Artificial intelligence will spur two fundamental changes in our relationship with technology. The first is that voice, already the most natural interface for human interaction, will become a dominant interface. Imagine latency reduced to less than half a second, a stark contrast to the sluggishness of touch based devices. Even silent voices on the table. Vocalizing commands without a sound. An especially useful option in a public setting like a cafe. Silent voices mouthing the words without allowing sound to come out of your mouth. Technologies to detect such silent speech will allow one to privately dictate in public places without anyone being able to listen. The second revolution is in how apps will adapt to us. No longer will we need to learn to navigate through apps like Uber or complex systems like those of SAP and Oracle. Thus far, we've always adapted to software, learning its intricacies, remembering layered menus and so forth to communicate with machines. Training to use complex apps is commonplace. Now AI is enabling software to adapt to humans instead. This will lead to new types of hardware designed primarily for voice interaction, with the computer learning the human language and the human. Yes, there still might be a screen for certain visual tasks, but the core interaction will shift to voice, be it silent or audible. From there, Vinaud gets into a number of the different projects which are reportedly working in this area he talks about reports of iPhone designer Jony I've teaming up with Sam Altman and how another set of ex Apple engineers launched the Humane pin, and even more, how the Rabbit R1 launch has brought this concept of a new type of interaction to a much larger audience. Vinod also points out that when it comes to how we're going to start adopting these interactions, it's not necessarily just going to be because of work. He talks about the cumbersome workflow he currently uses when hiking to identify plants with an app, which could be replaced by simply pointing a device powered by AI at the app and asking what is this plant? He also makes a number of arguments about why device creators might be excited about a voice paradigm. 1 He says it's significantly more affordable than a traditional smartphone. He also argues that it's simpler and more efficient than typing or touching a screen. He describes how different Rabbit's large action model is to other modalities. He writes, lambs learn to use software the way humans do, rather than communicating with an app through an application programming interface as traditional software does. Imagine someone peeking over your shoulder as you swipe on your phone and learning those patterns. That's a lamb, or whatever it might be called in the future. It's a complete inversion of the traditional paradigm and means that ultimately we won't have to interact with the software because the AI will do so on our behalf. The biggest benefit that Vinod sees to this is actually a deeply personal and human psychological benefit, a shift from a paradigm in which the devices that live in our pockets are designed to distract us, to capture our attention, to keep our attention to a set of devices that are designed to specifically save us time, minimize distractions and get us back to interacting with the real world. Now, when it comes to where this innovation is likely to come from, it will perhaps not surprise you that a VC thinks that it's gotta be from the startups effectively, he says, because this is not the evolution of an iPhone 16 to an iPhone 17, but a total reimagining of the ground up for the human computer relationship. Startups that can think anew and act totally differently are in the best place to figure it out, he writes. Precisely because this next phase is not about hardware or gadgets, but a complete overhaul of how humans and computers interact. We'll be adding devices like Rabbit's R1 to our repertoire. These devices are inventing a human centered and agent based future enabled by new AI technology. It's not just an incremental change. Apple brought us the world of there's an app for that rabbit like devices will bring us the world of there's an AI for that accessible through a voice driven personal agent that can run apps for you. So that's a summary of the piece. Like I said, you should go read it on the information, which is by far the best source of especially breaking news in the AI space. I think shifting the mental paradigm from thinking about this category as AI hardware to something that's about a much more fundamental exploration and shift of the relationship between humans and computers is the right idea. It's why it's harder to imagine shifting behavior to something like the rabbit because it's not incremental, as Vinod points out. One thing that he doesn't discuss is how AI is still a little bit behind where it needs to be for some of these systems to really come into play. For example, we've recently had people get their hands on Grok groq, which runs LLMs massively faster than the experience that people are used to with things like Gemini and ChatGPT. Reducing the latency in such a profound way is going to be a key step towards having natural voice mediated interactions with a device, the rabbit, or whatever else comes like it. The other pillar of this is obviously the agent future. Now it's very clear that most of the big labs are betting on some version of that future coming to fruition. OpenAI has not been cagey about the fact that GPTs and the custom GPT Store were a very first baby step towards something like that. However, if you look at where a lot of the startups talking about agents are, it's pretty clear to me that there is not yet a really strong sense of of which use cases for agents which functions in people's lives. They're most likely to automate and outsource to an agent first. You see a ton of companies trying to do generalist AI agent type activities, and the reason for that is that until people start actually using them, we're not really going to be able to know or predict what people will use them for. I actually tend to be more skeptical of a generalist personalized AI assistant type of future where everyone has a little EA in their pocket that does things for them. But I think that lots of people will find very specific use cases for agents that save them time and become part of their normal flows. Without knowing what those use cases are again, it's really hard to know what the right type of device or form factor will be. There's also an interesting countervailing trend to the future that Vanad is imagining, which I don't think actually contradicts it, but it is worth noting. In 2023, in the wake of ChatGPT, every new AI startup was experimenting with a totally natural language sort of interface where we did away with all the buttons and all the controls that normal software had and instead had you just talk to software. What you started to see towards the second half of last year though, and certainly into this year, is more and more custom purpose AI software suites returning and actually integrating natural language interfaces where it makes sense with more traditional software type controls that are about enabling that particular use case. You're seeing this a lot, for example in the visual realm with design software where if for example a startup or a platform's entire purpose is to help someone create the best product shots, which for example a company called Flare AI is doing well because it's such a specific use case, there are a lot of controls in their software that make more sense for them to give you specific guidance around and interact with like traditional software than to just have a natural language input, as does something like midjourney or Dall E3. Which suggests to me a hybrid future where certain behaviors that are cumbersome, laborious, annoying, inefficient in their current smartphone mediated modality or laptop mediated modality gets swept up into voice controlled natural language controlled agent AI type experiences. But then other things will still be mediated by screens by controls that aren't just about natural language. There will still be software where it makes there will still be software where the trade off to learn complex interactions will be worth whatever challenge it presents. Whatever the case, it's going to be an exciting and diverse and dynamic future and I'll be sharing everything I learn about it with all all of you as we go. For now though, that is going to do it for today's AI breakdown. Till next time, peace.
More from LARRUZ


Ep 881: Faster AI Agents, Fewer Human Coworkers: The Overly Productive Future of Managing Agents? (Replay)


Ep 879: New: OpenAI Presence. Has The AI Customer Service Takeover Finally Arrived? (Replay)


Ep 878: What’s Coming Next: 5 AI Trends, Problems and Opportunities around the Corner (Replay)




