Rabbits New AI AGENT Device Just SHOCKED The Entire INDUSTRY (Rabbit R1 Device)

Presentation (YouTube video, Jan 10, 2024 upload) by Jesse (founder/CEO of Revit) unveiling Rabbit's new AI-powered device R1 and its foundation model. Core claim: move beyond app-based phones by pairing a Large Language Model for understanding with a new Large Action Model (LAM) that can execute actions across arbitrary user interfaces. Demonstrated capabilities include sub-second voice response (claimed ~500 ms with push-to-talk), end-to-end task execution (booking rides, ordering food, travel planning), Rabbit Hole web portal for authenticating third-party services, Rabbit Eye (360° rotational computer-vision camera) for environment understanding and translation, Teach mode to record and replay multi-step tasks (example: Midjourney image generation via Discord), and hardware features (touchscreen, push-to-talk button, analog scroll wheel, microphone/speakers, Bluetooth/Wi‑Fi, global 4G LTE SIM). Design partner: Teenage Engineering. Privacy note: redirects to native login pages; no storage of third‑party credentials claimed. Positioning: framed as a new device class (not a phone replacement) with price/feature comparisons to current top phones (~$700–$1,000), smart speakers (~$200), and other new AI devices mentioned (Aiping $699, Tab $600).
Questions this video answers
January 10, 2024.
Teenage Engineering.
Approximately 500 milliseconds.
A 360-degree rotational camera called the Rabbit Eye (computer-vision enabled).
Global 4G LTE (SIM card supported).
Chapters
So the company Rabbit just released their demo for their new AI powered device and it is honestly, no word of a lie, absolutely incredible. And I'm pretty sure this actually did shock the entire industry because there was no previous hype around this product and now it's sending shockwaves through the entire industry in terms of what we knew about consumer devices. Take a look at the amazing demo because you're likely to be blown away. Hi everyone, my name is Jesse and I'm the founder and CEO of Revit. I'm so excited to be here today to present to you two things we've been working on. A revolutionary new foundation model and a groundbreaking consumer mobile device powered by it. Our mission is to create the simplest computer. Something so intuitive that you don't need to learn how to use it. The best way to achieve this is to break away from app based operating system currently used by smartphones. Instead, we envision a natural language centered approach. The computer we're building, which we call a companion, should be able to talk, to understand, and more importantly, get things done for you. The future of human machine interfaces should be more intuitive. Now, before we get started, let's take a look at the existing mobile devices that we use daily. The one device that's in your pocket, the smartphones like iPhone and Android phones. These guys been here for years and we've grown tired of them. The problem with these devices however, is not the hardware form factor, it's what's inside the app based operating system. Want to get a ride to the office? There's the app for that. Want to buy groceries? There's another app for that. Each time you want to do something, you fumble through multiple pages and folders to find the app you want to use. And there are always endless buttons that you need to click, add to the cart, go to the next page, check the boxes and jumping back and forth, and so on. The smartphone was supposed to be intuitive, but with hundreds of apps on your phone today that don't work together, it no longer is. If you look at the top ranking apps on app stores today, you'll find that most of them focus on entertainment. Our smartphones has become the best device to kill time. Instead of saving them, it's just harder for them to do things. Many people before us have tried to build a simpler and more intuitive computers with AI. A decade ago, companies like Apple, Microsoft and Amazon made Siri, Cortana and Alexa with these smart speakers. Often they either don't know what you're talking about or fail to accomplish the task we asked for. Recent achievements in large language models, however, or LLMs, a type of AI technology have made it much easier for machines to understand you. The popularity of LLM chatbots over the past years has shown that the natural language based experience is the path forward. However, where these assistants struggle is still getting things done. For example, if you go to the ChatGPT and use their Expedia plugin to book a ticket, it can suggest options but ultimately cannot assist you in completing the booking process from start to finish. Things like ChatGPT are extremely good at understanding your intentions that could be better at triggering actions Another hot topic is a field of research around what they call agents. It has caught the eye of many open source projects and productivity software companies. What remains to be solved is for these agents to perform tasks end to end accurately and speedily. The problem is forcing a model to perform a task it is not designed for. Whether for a language model to reason about webpage using super prompts or screenshots, we have yet to produce an agent as good as users simply clicking the buttons to fulfill our vision of a delightful intuitive companion, we must go beyond a piece of complex software. We want it to be in the hands of everyone. So we first set out to fundamentally understand how computer apps are structured and more importantly, how humans interact with them. We wanted to find a way for our AI to trigger auctions on behalf of users across all environments. We want it to be universal. Not just a Chrome plugin or limited set of apps, but everything iOS, Android and desktop. These applications share something in common the interface. They all have a user interface. So at a philosophical level, if we can make an AI trigger actions on any kind of interface, just like a human would, we will solve the problem. This insight led us to create the Large Action Model, or LAM as we call it. It is new foundational model that understands and executes human intentions on computers, driven by our research in neural symbolic systems. With a Large Action Model, we fundamentally find a solution to the challenges that apps, APIs or agents face. We solve it with interfaces. Lam can learn any interfaces from any software, regardless of which platform they're running on. In short, the Large Language model understands what you say, but the Large Action Model gets things done. We use LAM to bring AI from words to action. Finally, we can build a computer that, in addition to understanding what you're trying to say, can actually help you do things on your behalf. We'll pack the Large Action Model into an advanced Rabbit OS operating system. It is built for real time interactions between you and The Rabbit, powered by lam large action models, concept and test results are so powerful that we decided to make a one of a kind mobile device. Introducing R1, your pocket companion. It. This is the Rabbit R1. Designed in collaboration with Teenage Engineering. The R1 is a fully standalone device primarily driven by natural language. The accumulation of countless hours of work from our research, design and software teams, it is simple to use. R1 is equipped with everything you need to interact with you and perceive your surround. It comes with a touchscreen, a push to talk button and an analog scroll wheel, a microphone and speakers, and a computer vision enabled 360 degree rotational camera we call the Rabbit Eye. It is Bluetooth and WI fi capable and has the same card slots that supports global 4G LTE network. And now let's see how it works. I can ask Rabbit for anything just like if I'm using ChatGPT. The difference though is the speed. With Rabbit OS, I get a response 10 times faster than most of the voice AI projects. Rabbit answers my questions within 500 milliseconds with the push to talk button. You don't need to say anything to wake it up. Just press and hold the button and talk like a walkie talkie. Now let's give it a shot. What's the nature of the reality?
The nature of reality is a topic that has captivated the minds of philosophers and thinkers throughout history. According to Bertrand Russell, reality is composed of hard data derived from sensory experiences and logical analysis. It is the amalgamation of our perceptions, thoughts and the external world.
I can speak or type with R1. If you shake R1, a keyboard will pop up. You will also know that the response speed is much faster than using some of the LLM Assistant apps with web browsing such as ChatGPT. What's the stock price of Coca Cola?
Searching for the stock price of Coca Cola the stock price of Coca Cola is $59.76.
Who played the role Oppenheimer in Christopher Nolan's latest Movies?
In Christopher Nolan's most recent film, Oppenheimer, the role of J. Robert Oppenheimer is played by Cillian Murphy. The film is a biographical thriller that explores the story of American scientist J. Robert Oppenheimer and his involvement in the development of the atomic bomb.
Now let's see how the large action model works. With Lam Rabbit, R1 can interact with all kinds of applications. Introducing the Rabbit Hole web portal, I can log into different services and unlock functionalities. For R1, it's just like icloud. Let's say I want to listen to some music. With a rabbit hole y portal. I have complete control over which services I want to activate on my R1 and which provider I prefer. For music I use Spotify. So let's go ahead and connect my Spotify to the rabbit hole. Now that this is Spotify login page Before I start the login process, I want to emphasize our commitment to privacy, the way we design the infrastructure for apps that we interact with. We don't create fake users or spam users, we don't hack their infrastructures and of course we do not store any of your third party credentials. Instead we redirect you to their login page. We never save your username and password and we don't track your data. The authentication happens on the respective apps. Now I'm logged in with Spotify. Rabbit OS recognizes that Spotify has been authenticated on my device. Before this presentation, I pre authenticated some other apps like Uber and DoorDash. Just choose your preferred services and login through them to get authenticated on your device. It's that easy. Now let's play some music. Play Kraftwerk's Pocket Calculator.
Playing pocket calculator by Kraftwerk4u.
Play another song from the album.
Sure Playing Computer Love for you.
Who wrote the lyrics for this song?
Ralph Hutter and Emil Schulte wrote the lyrics for the song Computer Love by Kraftwerk.
Which band sampled this song?
It seems that Coldplay's Talk is the only known example of a song that sampled Computer Love.
What do you think about this song?
Computer Love by Kraftwerk is widely regarded as a groundbreaking and influential song in the realm of electronic music. Its fusion of catchy melodies, robotic vocals, and innovative use of synthesizers has left a lasting impact on the genre.
I can also use R1 to call a ride. Get me a ride from my office home.
Now of course I will book an Uber ride for you from your office to your home. Please confirm the ride.
I have six people with three luggages. Find me an Uber that can fit.
All of us for six people and three pieces of luggage. I recommend booking an Uber XL as it provides ample space for all passengers and luggage. Please confirm the ride.
The ride shows up. I just hit confirm. Uber's on my way. I can also use R1 to order food. Get me a 12 inch pizza from Pizza Hut delivered to here. The most ordered option on the app is fine.
Ordering a 12 inch pizza from Pizza Hut. Since you mentioned that the most ordered option is fine, I will select that for you. I just created an order for a 12 inch pizza. It's going to be hand tossed with a classic marinara sauce and topped with regular cheese. Please confirm your order.
That sounds really good. I just confirmed the order here. Now I'm waiting for my pizza. I can also make R1 to a set of more complex actions that may take multiple apps to finish on a smartphone. For example, if I want to plan a trip to London, I can just describe what I wish in full to R1. I want to take my family to London. It's going to be two of us and a child age 12. We're thinking of January 30th to February 5th. Can you plan the entire trip for me? We like cheap non stop flights, grouped seats, a cool SUV and a nice hotel that has WI fi.
Exploring ticketing options to make your trip a reality. For your trip, I've found various flight options, a range of hotels to choose from and car rentals available. Please confirm each option individually for further details and booking.
So it's all been planned out. I just confirm, confirm, confirm and that's it. Could you come up with a schedule for fun things to do while I'm over there?
On it, I have prepared a detailed travel plan for your trip. In summary, you will be exploring London's iconic landmarks, visiting museums, enjoying delicious meals at local restaurants, and experiencing the vibrant atmosphere of different neighborhoods. Navigation details are also prepared and I can help you book tickets for any events you'd like to attend.
R1 just planned the entire trip for me. That's awesome. But it seems like this is a little bit too intense. Can you plan a a easy schedule for us?
Sure, I'm working on it. Please take a look at it and let me know what you think.
It gave me a more relaxed schedule every day with all the details. Sounds really good and I just confirmed that.
I can foresee a wonderful trip.
Isn't that cool, huh? R1 can help me reach others just like a phone, but smarter. It comes with a built in real time translator and a note taker. Removing the final barriers to communication. R1 automatically detects the language spoken in the environment and provide the BI directional translation. R1 has an I an onboard camera designed for advanced computer vision. It can analyze surroundings and take actions in real time. To activate the eye, just double tap the button. Oh, funny seeing you here Rick.
Let me take a look.
This is what I got in fridge. Can you make me a nice dish that's low in calories?
Let me see. How about a green garden omelette? It's a delicious and low calorie dish that combines the freshness of broccoli and cabbage with the creaminess of eggs. Here's a simple recipe for you.
Nice. It recognized all the stuff and gave me the actual recipes. Rabbit Eye can also help you with your documents. Here's a table I've been working on for job questionnaire. Can you create an additional column that matches candidates who mentioned rabbit? Then there are questions about how they found us.
Sure. Let me take a look at the table and add the matching column for you. I've processed the table and sent you an email with the results.
Okay, now let's check our email. I can continue to interact with Rabbit OS even beyond R1. Let's reply this email directly. Can you add another column that matches candidates who have included rabbit in their question and are LA based? I just reply the email. Hey, send. And I got a refined version from Rabbit OS through my email. Let's say I have a unique routine or task I can now do on my phone. R1 can do that too. We are experimenting with what we call the Teach mode. Just like how I can teach my friend how to skateboard, I can show R1 how to do it and it will learn from me. This means that any user, regardless of technical background, can teach R1 to learn new skills. So you go to Teach mode. You start a new session. Today, I will show you how to generate an image of puppy using Midjourney from a prompt using Discord. First I will go to the servers page and click one of my own servers. Since this is only a general image generation, I'll go to Midjourney text channel. Then I will use the image combined along with the prompt. Here I'm putting a cute baby wild dog with big eyes animated cartoon unreal8k. Let's wait for a minute for the engine to start generating the images. Once it's done, let's click on the image to get a link. I will then explain to Rabbit OS how to use this Rabbit and annotate it so that I can generate anything, not just puppies. So let's go back to our web portal, submit the request. It takes seconds for the web portal to finish processing. And that's it. It's that simple. Now once we finish the training, I can go back to my R1. Now let's use Midjourney as I told you, to generate a picture of a bunny in pixel art style.
Certainly, Jessie. I will use Midjourney to generate a picture of a bunny in pixel art style for you. Please give me a moment to create the Image.
Now here you go. You got an image generated on midjourney through Teachmode. Watch, learn and repeat. That's Teachmode. It's that simple. That's all the demos for today. With LAN fast evolving, my R1 will eventually help me to do things that can never be achieved on an app based phone. Speaking of the current app based phones, the first question we ask about ourselves is why would I need a new device if I already have $1000 iPhone. My iPhone can't do any of this at all. We do not build rabbit R1 to replace your phone. It's just a different generation of devices. The app based system was introduced more than 15 years ago and the new generation of native AI powered devices are just getting started. Here's a quick recap. R1 is our companion that hosts the large action model with natural language. I can use it for a wide range of tasks as anything direct actions, complex actions, AI enhanced video calls, note taker, translator with rabbit eye computer vision and experimental teach mode. On the hardware perspective. We got a 360 rotational camera, a global 4G LTE SIM card, a push to talk button and an analog scroll wheel. One last thing. What about the price? Now before we reveal our price, I want to do a quick comparison. Here are some of the best phones on the market right now. You got iPhone, you got latest version of Android phone. We're looking at somewhere around $700 to $1,000 for a top phone with an app based system. I bought my new iPhone 15 Pro Max last year and it's the same experience as my previous ones. Here are not so smart smart speakers. They're asking roughly around $200 but they're all outdated. And finally here are a couple of the new things with only large language models. You got Aiping asking for $699 plus monthly subscript base models. You got Tab asking for $600 and you got meta ribbon glasses asking.










