Autonomous AI: Are We Creating Westworld?

In this video, I'm going to show you some of the coolest tech that I've come across over the last few days. So let's get right into it. The first one is this Reverie demo. These are basically like NPCs, non playable characters, but they interact with each other in a Sims like world using AI, they actually form relationships with each other, they have discussions, they get to know each other. It's a really, really interesting experiment. And if you come over to their demo here, you can actually watch them interact. And there's a whole cast of characters here and you can click on any character you want at any given time and see what they're up to. Let's click on as. So as is Adam Smith. His current action is having a meeting, discussing the topic with the other participants. So if we look up here on the screen, we could jump to Adam Smith and you can see he's walking here now. It looks like he's going to find some coffee or something. If I look down here, his current action, he's taking a break from the meeting. Let's click on IR and find her. She's currently eating some pizza right now. Now these characters, they are taking all of these actions independently. There is nobody instructing to do anything. They are just wandering around this little world doing actions based on their past memories and a sort of preset personality that was designed for them. And this is based on a paper called Generative Agents Interactive Simulacra. Simulacra of human Behavior. And it's actually a really interesting read. Of all of the research papers I've read, this is one that's actually kind of a fun read. We initiate Generative Agents to populate an interactive sandbox environment inspired by the Sims, where end users can interact with a small town of 25 agents using natural language. So check this out here in an evaluation. These generative agents produce believable individual and emergent social behaviors. For example, starting with only a single user specified notion that one agent wants to throw a Valentine's Day party, the agents autonomously spread invitations to the party over the next two days, make new acquaintances, ask each other out on dates to the party, and coordinate to show up for the party together at the right time. So these little sim like characters that are running autonomously with their own sort of built in AI, they planned a Valentine's Day party, asked each other out on dates and coordinated to show up at the same time. That's really, really cool. But there's also something kind of creepy about it. A little further down the paper. It explains here that each agent is represented by a simple sprite avatar. We authored one paragraph of natural language description to depict each agent's identity, including their occupation and relationship with other agents as seed memories. So they kind of gave him a little bit of a seed paragraph to start off the personalities. And then everything that happened beyond that sort of happened autonomously. So for example, John Lin is a pharmacy shopkeeper at the Willow Market and Pharmacy who loves to help people. He's always looking for ways to make the process of getting medication easier for his customers. He's living with his wife, who's a college professor, his son Eddie, who is a student studying music theory, et cetera, et cetera. And it goes on to give a single paragraph about this person's kind of story and personality. Combine this with the news that meta created robots that learn from videos of human activities and simulated interactions and you've literally got the plot of Westworld. These robots could literally take input video footage of an action being taken and then replicate what they seen on the video. Using the video information, object bounding detection and various depth maps, they can then recreate the actions that they saw on video. And this technology is put into real robots that are actually, actually moving around and doing these actions. So if we create AI that gives NPCs free will and autonomy and we have robots that can run around and take actions as they learn stuff, I think that's both exciting and really scary at the same time because this is how the plot of almost every single robot taking over the world movie begins. But at least you and I will be ready for it because we're paying attention. Here's another cool thing I came across From Rick or rikvk01 on Twitter. He's basically figured out how to add a long term memory to chat GPT. So if we take a look at his video here.

Okay, guys, this is crazy. I just made chatgpt. But with long term memory, basically anything you say it's going to remember and it's going to make your experience a lot more personalized. Before, I already told this guy what's my workout routine is. So let's see if he remembers. And he says, you do 100 push ups every two days.

Okay, so you can see he started a brand new chat here. This is a fresh chat here. And he said, hey, do you know what my workout routine is? And it says, yes, I remember that. So at some point in the past, he trained this chat on what his workout routine is. And Then asked him to bring it up again at a later time. And the bot still remembered. If you know anything about Chat GPT, it only remembers the context of the conversation directly above it.

Okay, don't judge me, but let's tell him that we're actually increasing this to 200 push ups now. We're now doing 200 push ups instead of 100.

So now he just gave it some new information. Actually Now I'm doing 200 push ups every two days instead of 100. And it says wow. And essentially it's adding that new information to the long term memory.

Let's also tell it that I'm launching a new project called Memory GPT, which is like chatgpt but with long term memory. Let's do all that, let's on that, let's say, wow, cool, all this stuff. But now to prove that works, I'm going to open it in a new tab. I'm going to refresh my my window.

So he just added some new information. He started a new tab with a new window and a new chat. And with this new chat, ask it.

Again if it knows what my workout routine is. Okay.

He's asking some of these same questions again now.

And now he says, wow, you do 200 pushups. So cool. And let's also ask it if it knows of any projects I'm working on. And it says, yeah, you're working on memory GPT, which is like ChatGPT.

So this isn't publicly available, but he does have a wait list on his tweet where you can sign up through a Google Doc, tell him why you want to use it and he'll get you access. I don't have access to it yet. I just kind of came across this video and wanted to show it off because I thought it looked cool. This one's from Pietro Scarano. He created something called Designer GPT, which is a plugin for ChatGPT. So so obviously you need to have access to the plugins feature in ChatGPT to be able to use this. Most people don't have access to yet. I don't have access to it yet, but once we get access to it, this looks like it'll be really, really cool. It will basically build an entire website for you using ChatGPT. It'll write the code for you, it'll write the copy for you, it'll generate the images for you. Let's just check out this demo video here. So he wrote, generate a website for a beautiful architecture firm. Generate any images you need as well. That was his prompt. So it used the Image Generator plugin, it used his Designer GPT plugin and it says, here's the website for the beautiful architecture firm. He clicked on the website, opened it in a new window over here and you can see it put the title, it put an image, it put about us, it put our services, it put a contact details, it literally did all of that from just generate a website for a beautiful architecture firm. Generate any images you need as well. He then types, that was great. Can you now give me a portfolio for a portrait photographer starts using the Image generator plugin, his Design Designer GPT plugin. And then once again it says, here's the portfolio website with a link. He opened this link in a new tab over here and then it says, please click on the link above to view the portfolio and you can see here's the portfolio website, Portrait Photographer portfolio. It generated a couple images about the photographer, generated some copy, put some contact information, and it just generated this entire website from one prompt. And he says, okay, so great, last one. We're going to generate a Minimal Design Agency website using the image generator plugin, using his Designer GPT plugin, gives him a new link, he opens it a new tab here and then, welcome to Minimal Design Agency. And it creates this real basic website over here. And on Pietro's Twitter thread here, if we scroll down a little bit, you can see another example of a website that he built with it where he asked for a fantasy carpet seller website and it says, here's the website for Aladdin's Flying Carpets, a flying carpet seller from the 14th century. You could visit the website by clicking on the link below. And then this is the website it generated. Aladdin's flying Carpets, Magical carpets from the 14th century. It generated an image with AI and put some copy down here for his magic carpet. Obviously these aren't the most beautiful websites we've ever seen in the world. They're kind of plain, kind of basic. But as I say, this is kind of becoming a recurring theme in a lot of my videos. This is as worse as it's going to get. Everything from here just gets better and better. Imagine when these tools are building just completely beautiful, modern, crazy looking websites, like we're not that far off. So that's a real cool tool from pietro called Designer GPT. Again, that one's going to require ChatGPT plus the plugins. Excited to play with that one and see where he goes with it. And then finally, the last one I want to point out comes from my good Buddy, Angry Penguin or AP over on Twitter. And this one's called Scene Dreamer. And this one you can actually play around with right now if you want to. So here's the TLDR scene. Dreamer learns to generate unbounded 3D scenes. And from in the wild 2D image collections, our methods can synthesize diverse landscapes across different styles with 3D consistency, well defined depth and free camera trajectory. So basically what it does is it generates these maps, these bird's eye view maps, and then from these maps with all these various types of landscapes, it then generates these 3D scenes that you can travel through. And all of this is created with AI. So here's an example scene that they show off of what these types of landscapes look like. And, and this started as one of those bird's eye view top down images of just sort of like a topography looking map. And then from that kind of topography map it generated this visual of the camera, almost like a drone shot flying over the landscape. From that topography map you can see all different types of scenes and styles that they have available for this. And this one, there is a hugging face space that you can play with on this. Right now you can see here's the original Bev they call it, or bird's eye view map. And from these bird's eye view maps here, it generated this video for me. You can see it's actually kind of spinning around from some sort of point of view here. But you've got different options here. We can change the random seed, you can change how many frames are rendered, the width of the rendered image, the height of the rendered image, and create all sorts of different scenes. Now you can also create a brand new bird's eye view map here and it will randomly generate a new bird's eye view. But it does say here that it does require a long time. So you can generate this bird's eye view. But if you go to generate the bird's eye view, you can see that it's quite time consuming to do. So. This is the random map that it just generated for me. Let's go ahead and render new video and see what that looks like. And here's the scene that it generated for us from that new topography or bird's eye view map that it just generated for us as it circles around our land plot that we just created. So some pretty cool technology. There's new crazy stuff coming out every single day, whether it's characters learning to be fully autonomous, autonomous self learning robots, ChatGPT with long term memory, GPT plugins that can build entire websites for you or just epic AI generated 3D scenes. There is constantly cool new stuff that I'm excited to share with you. And if you want to stay in the loop with all of the latest tech in AI and virtual reality and augmented reality and just all the cool future tech, head ON over to FutureTools IE. This is where I curate all of the coolest tools that I come across. I'm adding new tools every single day and then I've also got a free newsletter. If you click the button here to join the free newsletter, you'll join over 65,000 other people that get the TLDR of AI for the week every Friday. That's right, every single Friday. I send you just my five favorite tools that I've come across for the whole week. A handful of really interesting news articles in the AI space, a handful of YouTube videos, and one cool way to make money with AI. It goes out every single Friday and it's how tens of thousands of people stay in the loop every single week with AI. So if you're not on that list already, head on over to FutureTools IE and join the list. And if you want to make sure you see more cool AI news and tutorials in your news feed, make sure you give this video a thumbs up and subscribe to this channel because I'm going to keep on making videos like this for you and subscribe and that will ensure you keep on seeing this type of video inside of your newsfeed. Once again, thanks so much for tuning in today. I really appreciate you. I'll see you guys in the next video. Bye bye.