Boston Dynamics New Autonomous Update Is Incredible (Boston Dynamics Atlas 2024)

Boston Dynamics' Atlas robot autonomously moves engine covers between bins and a dolly in a 2 minute 30 second demo. It uses a machine-learning vision model to find objects, a three-finger gripper that works like an opposable thumb, and real-time feedback from cameras and force sensors, with no remote control or pre-programmed moves.
Questions this video answers
LARRUZ (YouTube creator).
October 31, 2024.
2 minutes and 30 seconds.
A pre-mapped list of bin locations to move parts between.
No; motions are generated autonomously online with no teleoperation or prescribed movement sequences.
Chapters
So today, Boston Dynamics finally unveiled their ATLAS robot. But this time, the unveiling was of the robot doing actual moving tasks. This video is from The Boston Dynamics YouTube channel, in which you can see their humanoid robot performing a range of different tasks relating to loading and unloading some bins. Now, I think this is one of the most impressive demos we've seen as of recent, because this isn't any kind of polished or, you know, extremely curated demo. This is a robot working in the kind of environment that you would expect from a standard employee in various different companies in various different settings. Now, the craziest thing about all of this is that it says that ATLAS is autonomously moving engine covers between supply containers and a mobile sequencing dolly. And the autonomous feature that I think most people are underrating is the fact that this means that ATLAS performs the task without need for human intervention or remote control. And this entire thing is 2 minutes and 30 seconds long. It's doing this completely independently, using pre programmed logic and real time sensor inputs to decide its actions. And the autonomy here highlights ATLAS ability to carry out repetitive and potentially dangerous tasks safely and efficiently on its own. Now, of course, the engine covers. These are the components that ATLAS is tasked with moving. These engine covers are often heavy, bulky and awkwardly shaped, which makes them challenging to handle, especially with precision. And this highlights ATLAS capability to manipulate large, unwieldy objects with care, which is a critical skill in industrial environments. And the supplier containers are essentially just the storage units that likely hold the engine covers. The mobile sequencing dolly, on the other hand, is a movable cart or platform that helps organize the position or position these engine covers for the next step in a production process. And atlas's role is to move the covers between these two points, indicating its involvement in the assembly or manufacturing line. Now, I think that when you really start to understand just exactly what this demo showed us, you'll understand that the future of robotics is in Boston Dynamics. Now, the description states that this robot that you're seeing receives as an input a list of bin locations to move parts, parts between. So ATLAS is essentially provided with a list that contains the locations of all the bins where the parts are stored and where they need to be moved. The list is mapped out in advance and is used by the robot to perform its tasks accurately. And by having predefined locations, ATLAS is then able to navigate its workspace efficiently without needing new instructions for every single action. And we can see these points that I'll get into in a moment on screen right now. Now, ATLAS Tasks involves Moving these items between these bin locations in a systematic and repetitive way. This essentially indicates that ATLAS can handle sequence based tasks which are common in logistics or production lines, where moving parts to and from specific locations can is crucial for a streamlined process. Which is why many have been joking around on Twitter stating that this product is one that is going to replace a lot of Amazon warehouse workers. But if you've ever paid attention, you know that they already have a significant amount of robots in their workforce. Now ATLAS actually uses a machine learning vision model to detect and localize the environment fixtures and individual bins, which is what we can see on screen where we see these red dots. And this model has been trained on a large data set of images to recognize and understand different components of the environment visually. The machine learning model gives ATLAS the ability to differentiate between different objects such as bins, containers or other environmental elements. Now detect and localize essentially means that identifying objects like bins or containers will within its environment. And localizing, which is what they said in the description, basically just means that determining their exact positions in three dimensional space. And this is really critical because ATLAS must not only know what the objects are, but also understand where they are in relation to itself so it can move toward them or interact with them effectively. Now of course, these environment fixtures and individual bins are essentially structural elements like racks or support frames that ATLAS must navigate around. And ATLAS must accurately identify and locate these elements to interact with them properly during its task. Now, one of the things they also state is that this robot uses a specialized grasping policy and continuously estimates the state of manipulated objects to achieve the tasks. This specialized grasping policy is essentially where ATLAS has a specific set of rules or approaches to for picking up different types of objects. The grasping policy is designed based on unique attributes of the item it handles. It might include factors like the optimal grip strength, the best angle for approaching the object, and how to adapt to irregularities which we see later on. And this helps to ensure that ATLAS can pick up and carry objects securely without damaging them or dropping them. Now it also says that you know in this statement it says that the robot uses a specialized grasping policy and continuously estimates the state of manipulated objects to achieve the task. Now, after ATLAS picks up an object, it doesn't just assume everything is fine. Instead it constantly monitors the object while being moved. The monitoring includes checking if the object is secure, if it is starting to slip, or if it has become misaligned. And continuous estimation includes is essential for ensuring that the robot can adapt to unexpected conditions and successfully complete a task which is what we saw when it manages to make a mistake. Now, of course, in this object, the manipulated objects are going to be these engine covers, which is where it's able to manipulate these in an incredible way. And ATLAS must be always aware of the state of the objects that it is handling. This enables it to make on the fly adjustments if it senses that something is isn't right. Of course, there are no prescribed or teleoperated movements, and all of these motions are generated autonomously online. Now, when they say no prescribed movements, this basically means that unlike robots that follow these pre recorded demos or strictly pre programmed movement paths, ATLAS does not use fixed movement sequences. Instead, its movements are dynamically determined based on the task and the environmental conditions it encounters in real time. There's also no teleoperation. Teleoperation just essentially refers to a human controlling the robot from a remote location. And in atlas's case, there's no human operator actively controlling its actions, is acting independently and making decisions as needed. Now, generating autonomously online just means that these actions are being generated in, in real time. Rather than relying on pre planned sequences, ATLAS continuously analyzes the current state of its environment and then it uses this information to generate the appropriate movement on the fly. This is the real time adaptation that allows ATLAS to handle dynamic and unpredictable changes in its surroundings. Now, I think one of the really important things that we saw in this video was the ability for the robot to detect and react to changes such as accident failures, for example, failure to insert the COVID or tripping and environment collision. So ATLAS is equipped with the ability to detect unexpected changes in its environment and respond accordingly. This is really important because many of these workplaces in these factories where these robots are going to be, are pretty dynamic. You know, you've got things like tools, containers, or even other workers that could move unexpectedly. Now, of course, the moving fixtures, which is where it's able to react to these changes, is that if one of these containers that we do see here, if it shifts position, ATLAS is able to detect this movement and adjust its approach to match the new position. This adaptability ensures that ATLAS can continue working effectively even if, if the workspace isn't perfectly stable. Now, of course, this failure to insert this cover that we see here, it's absolutely really incredible that we see this combination of vision, force and proprioceptive sensors being able to allow ATLAS to fix this quickly. The vision sensors basically mean that it's the camera or other imaging devices that help ATLAS see its environment and detect objects and determine their position. The force sensors basically measure the physical forces that ATLAS encounters during its tasks, such as how much pressure it applies while gripping an object, or detecting if there's unexpected resistance while moving. And the proprioceptive sensors basically help ATLAS understand its own body state, such as angles of its joints, the positions of its limbs, and its balance. And this is basically similar to how humans can handle their sense of their own body parts, which without looking at them. Now, one of the key things that I actually did miss in this demo was something rather subtle. But it does show that ATLAS is a versatile robot engaged in many different dynamic tasks and many different dynamic use cases. One of the things pointed out by the Humanoid Hub was the fact that if we take a look at this in slow motion, we can see that atlas's three finger hand gripper is doubling as an opposable thumb. This allows ATLAS to use its hand in multiple different ways. We can see it's able to use its hand to grip this out and then it's able to flip that over and then pull this out. It's like some really advanced tongs or tweezers. But in robotics, this means it's a lot more adaptable to many different scenarios. It's quite like having an arm that you could change for many different dynamic situations. I think this kind of thing did get overlooked. It was something that I didn't pick up the first time watching this, but on seeing this on Twitter, the Humanoid Hub, which is a great Twitter account for all humanoid robots, I saw this in slo mo and my mind was blown once again. So this is where they're using potentially different areas of dynamic control to be able to use these robots to be able to grasp different things and have them adapt to different scenarios. Another subtle thing that I did notice was the fact that there have been two demos so far of the Atlas robot. One of the earlier iterations that we saw was one where we got to see the design and presentation of the prior ATLAS robot appeared to be rather polished. This demo, the one you can see on the right, looks as if it is a lot more rough and rugged, which potentially indicates that this version of Atlas, the one that we got to see today, was engaging in a lot more demonstrations. I mean, the left side basically shows Atlas that is in what seems to be a controlled indoor environment, possibly in a display area where it's not been exposed to the rigors of real world operation, which makes it easier to keep the robot looking pristine. But of course, the robot on the right hand side looks a lot less polished. But of course, it's handling heavy objects, encountering a lot of dust, dirt, and probably a lot of wear and tear from these repetitive tasks. But overall it does seem like these are very similar iterations. But I also want to show you guys something as well. So you do remember the fact that I talked about how we have this robot here and it's able to switch its hands to be able to do many different things. One of the things that I recently saw that was absolutely outstanding was the fact that you can see that Optimus in this short demo is equipped with different hands. Now the hands that we just previously talked about were ones that enable it to grip certain things. But if we look at this specific demo, the hands are quite different. There's like some rubber half ball shape and that is allowing it to perform these push ups well. So essentially what we are seeing here is that this Atlas robot is able to have dynamic body part changes that allow it to interact in certain environments to be more flexible and more useful. This is something that I think is quite underrated because a lot of robots don't have that modularity where you can swap parts in and out. But the Atlas robot does have this feature, which means you can simply swap out the hands and and then set it off to do different things. I think this feature is remarkably underrated, as most people didn't see this video, but it was one that they showcased when they were showing the flexibility of this robot. And this one even looks a little bit more polished than the prior one that was working long hours in the factory. And lastly, I do want to mention that this robot's movement is largely one of the most uncanny that I've ever seen. One of the things that I've seen people continue continually complain about is the fact that these robots are remarkably too human. It's almost as if we're anthropomorphizing these robots and making them less efficient as a result. What if we just made these robots just be entirely efficient for the task? How would they look and perform? And I think we're starting to see this with the Atlas platform. Oftentimes when this robot is moving to and from these different locations, we can see that it moves its Torso in a 180 degree manner and it also moves its legs in ways that humans simply wouldn't be able to do. I think this does give us this unnerving feeling about Terminator robots, but I think it just makes the robot a lot more effective. Like right there, you can see it turned its head on a swivel and then just turned around its body and was able to immediately get into the right position. I mean, it looks unnatural, but you have to remember that this is not a human. It's not like some kind of, you know, adolescent. This is a complete artificial intelligence robot that doesn't have anything to do with us at all. So while it might look a little bit weird, it's completely natural and normal. And I think we need to expect that when we're looking at future robot releases, like. Like right here, when it manages to do a complete 360 on its head, then move the legs around and start walking towards it. It's something that will never get old. So if you did find this completely interesting, let me know what you thought about the video and I'll see you guys in the next video.










