Humanoid robots might be able to run, dance, and occasionally kick people, but to become truly human, they’re going to need to learn how to do all sorts of menial chores at work.
Flexion Robotics, a Swiss startup founded by ex-Nvidia robotics researchers, thinks it has the solution. The company has developed a way to train robots to perform complex tasks that involve simple skills like opening doors, climbing stairs, and carrying boxes. The key is to teach the robots individual skills in simulation, then have a master AI algorithm determine how to use them.
Most demo videos show humanoids that have been trained to do a specific task, like folding shirts or loading shelves. Typically, this is done through teleoperation—a person behind the scenes who controls the robot’s movements. But this approach doesn’t work reliably when the robot is put into unfamiliar settings. Flexion says its system is different—and more efficient—because it trains its robots in simulation and with limited human instruction.
The video below shows the software in action: A modified Unitree humanoid robot operates autonomously after it receives the following command: “A parcel with snacks has been delivered for Flexion. Retrieve it using the stairs and come up using the elevator. Then unpack it and place the items into the empty drawer on the shelf in the snack area.”
Courtesy of Flexion
Flexion’s approach works by combining different AI systems.
The main AI model figures out how to do its chores by digesting videos of humans doing different things. These videos teach the model what actions to take and when—not how to physically perform it. The software then triggers learned skills—which it has picked up in simulation—and it performs those tasks in the real world. In order to reach the mail room in an office, for example, the model may have learned that it needs to open certain doors and use the elevator. The system also controls the robot’s motors, allowing it to walk, move its limbs, and maintain balance.
According to Nikita Rudin, the cofounder and CEO of Flexion and a former robotics research scientist at Nvidia, the software’s “secret ingredient” is its extensive use of reinforcement learning, which trains computers to master tasks through trial and error. Each layer of the software, from the master AI model to the simulation to the motor control, uses this approach.
