TWIST: A Real-Time Teleoperation System for Humanoid Robots

0
810

The real-time remote control of robots, known as teleoperation, holds promise for a wide array of real-world applications. In recent years, engineers have increasingly focused on developing teleoperation systems that allow users to guide humanoid robots—machines with human-like body structures—by getting them to closely imitate full-body human movements.

Researchers from Stanford University and Simon Fraser University have introduced a new system called TWIST (Teleoperated Whole-body Imitation System), which enables humanoid robots to mirror human body motions in real time while performing practical tasks.

Detailed in a recent paper posted on the arXiv preprint server, TWIST integrates motion capture (MoCap) data with reinforcement learning and imitation learning techniques to achieve its results.

"We want humanoids to have the same level of whole-body dexterity as humans," said lead author Yanjie Ze in an interview with Tech Xplore. "Imagine a cluttered kitchen—humans can hold items with both hands, use their feet to move obstacles, and even open doors using their bodies or elbows. Our goal is to enable robots to replicate these actions by directly imitating humans."

The TWIST system utilizes MoCap technology to accurately track a user’s movements, translating these into coordinated commands that drive the entire body of a humanoid robot. Unlike previous systems, TWIST allows for synchronized control of multiple joints across the body, including arms, legs, waist, and elbows, enabling more natural and human-like movement.

"TWIST operates by capturing a person’s full-body movement in real time and converting that into executable commands for a humanoid," Ze explained. "This results in higher accuracy and a broader range of motion capabilities than seen in prior work."

https://github.com/DanielXCT/BOWBLITZ-MOD-unlimited-money-and-gems


https://github.com/RyanTNW/Fish-of-Fortune-free-spins-MOD-2025


https://github.com/JoshGWT/Screw-Rescue-Master-MOD-unlimited-money


https://github.com/JeffRGT/Car-Driving-2025-School-Game-unlimited-money


https://github.com/TravisBNG/Vector-unlimited-money-2025-MOD


https://github.com/AndrewTRB/Hide-Online-unlimited-money-2025


https://github.com/DaveFGN/Top-Drives-unlimited-money-and-gold-latest-version-2025


https://github.com/ChrisTRH/Tank-Stars-unlimited-money-and-gems-MOD-2025


https://github.com/EricDNGT/CloudMoon-unlimited-time-MOD-2025


https://github.com/DevonKNE/Supreme-Duelist-Stickman-unlimited-money-and-max-level-2025


https://github.com/ShaneRVM/Terminal-Master---Bus-Tycoon-unlimited-money-and-gems


https://github.com/CodyGNT/Tuning-Club-Online-unlimited-money-2025


https://github.com/DannyGNS/Garage-Mania-Triple-Match-3D-unlimited-money-and-gems-MOD


https://github.com/JohnGNB/Drive-Zone-Car-Simulator-Game-unlimited-money-MOD


https://github.com/AaronMBT/SRGT-Racing-Car-Driving-Game-unlimited-money-MOD


https://github.com/AdamTNC/Car-Parking-Driving-School-unlimited-money-2025


https://github.com/AidenTRG/Hot-Slide-unlimited-money-and-gems-MOD


https://github.com/AlanBNG/CarX-Drift-Racing-3-unlimited-money-MOD-2025


https://github.com/JoshRBD/GT-Nitro-Drag-Racing-Car-Game-MOD-unlimited-money-2025


https://github.com/AnthonyMNT/SD-Gundam-G-Generation-ETERNAL-MOD-unlimited-diamonds


https://github.com/StevenRDN/Grand-Mobile-unlimited-money-MOD-2025


https://github.com/AustinBRC/My-Supermarket-Journey-unlimited-money-and-energy-2025


https://github.com/BenjaminUND/MWT-Tank-Battles-MOD-unlimited-money-and-gold


https://github.com/BlakeDNT/Tap-Titans-2-unlimited-diamonds-MOD-2025


https://github.com/BrianGSK/Gold-and-Goblins-unlimited-money-and-gems-2025


https://github.com/CameronALK/Idle-Zombie-Miner-MOD-unlimited-money-and-gems-2025


https://github.com/ChristianHMT/Head-Ball-2-unlimited-diamonds-and-money-2025


https://github.com/ColinKNS/Race-Max-Pro-unlimited-money-and-gold-2025


https://github.com/DeanKNG/Payback-2-unlimited-money-MOD-2025


https://github.com/DylanNSB/Tower-War-unlimited-money-and-gems-MOD-2025


https://github.com/EdwardTME/Galaxy-Attack-unlimited-crystals-MOD


https://github.com/EricKSLT/Cooking-Madness-unlimited-money-and-gems-2025


https://github.com/GabrielMGE/House-Designer-Fix-and-Flip-unlimited-money-2025


https://github.com/GavinMHB/Rec-Room-unlimited-tokens-MOD-2025


https://github.com/JackDLN/Real-Car-Driving-Midnight-Club-unlimited-money-2025


https://github.com/JacobDWN/Super-City-Building-Master-unlimited-money-and-gems-MOD-2025

 

The team tested TWIST in real-world experiments using the G1 humanoid robot developed by Unitree Robotics. The system successfully enabled teleoperation of the G1 and showed potential compatibility with other humanoid platforms like Booster Robotics' T1.

According to Ze, one of the most significant discoveries was that full-body motion data alone can effectively control a humanoid robot, allowing it to exhibit human-level dexterity across all major body parts. This opens up possibilities for using human operators to generate large-scale datasets that can train foundational models for robotics.

Looking ahead, the researchers aim to improve TWIST by reducing its reliance on MoCap systems, which are currently non-portable and limit deployment flexibility. Ultimately, the system could be used to control robots performing manual labor in dangerous environments or precision tasks in industrial settings.

"We want humanoid robots to become truly capable and intelligent agents in the real world," Ze said. "Our next steps include scaling up data collection and enabling robots to autonomously learn skills from these demonstrations."

Search
AI content
Categories
Read More
Expert Opinions
U4GM - 13 Best F2P Techniques to Obtain Steal a Brainrot Items Fast
If you're a free-to-play player looking to get your hands on Steal a Brainrot items quickly,...
By Xcv Xcv 2025-08-02 07:07:11 0 342
Games
MMOexp-Maximizing Charge Infusion: How to Harness Its Full Potential in POE
Path of Exile (POE) continues to evolve as one of the most complex and dynamic action...
By Chunz Liu 2025-06-24 00:52:39 0 783
AI in Education
MMOexp MLB 25: A runner on first then advancing them via a sacrifice bunt
1. Complete the Moments The first step to kick off your Egg Hunt program should be completing...
By Lee Aventurine 2025-08-21 03:39:41 0 282
Interactive Media
Mmoexp Skull and Bones Items: Refining and Upgrading Materials
5. Refining and Upgrading MaterialsRaw resources can be refined into advanced materials at...
By Lacie Rozemondbell 2025-05-29 01:48:41 0 948
Games
Last Epoch has more advantages
Last Epoch stands out in the crowded ARPG genre by offering numerous advantages that appeal to...
By Zsd Lsd 2025-06-10 02:36:05 0 712