Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data
TL;DR AI
2 min readKey summary
Ego2Robot turns egocentric human manipulation videos into robot-format training data for pretraining.
The pipeline combines action retargeting, robot-arm visual synthesis, and quality curation to scale data generation.
It produces 18,561 hours of data across 15 robot morphologies and extends RoboTwin2.0 with perturbation benchmarks.
Pretraining with synthesized plus robot data improves out-of-distribution robustness and real-robot performance.