Sunday reposted this
ACT-2 is out... Take a bow Sunday Robotics! For years, robot learning has lived with an uncomfortable tradeoff. Pretrain on broad, diverse data and you get generalization. Post-train on curated robot data and you get reliability. Usually you sacrifice one for the other. Sunday Robotics' ACT-2 argues that this tradeoff starts disappearing once pretraining becomes strong enough. Their central claim is that as the foundation model scales, small amounts of in house data stop overfitting and start generalizing. They even show a single demonstration teaching a new folding behavior that transfers to unseen garments. (So now it can handle all your snazzy outfits ;) ) Where have we seen this trend before.... Oh right, GPT-3 and the LLM world was never the same again. GPT-3 reduced downstream adaptation by making pretraining stronger. ACT-2 is making the same argument for robotics. They further introduce a "Solve" as the unit of robotics progress, breaks it down to the nitty gritty specifics...What task? Across what distribution? With how much adaptation? A 99% success rate in one lab and 99% across unseen homes with zero adaptation are completely different scientific claims. This is the first time I'm seeing a major Robotics lab talk about real, repeatable benchmark rather than carefully curated/ cherry picked demos. The other thing that stood out is their post training philosophy. They describe reliability as hill climbing. Every failure becomes another iteration, and because the base model generalizes well, each improvement transfers instead of staying trapped in one environment. If this recipe holds beyond laundry, I think it changes how we think about robot scaling. Less emphasis on collecting enormous amounts of task-specific robot data, More emphasis on building stronger foundation models that can absorb tiny amounts of new experience and immediately generalize. That feels like a much more scalable future for robotics than starting every capability from scratch. Still early days for truly generalizable Robotics foundation models, but atleast we are making progress!