VLA-REPLICA is a low-cost, easily reproducible real-world benchmark for evaluating VLA models. Built from off-the-shelf components, our system can be quickly assembled and replicated across laboratories, providing a consistent environment for policy evaluation anywhere in the world. VLA-REPLICA includes a diverse suite of manipulation tasks and a small-scale demonstration dataset for target-domain adaptation, with real-world evaluation protocols for both in-distribution and out-of-distribution settings.
Robometer is a general-purpose, video-language-input, dense reward model trained on RBM-1M, a large-scale dataset of over 1M trajectories spanning 21 robot embodiments. It significantly improves robot learning across online RL, offline RL, model-based RL, failure detection, and data retrieval for imitation learning. Link redirects to project website.
