Open X-Embodiment
A large cross-institution collection of robot demonstrations spanning many embodiments and manipulation tasks.
COMMERCIAL USE
Commercial use unclear
Commercial use status is a conservative truelabel interpretation for buyer triage. Legal teams still need to review source terms, contributor consent, and downstream model use rights.
DIRECT ANSWER
Dataset license text alone rarely answers whether a physical AI team can train, evaluate, redistribute, or commercialize a model. This grouping organizes datasets by truelabel’s buyer-readiness risk signal.
DROID
A real-world robot manipulation dataset focused on diverse teleoperated demonstrations outside narrow lab-only settings.
BridgeData V2
A robot manipulation dataset from Berkeley focused on real-world behavior cloning and task generalization.
RT-1
A robotics transformer data release associated with language-conditioned robot manipulation research.
ALOHA
A low-cost bimanual teleoperation platform and dataset family used for imitation learning in dexterous manipulation.
RoboNet
A multi-robot dataset for visual foresight and manipulation policy research.
RLBench
A simulated robot learning benchmark with many manipulation tasks in CoppeliaSim.
CALVIN
A benchmark for language-conditioned long-horizon robot manipulation in simulated environments.
HOI4D
A 4D egocentric human-object interaction dataset with RGB-D and pose-oriented annotations.
DexYCB
A dexterous hand-object interaction dataset centered on grasping YCB objects with 3D annotations.
Habitat datasets
A family of embodied AI datasets and simulation assets for navigation and rearrangement research.
BEHAVIOR
A benchmark for household activities and embodied AI tasks in simulation.
ObjectFolder
A dataset family for object-centric physical properties, geometry, and multimodal perception research.
BC-Z
A behavior cloning project focused on zero-shot task generalization for robots.
DexMV
A dexterous manipulation dataset focused on multi-view visual observations and hand-object interaction.
RH20T
A real-world contact-rich robot manipulation dataset with multimodal sensing, force, audio, and human demonstration video.
AgiBot World
A large-scale real-world robot manipulation dataset family for fine-grained manipulation, tool use, and multi-robot collaboration.
RoboCasa
A large-scale kitchen simulation framework and dataset family for everyday manipulation tasks in diverse household environments.
LIBERO
A benchmark suite for lifelong robot learning and language-conditioned manipulation tasks.
RoboSet
A real-world multi-task kitchen manipulation dataset with teleoperated and kinesthetic demonstrations.
RoboTurk
A large-scale teleoperation data collection platform and dataset family for robot manipulation tasks.
UMI
Universal Manipulation Interface is an in-the-wild human demonstration framework for transferring portable gripper data to robot policies.
FurnitureBench
A real-world long-horizon furniture assembly benchmark with successful demonstration data.
TACO Play
A kitchen robot manipulation dataset with Franka arm interaction data available through TensorFlow Datasets.
LeRobot datasets
A Hugging Face robotics dataset ecosystem and standardized dataset format for multimodal robot learning data.
FACET REVIEW PATHS
Do not treat this tag as the whole sourcing decision
Facet groupings are discovery aids, not final recommendations. A shared modality, task, robot, format, license, or commercial-use label only says that datasets are worth comparing; it does not prove that the source is safe, complete, or useful for a target model.
Use this grouping to shortlist candidates, then open the dataset profiles, run fit and license checks, and compare sources against the buyer's target environment. Thin tag results become useful only when they route the reader into deeper evidence and action surfaces.
The external references below keep the facet grounded in robotics data practice. They help reviewers understand why format, embodiment, trajectory quality, licensing, and real-world coverage matter before a team commits engineering time to ingestion.
When a facet has only a few matching datasets, treat that as a signal rather than a weakness. It may mean the public corpus is thin for that robot, task, or format, and the next move is a custom supplement with the facet written into acceptance criteria.
INTERNAL LINKS
Continue the buyer workflow
Physical AI dataset catalog
Use the catalog to compare source-backed dataset profiles by modality, task, rights signal, consent risk, and deployment fit.
Hugging Face robotics index
Scan the broader robotics dataset surface before narrowing into promoted profiles, comparisons, and custom collection specs.
Dataset changelog
Track source updates, licensing notes, and buyer-readiness changes that should trigger a renewed review.
Dataset fit checker
Score whether a public source is enough for the model, rights path, modalities, and target environment.
License risk checker
Separate source license language from contributor consent, redistribution, private-space risk, and model-use assumptions.
Data spec generator
Turn a public-source gap into a scoped capture request with sample QA, metadata, and delivery requirements.
Vendor alternatives hub
Compare data providers when the answer is not another public dataset but a better sourcing or capture route.
Data annotation companies
Use the company index to separate annotation vendors, data engines, marketplaces, and specialist capture teams.
EXTERNAL REFERENCES
Source context to verify
Scale AI physical AI data engine
Market context for why physical AI systems need custom, enriched, real-world data beyond generic labeling workflows.
LeRobot documentation
Robotics dataset and tooling context for Hugging Face based collection, sharing, conversion, and training workflows.
Open X-Embodiment
A cross-embodiment robotics dataset reference for comparing trajectory scale, robot diversity, and VLA training assumptions.
DROID dataset
A large in-the-wild robot manipulation dataset reference for real-world trajectory capture and deployment transfer risk.