DATASET FACET · TASK
Household manipulation datasets for physical AI
Domestic tasks such as opening doors, folding laundry, cooking, cleaning, and object retrieval.
DIRECT ANSWER
Household manipulation pages collect datasets where this taskis materially relevant, then add truelabel’s commercial use, consent risk, and deployment fit notes so buyers can decide whether public data is enough.
MATCHED DATASETS
21 catalog entries
21 of 21 datasets
Open X-Embodiment
Published May 2026 · custom
A large cross-institution collection of robot demonstrations spanning many embodiments and manipulation tasks.
- Multi-institution robot demonstration corpus; exact per-task scale varies by contributing dataset.
- Commercial use unclear
- Best for: robot foundation model pretraining
DROID
Published May 2026 · custom
A real-world robot manipulation dataset focused on diverse teleoperated demonstrations outside narrow lab-only settings.
- Large real-world manipulation corpus; check source for current release counts.
- Commercial use unclear
- Best for: real-world manipulation pretraining
BridgeData V2
Published May 2026 · custom
A robot manipulation dataset from Berkeley focused on real-world behavior cloning and task generalization.
- Robot manipulation demonstrations across multiple tasks; source release describes exact split.
- Commercial use unclear
- Best for: behavior cloning
RT-1
Published May 2026 · custom
A robotics transformer data release associated with language-conditioned robot manipulation research.
- Large language-conditioned robot demonstrations described in the source paper and project materials.
- Commercial use unclear
- Best for: language-conditioned robotics
ALOHA
Published May 2026 · custom
A low-cost bimanual teleoperation platform and dataset family used for imitation learning in dexterous manipulation.
- Task-specific demonstrations released around the ALOHA platform and follow-on projects.
- Commercial use unclear
- Best for: bimanual imitation learning
RLBench
Published May 2026 · custom
A simulated robot learning benchmark with many manipulation tasks in CoppeliaSim.
- Large simulated task suite; source materials define current task count.
- Commercial use unclear
- Best for: simulated manipulation
CALVIN
Published May 2026 · custom
A benchmark for language-conditioned long-horizon robot manipulation in simulated environments.
- Long-horizon simulated benchmark and demonstrations.
- Commercial use unclear
- Best for: language-conditioned policy evaluation
ManiSkill
Published May 2026 · apache-2
A simulation benchmark and toolkit for manipulation skills and embodied AI policy evaluation.
- Simulation suite with tasks and environments maintained by the ManiSkill project.
- Source appears permissive; verify data terms
- Best for: simulated manipulation
Ego4D
Published May 2026 · custom
A large-scale egocentric video dataset focused on first-person human activity understanding.
- Large-scale first-person video corpus with annotations; source controls exact access terms.
- Commercial use restricted
- Best for: egocentric perception
EPIC-KITCHENS
Published May 2026 · custom
An egocentric video dataset of kitchen activities used for action recognition and human-object interaction research.
- Large egocentric kitchen activity dataset with action annotations.
- Commercial use restricted
- Best for: egocentric action recognition
Habitat datasets
Published May 2026 · custom
A family of embodied AI datasets and simulation assets for navigation and rearrangement research.
- Multiple scene and task datasets under the AI Habitat ecosystem.
- Commercial use unclear
- Best for: embodied navigation
AI2-THOR
Published May 2026 · apache-2
An interactive simulated environment for embodied AI agents in household-like scenes.
- Interactive household simulation scenes and tasks.
- Source appears permissive; verify data terms
- Best for: embodied agent research
BEHAVIOR
Published May 2026 · custom
A benchmark for household activities and embodied AI tasks in simulation.
- Household activity benchmark and simulation assets.
- Commercial use unclear
- Best for: household task taxonomies
BC-Z
Published May 2026 · custom
A behavior cloning project focused on zero-shot task generalization for robots.
- Task demonstrations and model references associated with the BC-Z project.
- Commercial use unclear
- Best for: behavior cloning
AgiBot World
Published May 2026 · custom
A large-scale real-world robot manipulation dataset family for fine-grained manipulation, tool use, and multi-robot collaboration.
- Hugging Face organization page describes the Beta release as 1M+ trajectories and 2,976.4 hours across 217 tasks, 87 skills, 3,000+ objects, and 100+ real-world scenarios.
- Commercial use unclear
- Best for: large-scale manipulation pretraining
RoboCasa
Published May 2026 · custom
A large-scale kitchen simulation framework and dataset family for everyday manipulation tasks in diverse household environments.
- RoboCasa365 source materials describe 365 everyday tasks, 2,500 kitchen environments, 600+ hours of human demonstration data, and 1,600+ hours of synthetic demonstrations.
- Commercial use unclear
- Best for: large-scale kitchen simulation
LIBERO
Published May 2026 · custom
A benchmark suite for lifelong robot learning and language-conditioned manipulation tasks.
- Benchmark datasets are organized around multiple LIBERO task suites, including spatial, object, goal, and long-horizon manipulation variants.
- Commercial use unclear
- Best for: VLA benchmark evaluation
RoboSet
Published May 2026 · custom
A real-world multi-task kitchen manipulation dataset with teleoperated and kinesthetic demonstrations.
- Source describes 30,050 trajectories, including 9,500 collected through teleoperation, across 12 skills and 38 tasks with four camera views.
- Commercial use unclear
- Best for: real-world kitchen manipulation
UMI
Published May 2026 · custom
Universal Manipulation Interface is an in-the-wild human demonstration framework for transferring portable gripper data to robot policies.
- Project materials emphasize portable in-the-wild data collection and fast demonstrations for tasks such as cup manipulation, dish washing, cloth folding, and dynamic tossing.
- Commercial use unclear
- Best for: portable in-the-wild demonstrations
TACO Play
Published May 2026 · custom
A kitchen robot manipulation dataset with Franka arm interaction data available through TensorFlow Datasets.
- TensorFlow Datasets documentation lists TACO Play as Franka kitchen interaction data with train and test splits and a 47.77 GiB dataset size.
- Commercial use unclear
- Best for: TFDS robotics ingestion
LeRobot datasets
Published May 2026 · custom
A Hugging Face robotics dataset ecosystem and standardized dataset format for multimodal robot learning data.
- LeRobot documentation describes a standardized dataset ecosystem on Hugging Face Hub using Parquet for tabular data and MP4 for video observations.
- Commercial use unclear
- Best for: robotics dataset distribution
READ THE TAG WITH CARE
Do not treat this tag as the whole sourcing decision
Facet groupings are discovery aids, not final recommendations. A shared modality, task, robot, format, license, or commercial-use label only says that datasets are worth comparing; it does not prove that the source is safe, complete, or useful for a target model.
Use this grouping to shortlist candidates, then open the dataset profiles, run fit and license checks, and compare sources against the buyer's target environment. Thin tag results become useful only when they route the reader into deeper evidence and action surfaces.
The external references below keep the facet grounded in robotics data practice. They help reviewers understand why format, embodiment, trajectory quality, licensing, and real-world coverage matter before a team commits engineering time to ingestion.
When a facet has only a few matching datasets, treat that as a signal rather than a weakness. It may mean the public corpus is thin for that robot, task, or format, and the next move is a custom supplement with the facet written into acceptance criteria.
Where to go next
- Physical AI dataset catalogUse the catalog to compare source-backed dataset profiles by modality, task, rights signal, consent risk, and deployment fit.
- Hugging Face robotics indexScan the broader robotics dataset surface before narrowing into promoted profiles, comparisons, and custom collection specs.
- Dataset changelogTrack source updates, licensing notes, and buyer-readiness changes that should trigger a renewed review.
- Dataset fit checkerScore whether a public source is enough for the model, rights path, modalities, and target environment.
- License risk checkerSeparate source license language from contributor consent, redistribution, private-space risk, and model-use assumptions.
- Data spec generatorTurn a public-source gap into a scoped capture request with sample QA, metadata, and delivery requirements.
- Vendor alternatives hubCompare data providers when the answer is not another public dataset but a better sourcing or capture route.
- Data annotation companiesUse the company index to separate annotation vendors, data engines, marketplaces, and specialist capture teams.
Other places to verify the claims
- Scale AI physical AI data engineMarket context for why physical AI systems need custom, enriched, real-world data beyond generic labeling workflows.
- LeRobot documentationRobotics dataset and tooling context for Hugging Face based collection, sharing, conversion, and training workflows.
- Open X-EmbodimentA cross-embodiment robotics dataset reference for comparing trajectory scale, robot diversity, and VLA training assumptions.
- DROID datasetA large in-the-wild robot manipulation dataset reference for real-world trajectory capture and deployment transfer risk.
TRUELABEL ROUTING
Need household manipulation data with cleaner rights?
Commission target-scoped data with contributor consent, capture metadata, sample QA, and delivery into your own storage.