#11 · Primary category: Synthetic Data Generation
com.unity.perception
Perception toolkit for sim2real training and validation in Unity
Project last updated:11/08/24
GitHub Stars
994
Forks
187
Contributors
26
License
Apache-2.0
Why we included this project
Computer vision teams frequently hit a wall when they need large amounts of labeled training data but cannot collect or annotate enough real footage. This Unity package works around that by generating synthetic datasets from simulated scenes: you arrange labeled objects in the editor, capture RGB images together with ground truth such as bounding boxes, segmentation masks, and pose or keypoint labels, and use domain randomization to shift lighting, materials, and object placement between captures. Exports follow the SOLO schema and can be converted to COCO or pulled into tools like Voxel51 for inspection before training, so the output slots into an existing ML workflow. The catch is that Unity has discontinued the project and no longer supports it, meaning you would rely on community forks and GitHub issues rather than vendor help. For teams already invested in Unity it is still a capable reference implementation and a practical starting point for building a synthetic data pipeline.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
SDV
Synthetic data generation for tabular data
distilabel
Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
kubric
A data generation pipeline for creating semi-realistic synthetic multi-object videos with rich annotations such as instance segmentation masks, depth maps, and optical flow.
synthetic-data-generator
SDG is a specialized framework designed to generate high-quality structured tabular data.
unrealcv
UnrealCV: Connecting Computer Vision to Unreal Engine