#361 · Primary category: Computer Vision
CoreML-in-ARKit
Simple project to detect objects and display 3D labels above them in AR. This serves as a basic Template for an ARKit project to use CoreML.
Project last updated:08/23/21
GitHub Stars
1.7K
Forks
221
Contributors
2
License
MIT
Why we included this project
Building on-device object recognition into an iOS AR app usually means stitching together Vision, CoreML, and ARKit yourself. This sample shows how the three fit together: it feeds the live AR frame through the Inception V3 model and drops a SceneKit 3D text label at the detected object's location. The whole flow, from camera capture to label placement, lives in one view controller, so it is easy to read top to bottom and adapt. It is also honest about the rough edges, noting that SceneKit text can get polygon-heavy enough to crash on busy scenes and that the pixel format handed to the model (RGB versus YUV) is not fully settled. If you want a quick, readable starting point for prototyping AR object detection rather than a production framework, this.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
opencv
Open Source Computer Vision Library
RuView
π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a single pixel of video.
PaddleOCR
Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PDFs and LLMs. Supports 100+ languages.
MinerU
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
tesseract
Tesseract Open Source OCR Engine (main repository)