ChatARKit
An iOS app that uses ChatGPT to generate ARKit code from spoken prompts, placing and manipulating 3D objects in augmented reality.
What is ChatARKit?
ChatARKit is an iOS application that uses ChatGPT to generate ARKit code from natural language prompts, enabling users to create augmented reality scenes by speaking commands. It translates spoken instructions into JavaScript that manipulates 3D objects in AR, such as placing models on detected surfaces and animating them. The project is an experiment in leveraging large language models for code generation in custom API environments.
iOS developers and AR enthusiasts interested in exploring AI-driven content creation, particularly those experimenting with ChatGPT integration and natural language interfaces for augmented reality.
Developers choose ChatARKit for its novel approach to AR prototyping, allowing rapid scene creation without manual coding. Its integration of Whisper for speech recognition and Sketchfab for 3D assets provides a streamlined, albeit experimental, pipeline for AI-generated AR experiences.
Overview
Using ChatGPT to create AR experiences with natural language.
Use Cases
Best For
- Prototyping AR scenes quickly using voice commands
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
