what the thing?
Android app that uses your camera to identify objects and translate their names into different languages.
What is what the thing??
What the Thing is an Android application built with React Native that uses computer vision and language translation to help users learn foreign vocabulary in context. By pointing the camera at real-world objects, users can instantly see what those items are called in another language. It combines Clarifai's AI for object recognition with Yandex Translate for language translation.
Android users, language learners, and developers interested in React Native projects that integrate multiple APIs for educational purposes. It's particularly suited for those seeking a practical tool to bridge language barriers through visual recognition.
Developers choose this for its straightforward, camera-based interface that provides real-time object recognition and translation without requiring a development server in bundled builds. As a learning exercise in React Native, it demonstrates how to combine computer vision and translation APIs into a functional app.
Overview
:camera: Point your camera at things to learn how to say them in a different language. Android app built with React Native.
Use Cases
Best For
- Learning foreign vocabulary through visual context by pointing a camera at objects.
- Android developers looking for example React Native projects integrating Clarifai and Yandex APIs.
- Building educational tools that combine computer vision with language translation.
- Creating offline-capable mobile apps for language learning without a development server.
- React Native beginners seeking a practical project to understand API integration and camera usage.
- Developing simple point-and-learn applications for real-time object identification and translation.
Not Ideal For
- Projects requiring iOS support or cross-platform mobile development.
- Applications that need fully offline object recognition without internet connectivity for API calls.
- Commercial use cases where high-volume, reliable API usage is critical, due to dependency on free-tier external services like Clarifai and Yandex.
Pros & Cons
Pros
Uses Clarifai's AI to instantly identify concepts in captured images, providing immediate visual feedback for contextual language learning.
Integrates Yandex Translate API to deliver quick translations of recognized objects, supporting multiple languages for vocabulary acquisition.
Offers a simple point-and-learn interaction directly through the device camera, making it intuitive and engaging for users.
Can create bundled APK builds that don't require a running development server, enabling standalone app installation and usage.
Cons
Built exclusively for Android, so it's unsuitable for iOS users or cross-platform projects without extensive modification.
Relies on third-party services (Clarifai and Yandex) that introduce potential rate limits, downtime, and costs for scaled usage, as noted in the setup requirements.
Based on React Native from 2017, which may have compatibility issues with modern tools and libraries, increasing setup and maintenance effort.
Frequently Asked Questions
Related Projects
F8 App 2017Source code of the official F8 app of 2017, powered by React Native and other Facebook open source projects.
30-days-of-react-native30 days of React Native demos
react-native-nw-react-calculatorMobile, desktop and website Apps with the same code
GitPointGitHub in your pocket :iphone:
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.