Inference Engine
Showing 9 of 9 projects
A cross-platform, high-performance accelerator for machine learning inference and training with ONNX models.
A blazing-fast, lightweight deep learning inference engine from Alibaba, optimized for on-device LLMs and Edge AI.
An engine-agnostic deep learning framework for Java developers, providing a high-level API for model training and inference.
A library for running LLMs locally and efficiently on any device with support for Python, Flutter, and Godot.
A lightweight, portable pure C99 ONNX inference engine for embedded devices with hardware acceleration support.
A Flutter plugin providing fast, flexible TensorFlow Lite inference with multi-platform delegate support.
A pure C99 ONNX runtime with zero dependencies, designed for embedded devices and old hardware.
Integrates Intel OpenVINO with ROS 2 for efficient deep learning inference in computer vision applications on Intel hardware.
Open-source software for deep learning-based analysis and visualization of whole slide images in digital pathology.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.