Inference Engine
3 projects
Showing 3 of 3 projects
ONNX runtimeC++
A cross-platform, high-performance accelerator for machine learning inference and training with ONNX models.
#ai-framework#performance-optimization#deep-learning
Stars19.9k
Forks3.8k
Last commit1 day ago
MNNC++
A blazing-fast, lightweight deep learning inference engine from Alibaba, optimized for on-device LLMs and Edge AI.
#vulkan#winograd-algorithm#neural-network
Stars15.0k
Forks2.3k
Last commit3 days ago
djlJava
An engine-agnostic deep learning framework for Java developers, providing a high-level API for model training and inference.
#ai#neural-network#model-training
Stars4.8k
Forks744
Last commit10 days ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.