ONNX runtime
A cross-platform, high-performance accelerator for machine learning inference and training with ONNX models.
What is ONNX runtime?
ONNX Runtime is a cross-platform inference and training accelerator for machine learning models in the ONNX format. It enables faster model execution and lower deployment costs by optimizing performance across different hardware platforms while supporting models from popular frameworks like PyTorch, TensorFlow, and scikit-learn.
Machine learning engineers and developers who need to deploy trained models in production environments with high performance requirements across diverse hardware configurations.
Developers choose ONNX Runtime for its exceptional performance optimizations, broad framework compatibility, and ability to leverage hardware accelerators without rewriting model code, making it ideal for production ML deployments.
Overview
ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
Use Cases
Best For
- Deploying PyTorch or TensorFlow models to production with minimal latency
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
