Ai Deployment

triton-inference-serverPython

An open-source inference serving platform for deploying AI models from multiple frameworks across cloud, data center, and edge devices.

nndeployC++

A visual workflow-based AI deployment framework for multi-platform and multi-backend inference, supporting large models and edge devices.

BackpropPython

A Python library that simplifies using, finetuning, and deploying state-of-the-art machine learning models for various AI tasks.