Tensorrt

FluxPython

Minimal inference code for running FLUX.1 open-weight models for image generation and editing.

TensorRTC++

NVIDIA's SDK for high-performance deep learning inference optimization and deployment on NVIDIA GPUs.

DeepDetectC++

An open-source deep learning API and server written in C++ that supports multiple backends like PyTorch, TensorRT, and TensorFlow for training and inference.

nndeployC++

A visual workflow-based AI deployment framework for multi-platform and multi-backend inference, supporting large models and edge devices.