Heterogeneous Computing

Colossal-AI - An Integrated Large-scale Model Training System with Efficient Parallelization TechniquesPython

A unified deep learning system for efficient large-scale model training and inference with advanced parallelism strategies.

Paddle - PArallel Distributed Deep LEarning by BaiduC++

An industrial deep learning framework supporting unified dynamic/static graphs, automatic parallelism, and integrated training/inference for large models.

PaddlePaddleC++

An industrial deep learning framework from China supporting unified dynamic/static graphs, automatic parallelism, and integrated training/inference for large models.

TaskflowC++

A fast, expressive, and header-only C++ library for building task-parallel programs with static, dynamic, and conditional task graphs.

Boost.ComputeC++

A C++ GPU computing library providing an STL-like interface for OpenCL-based parallel programming.