Data Parallelism
4 projects
Showing 4 of 4 projects
Colossal-AI - An Integrated Large-scale Model Training System with Efficient Parallelization TechniquesPython
A unified deep learning system for efficient large-scale model training and inference with advanced parallelism strategies.
#big-model#distributed-training#ai
Stars41.4k
Forks4.5k
Last commit
RayonRust
A lightweight data-parallelism library for Rust that makes it easy to convert sequential computations into parallel ones.
#no-data-races#parallel-computing#webassembly
Stars13.0k
Forks588
Last commit1 month ago
ADAMScala
A genomics analysis platform that uses Apache Spark to parallelize genomic data processing across clusters, replacing traditional file-based workflows.
#genomic-data#apache-spark#parquet
Stars1.1k
Forks313
Last commit2 months ago
Minerva - a fast and flexible tool for deep learning on multi-GPUC++
A fast and flexible deep learning system with NumPy-like NDarray interface and easy multi-GPU support.
#multi-gpu#c-bindings#deep-learning
Stars711
Forks173
Last commit
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.