Data Parallelism
3 projects
Showing 3 of 3 projects
Colossal-AI - An Integrated Large-scale Model Training System with Efficient Parallelization TechniquesPython
A unified deep learning system for efficient large-scale model training and inference with advanced parallelism strategies.
#big-model#distributed-training#ai
Stars41.4k
Forks4.5k
Last commit
RayonRust
A lightweight data-parallelism library for Rust that makes it easy to convert sequential computations into parallel ones.
#no-data-races#parallel-computing#webassembly
Stars12.9k
Forks586
Last commit5 days ago
ADAMScala
A genomics analysis platform that uses Apache Spark to parallelize genomic data processing across clusters, replacing traditional file-based workflows.
#genomic-data#apache-spark#parquet
Stars1.0k
Forks314
Last commit1 month ago
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.