Inference Acceleration
5 projects
Showing 5 of 5 projects
NebullvmPython
A collection of libraries to optimize AI model performance through inference acceleration, infrastructure efficiency, and fine-tuning optimization.
#ai-optimization#ai#cost-reduction
Stars8.3k
Forks614
Last commit2 years ago
SpeedsterPython
A collection of libraries to optimize AI model performance through inference, infrastructure, and fine-tuning techniques.
#ai-optimization#ai#ai-infrastructure
Stars8.3k
Forks614
Last commit2 years ago
Whisper JAXJupyter Notebook
A JAX implementation of OpenAI's Whisper model offering up to 70x faster transcription on TPUs.
#parallel-computing#jax#deep-learning
Stars4.7k
Forks410
Last commit2 years ago
CurvineRust
A high-performance, concurrent distributed cache system built in Rust for low-latency, high-throughput workloads.
#opendal#multi-tier-cache#ai
Stars935
Forks112
Last commit11 hours ago
whisper-openvinoJupyter Notebook
A fork of OpenAI's Whisper speech recognition models optimized with OpenVINO backend for faster CPU inference.
#intel#cpu-optimization#asr
Stars185
Forks16
Last commit2 years ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.