Ai Inference
Showing 5 of 5 projects
An open-source AI engine that runs LLMs, vision, voice, and image/video models on any hardware with drop-in OpenAI API compatibility.
A lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications.
A Python library for building production-ready model inference APIs, job queues, and multi-model serving systems for AI applications.
An open-source LLM function calling framework for building scalable, low-latency AI agents with geo-distributed edge infrastructure.
A portable mixed-precision math library with 2,000+ SIMD kernels for 15+ numeric types across x86, Arm, RISC-V, and WebAssembly.
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.