UCall
A high-performance JSON-RPC and REST library for Python and C, leveraging io_uring and SIMD for ultra-low latency and high throughput.
What is UCall?
UCall is a remote procedure call library that implements JSON-RPC and REST over TCP/HTTP with a focus on extreme performance. It solves the problem of high latency and low throughput in traditional web serving libraries by leveraging Linux io_uring and SIMD-accelerated parsers, making it ideal for high-demand microservices and AI applications.
Developers building high-performance microservices, real-time AI inference pipelines, or any system where low-latency RPC is critical, especially those deploying on Linux with kernel 5.19+.
Developers choose UCall for its unmatched performance—up to 100x faster than FastAPI—and its ability to handle custom data types like NumPy arrays natively, all while maintaining a simple API comparable to mainstream frameworks.
Overview
Web Serving and Remote Procedure Calls at 50x lower latency and 70x higher bandwidth than FastAPI, implementing JSON-RPC & REST over io_uring ☎️
Use Cases
Best For
- Building ultra-low-latency microservices requiring high request throughput
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
