wdt
A high-performance embedded library and CLI tool for multi-TCP data transfer between systems at near-hardware speeds.
What is wdt?
WDT (Warp speed Data Transfer) is an embeddable C++ library and command-line tool for high-speed data transfer between systems over multiple TCP connections. It solves the problem of slow data movement across networks by parallelizing transfers to achieve near-hardware-limited speeds, significantly outperforming traditional HTTP-based solutions.
System engineers, DevOps teams, and developers who need to transfer large datasets (like database snapshots or bulk files) between servers with minimal latency and maximum throughput, especially in data center or cross-region scenarios.
Developers choose WDT for its ability to saturate high-bandwidth network links (e.g., 40 Gbit/s) with minimal CPU overhead, its support for transfer resumption, and its embeddable library design that avoids heavy dependencies while delivering 3x faster speeds than optimized HTTP alternatives.
Overview
Warp speed Data Transfer (WDT) is an embeddedable library (and command line tool) aiming to transfer data between 2 systems as fast as possible over multiple TCP paths.
Use Cases
Best For
- Transferring RocksDB or other database snapshots between hosts
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
