amazon-kinesis-scaling-utils
A utility for scaling Amazon Kinesis Streams manually or automatically, similar to EC2 Auto Scaling.
What is amazon-kinesis-scaling-utils?
Amazon Kinesis Scaling Utility is an open-source tool that enables dynamic scaling of Amazon Kinesis Streams. It allows users to manually adjust shard counts or deploy an auto-scaling service that monitors stream metrics and automatically scales capacity up or down based on demand. It solves the problem of manually managing Kinesis stream sharding to match fluctuating data ingestion or consumption rates.
AWS developers and data engineers who manage Kinesis Streams with variable throughput and need to optimize cost and performance through automated scaling.
Developers choose this utility because it provides a programmatic, auto-scaling approach to Kinesis stream management—similar to EC2 Auto Scaling—reducing operational overhead and ensuring streams have adequate capacity without manual intervention.
Overview
The Kinesis Scaling Utility is designed to give you the ability to scale Amazon Kinesis Streams in the same way that you scale EC2 Auto Scaling groups – up or down by a count or as a percentage of the total fleet. You can also simply scale to an exact number of Shards. There is no requirement for you to manage the allocation of the keyspace to Shards when using this API, as it is done automatically.
Use Cases
Best For
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
