StreamCQL

StreamCQL is a Continuous Query Language (CQL) implementation built on top of Apache Storm for real-time computation systems. It enables SQL-like querying over data streams, introducing window concepts for in-memory processing to deliver fast, moment-in-time results. The project addresses the complexity of native Storm APIs by providing a unified SQL interface, making stream processing more accessible to developers familiar with SQL.

Key Features

• SQL-Like Syntax — Allows users to define and query data streams using familiar SQL statements, reducing the learning curve compared to low-level Storm APIs.
• Window-Based Processing — Supports time-based and row-based windows (slide and tumble) to handle unbounded streaming data by creating static views for query operations.
• Stream and Sink Definitions — Enables declarative creation of input/output streams with connectors like Kafka and console output for flexible data pipeline integration.
• Unified Client Interface — Uses SQL and commands to execute and distribute tasks, eliminating the need for separate client API code and simplifying deployment.
• Real-Time In-Memory Computation — Stores data in memory for rapid processing, delivering query results at specific moments in the data stream lifecycle.

Philosophy

StreamCQL is designed to lower the barrier to real-time stream processing by leveraging SQL’s widespread familiarity, allowing users to develop operational programs with minimal additional syntax learning.