pulsar-io-tdengine

HiveMQ TDengine Plugin

The HiveMQ TDengine Extension is a plugin that seamlessly bridges MQTT messaging with time-series data storage. It intercepts all messages published to a HiveMQ broker and persistently writes them to a TDengine database, enabling real-time IoT and telemetry data ingestion and analysis. ## Key Features - **Real-time Data Ingestion** — Intercepts and asynchronously writes every MQTT publish message to TDengine. - **Dual Write Methods** — Supports writing data via both HTTP and native TDengine SDK connections. - **Automatic Schema Management** — Creates the required database and table on startup based on configuration. - **Payload Encoding Handling** — Automatically attempts Base64 encoding if the payload contains characters incompatible with GBK encoding. - **Concurrency Safety** — Implements locking mechanisms to handle high-concurrency writes and avoid SDK pointer errors. ## Architecture The plugin consists of three core Java classes: `TDengineExtension` serves as the main entry point, managing the plugin lifecycle and configuration. `TDengine` handles all database connectivity, initialization, and the save operations. `TDengineInterceptor` is triggered on inbound publish events to call the asynchronous save method. ## Philosophy The extension is designed for simplicity and reliability, automating database setup and providing robust error handling to ensure continuous data flow from MQTT topics into structured time-series storage.

rsyslog plugin for tdengine

rsyslog plugin for tdengine

HiveMQ-TDengine-Extension

a TDengine extension for HiveMQ.

hivemq-tdengine-jdsl-extension

The HiveMQ TDengine JDSL Plugin is an experimental extension for HiveMQ that intelligently routes and stores published MQTT data into a TDengine time-series database. It enables users to define flexible JSON templates and storage strategies through configuration, automating the data ingestion process without writing custom code. ## Key Features **Custom JSON Templating** — Define JSON templates with variable placeholders (e.g., `$gateway$`) to map MQTT payloads to TDengine schemas. **Dynamic SQL Generation** — Automatically generates TDengine SQL statements (CREATE DATABASE, CREATE TABLE, IMPORT) based on templates and incoming data. **Flexible Storage Policies** — Configure database names, super tables, tags, and data retention (keep days) per topic or template. **Asynchronous Processing** — Uses an interceptor to asynchronously save data on inbound publish events, minimizing impact on HiveMQ performance. **Multi-Platform Support** — Leverages a Go-based JDSL core compiled to native libraries (Linux/Windows) with a Java JNA wrapper for cross-platform compatibility. ## Philosophy The project embraces an experimental, configuration-driven approach, allowing users to "store what they imagine" into TDengine by simply defining JSON templates, prioritizing flexibility and automation over rigid schemas.