How to install MQTT-Malaria on Ubuntu?

First, ensure Python 2 is installed, then use virtualenv to create an environment, activate it, and run 'pip install .' as per the README. Note the dependency on fusepy, which may require separate installation via package managers like apt.

MQTT-Malaria vs mqtt-benchmark: which is better for load testing?

MQTT-Malaria excels in realistic multi-client simulation with detailed timing statistics, but mqtt-benchmark is more actively maintained and may support newer MQTT features. For legacy testing or statistical depth, MQTT-Malaria is useful; for modern needs, consider alternatives like mqtt-benchmark.

Does MQTT-Malaria support MQTT 5.0?

No, MQTT-Malaria is based on older paho-mqtt libraries and does not support MQTT 5.0 features. It's designed for MQTT 3.1/3.1.1 protocols, so for testing MQTT 5.0 brokers, you'll need to look at other tools or update the codebase.

How to simulate 1000 concurrent publishers with MQTT-Malaria?

Use the 'malaria publish' command with -P 1000 flag to spin up 1000 processes. Adjust ulimit settings as warned in the README to avoid system resource limits, and specify message count and size with -n and -s flags for control.

Can MQTT-Malaria test with TLS/SSL enabled brokers?

The README does not mention TLS/SSL support in command options, so it likely only supports plain TCP connections. For secure brokers, you would need to modify the source code or use wrapper scripts, as no built-in functionality exists.

What are the key metrics provided by MQTT-Malaria?

It outputs message success rate, mean and standard deviation of timing, min/max times, and messages per second for each client and in aggregate. These metrics help identify performance bottlenecks and reliability issues in MQTT brokers.

Is MQTT-Malaria still maintained in 2024?

No, the project status indicates it has not been used internally since 2015 and is not in active development. The maintainers may review bugfixes but do not plan new features, making it a legacy tool with limited support.

Open-Awesome

mqtt-malaria

BSD-2-ClausePython

A set of Python tools for scalability and load testing of MQTT environments by simulating high-volume publishers and subscribers.

GitHub

265 stars57 forks0 contributors

What is mqtt-malaria?

MQTT-Malaria is a Python-based toolset for load testing and scalability analysis of MQTT message brokers and systems. It simulates high volumes of MQTT publishers and subscribers to measure performance, message delivery reliability, and timing characteristics under various load conditions. The project helps identify bottlenecks and validate the capacity of MQTT infrastructures.

Target Audience

IoT developers, MQTT system administrators, and performance engineers who need to validate the scalability and reliability of their MQTT-based messaging systems before deployment.

Value Proposition

Unlike generic load testing tools, MQTT-Malaria is specifically designed for MQTT protocols with features like QoS simulation, timing-instrumented messages, and multi-process client emulation. It provides detailed statistical output that helps pinpoint performance issues in MQTT broker implementations.

Overview

Attacking MQTT systems with Mosquittos (scalability and load testing utilities for MQTT environments)

Use Cases

Best For

Testing MQTT broker performance under high concurrent client loads
Simulating realistic IoT device message patterns with controlled publish rates
Measuring message delivery latency and reliability across different QoS levels
Validating MQTT infrastructure scalability before production deployment
Comparing performance between different MQTT broker implementations
Stress testing MQTT systems with thousands of simulated publishers and subscribers

Not Ideal For

Projects requiring modern Python 3 compatibility and active community support
Teams looking for a GUI-based or real-time monitoring interface for load testing
Scenarios where testing needs to include MQTT 5.0 features or non-MQTT messaging protocols
Environments needing out-of-the-box TLS/SSL security testing for MQTT brokers

Pros & Cons

Pros

Realistic Multi-Client Simulation

Uses multi-process publishing with the -P flag to mimic hundreds or thousands of separate MQTT clients concurrently, as demonstrated in examples simulating 500 processes.

Configurable Message Patterns

Supports fixed-size, Gaussian-distributed message sizes, and timing-instrumented payloads for flight time tracking, allowing varied and realistic test scenarios.

Rate-Controlled Publishing

Allows setting target messages per second with the -T flag, enabling simulation of real-world device behavior and controlled load generation.

Detailed Statistical Output

Provides per-client and aggregate metrics including success rates, mean/stddev timing, and messages per second, as evidenced in the verbose example outputs with timing data.

Cons

Outdated Dependencies

Requires Python 2 and paho-mqtt library from 2015, which are no longer supported and may have compatibility issues with modern systems and broker implementations.

Limited Subscriber Features

Subscriber side requires timing-instrumented payloads and operates in single-threaded mode, limiting flexibility for multi-threaded or varied subscriber testing scenarios.

Dormant Project Status

The project has not been actively developed since 2015, with minimal bugfix support and no new features, as explicitly stated in the README status section.

System Configuration Complexity

For high process counts, manual adjustment of ulimit settings is required, adding complexity to setup and execution for large-scale tests.

Frequently Asked Questions

Related Projects

MQTTX

A Powerful and All-in-One MQTT 5.0 client toolbox for Desktop, CLI and WebSocket.

Stars4,915

Forks534

Last commit2 days ago

MQTT TUI

Subscribe to a MQTT Topic or publish something quickly from the terminal

Stars669

Forks36

Last commit7 days ago

hivemq-mqtt-web-client

A websockets based MQTT Client for your browser.

Stars361

Forks137

Last commit2 years ago

MQTT CLI

MQTT CLI is a useful command line interface for connecting various MQTT clients supporting MQTT 5.0 and 3.1.1