Is jmeter-aci-terraform still supported for new projects?

No, the project is archived, and the README recommends using Azure Load Testing service instead. It's not actively maintained, so consider it for reference only.

How to customize JMeter tests with my own JMX file in this pipeline?

Update the default sample.jmx file or set the TF_VAR_JMETER_JMX_FILE variable in the pipeline to point to your custom JMX file, as described in the 'Updating the JMX test definition' section.

What are the cost implications of using this load testing solution on Azure?

Costs are based on ephemeral ACI usage during test runs. The project includes estimating costs documentation, but since it's archived, Azure Load Testing service might offer more predictable pricing.

Can I use this with JMeter plugins for advanced testing?

Yes, documentation covers adding JMeter plugins to the custom Docker image, but as the project is archived, you'll need to manage plugin updates and compatibility manually.

How does jmeter-aci-terraform compare to Azure Load Testing service?

This project offers more control with open-source JMeter and Terraform, but Azure Load Testing is a managed service with ongoing support, easier setup, and integrated features, making it better for most teams.

How to view and download JMeter artifacts after a test run?

Artifacts like dashboards and logs are published in Azure DevOps; you can download them via the UI or use az pipelines runs artifact download CLI command, as shown in the viewing artifacts section.

Open-Awesome

Load Testing Pipeline with JMeter, ACI and Terraform

MITHCL250958

Azure DevOps pipeline for scalable cloud load testing using Apache JMeter and Terraform to dynamically provision Azure Container Instances.

GitHub

119 stars95 forks0 contributors

What is Load Testing Pipeline with JMeter, ACI and Terraform?

jmeter-aci-terraform is an Azure DevOps pipeline solution for automated cloud load testing. It combines Apache JMeter for performance testing with Terraform infrastructure provisioning to create scalable, on-demand testing environments on Azure Container Instances. The solution addresses the challenge of running distributed load tests without maintaining permanent infrastructure.

Target Audience

DevOps engineers and performance testing teams working in Azure environments who need to integrate load testing into their CI/CD pipelines. It's particularly useful for organizations already using Azure DevOps and Terraform.

Value Proposition

Developers choose this solution because it provides a complete, automated pipeline for ephemeral load testing infrastructure, reducing costs and operational overhead compared to maintaining dedicated testing environments. The tight integration with Azure DevOps and Terraform makes it ideal for Azure-centric workflows.

Overview

Scalable cloud load/stress testing pipeline solution with Apache JMeter and Terraform to dynamically provision and destroy the required infrastructure on Azure.

Use Cases

Best For

Integrating performance testing into Azure DevOps CI/CD pipelines
Running distributed JMeter tests with scalable worker instances
Automating infrastructure provisioning for temporary testing environments
Teams needing cost-effective load testing with pay-per-use cloud resources
Organizations using Terraform for infrastructure management on Azure
Generating JMeter dashboards and test reports within Azure DevOps

Not Ideal For

Teams using cloud providers other than Azure
Projects requiring load tests longer than 1-6 hours due to Azure DevOps agent limits
Organizations seeking actively maintained, supported open-source solutions
Environments where minimal setup and quick deployment are priorities

Pros & Cons

Pros

Automated Infrastructure Lifecycle

Uses Terraform to dynamically provision and destroy Azure Container Instances, ensuring resources are only active during tests, which optimizes costs as stated in the key features.

Azure DevOps Pipeline Integration

Provides a complete pipeline with SETUP, TEST, RESULTS, and TEARDOWN phases, seamlessly integrating JMeter results into Azure DevOps through JUnit conversion and artifact publishing.

Scalable Distributed Testing

Implements JMeter's remote testing approach with configurable worker counts on ACI, enabling scalable load tests as described in the architecture.

Comprehensive Results Handling

Generates JMeter dashboards and converts test results to JUnit format for detailed reporting in Azure DevOps, enhancing visibility as shown in the viewing results section.

Cons

Archived and Unmaintained

The project is explicitly archived in the README, with a recommendation to use Azure Load Testing service, meaning no updates, bug fixes, or community support.

Complex Initial Setup

Requires multiple tools (Azure CLI, Azure DevOps CLI, jq), Azure resources (ACR, service principal), and involves numerous CLI commands, making onboarding time-consuming and error-prone.

Azure Ecosystem Lock-in

Heavily dependent on Azure-specific services like ACI, Azure DevOps, and Azure Storage, limiting portability and flexibility for multi-cloud or on-premises deployments.

Pipeline Duration Restrictions

Subject to Azure DevOps hosted agent time limits (1-6 hours), which can hinder long-running load tests without investing in custom agents, as noted in limitations.

Open Source Alternative To

Load Testing Pipeline with JMeter, ACI and Terraform is an open-source alternative to the following products:

Azure Load Testing

Azure Load Testing is a fully managed load testing service on Microsoft Azure that helps test application performance and scalability by generating high-scale load.

Frequently Asked Questions

Related Projects

jmeter-ec2

Automates running Apache JMeter on Amazon EC2

Stars461

Forks186

Last commit7 years ago

jmeter-kubernetes

Load testing as a service (LTaaS) with Apache Jmeter on kubernetes

Stars365

Forks250

Last commit2 years ago

kangal

Run performance tests in Kubernetes cluster with Kangal

Stars173

Forks25

Last commit5 months ago

jmeter-k8s-starterkit

Ultimate starterkit for JMeter in Kubernetes. WIth live test reporting, JMeter monitoring, kubernetes monitoring and mock as a service

Stars93

Forks64

Last commit1 year ago

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a project Star on GitHub