Defects4J
A database of reproducible real-world Java bugs and a framework for controlled software engineering experiments.
What is Defects4J?
Defects4J is a database and experimental infrastructure for software engineering research. It provides a collection of real, reproducible bugs from open-source Java projects, along with tools to checkout, compile, test, and analyze these bugs in a controlled manner. It solves the problem of inconsistent or synthetic benchmarks by offering a standardized platform for evaluating techniques like automated testing and program repair.
Software engineering researchers and practitioners focusing on empirical studies, automated testing, program repair, fault localization, and test generation who need a reliable benchmark of real-world Java faults.
Developers and researchers choose Defects4J because it offers a large, curated set of real faults with guaranteed reproducibility, a comprehensive CLI for controlled experimentation, and rich metadata—making it the de facto standard benchmark for many software engineering research areas.
Overview
A Database of Real Faults and an Experimental Infrastructure to Enable Controlled Experiments in Software Engineering Research
Use Cases
Best For
- Evaluating automated program repair (APR) techniques on real Java bugs
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
