datalad
A decentralized data management system built on Git and git-annex for versioning and distributing large datasets.
What is datalad?
DataLad is a decentralized data management system built on Git and git-annex that enables version control, distribution, and tracking of large datasets, code, and containers. It solves the problem of managing and sharing scientific data by providing Git-like workflows for data, making it easier to collaborate, reproduce research, and maintain provenance.
Researchers, data scientists, and developers working with large datasets in fields like neuroscience, biomedicine, or any domain requiring reproducible data management and distribution.
Developers choose DataLad because it extends familiar Git workflows to data, offers decentralized architecture without central server dependency, and integrates seamlessly with existing data providers and portals for automated ingestion.
Overview
Keep code, data, containers under control with git and git-annex
Use Cases
Best For
- Managing and versioning large scientific datasets with full provenance tracking
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
