Bulk Processing
3 projects
Showing 3 of 3 projects
webarchive-indexingPython
MapReduce tools for bulk indexing of web archive WARC/ARC files into ZipNum sharded CDX clusters on Hadoop, EMR, or local systems.
#mapreduce#mrjob#zipnum-cluster
Stars46
Forks12
Last commit8 years ago
elasticsearch_elixir_bulk_processorElixir
A configurable GenStage-based bulk processor for efficiently inserting data into Elasticsearch from Elixir applications.
#hacktoberfest#elixir#backpressure
Stars14
Forks1
Last commit
golem-bulk-image-handlerPython
A Python application that leverages the Golem Network to process images in bulk across distributed providers.
#python#image-processing#docker
Stars0
Forks0
Last commit4 years ago
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.