Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Batch Processing

Batch Processing

120 projects

Showing 36 of 120 projects

Raw Studio
Raw StudioC

An open-source RAW image processor for digital cameras with batch processing and tethered shooting capabilities.

#batch-processing#digital-camera#dng
Stars91
Forks20
Last commit2 years ago
flume
flumeElixir

A job processing system for Elixir applications built on GenStage and Redis, offering durability, back-pressure, and rate limiting.

#scheduled-jobs#elixir-lang#elixir
Stars81
Forks10
Last commit1 month ago
FSquaDRA
FSquaDRAJava

A tool for fast detection of repackaged Android applications by comparing resource file digests from APK signatures.

#digital-forensics#batch-processing#jaccard-similarity
Stars75
Forks26
Last commit3 years ago
capillaries
capillariesGo

A distributed batch data processing framework that handles scalability and intermediate storage, letting users focus on transforms and quality control.

#batch-processing#workflow-engine#message-queue
Stars73
Forks5
Last commit1 month ago
Flume MongoDB Sink
Flume MongoDB SinkJava

A Flume NG sink that writes event data to MongoDB with flexible configuration for collection mapping and data transformation.

#batch-processing#log-aggregation#java
Stars72
Forks62
Last commit3 years ago
AnyiQuack
AnyiQuackPascal

A modern object-oriented animation framework for Delphi using chain-pattern processing and closures.

#batch-processing#plugin-system#animation
Stars68
Forks20
Last commit5 years ago
gtfs-realtime-validator unit tests
gtfs-realtime-validator unit testsJava

A Java-based tool that validates GTFS-realtime transit data feeds against the official specification.

#batch-processing#java#gtfs-realtime
Stars62
Forks15
Last commit
gtfs-realtime-validator
gtfs-realtime-validatorJava

A Java-based tool that validates GTFS-realtime transit data feeds against the official specification.

#batch-processing#java#gtfs-realtime
Stars62
Forks15
Last commit4 months ago
scrubcsv
scrubcsvRust

A command-line tool to clean and normalize CSV files by removing invalid records and standardizing data.

#data-cleaning#csv-processing#batch-processing
Stars57
Forks7
Last commit4 years ago
Apex Chainable Batch
Apex Chainable BatchApex

A Salesforce Apex library for chaining Batchable, Queueable, and Schedulable jobs without hardcoding successors.

#asynchronous-programming#salesforce#apex-batches
Stars56
Forks14
Last commit2 years ago
Anthropic
AnthropicPHP

A PHP client for the Anthropic Claude API with support for messages, streaming, tool use, vision, and batch processing.

#tool-use#ai#batch-processing
Stars48
Forks9
Last commit6 days ago
Fling
FlingF#

A library that reduces boilerplate for efficiently saving and loading complex domain entities across multiple database tables.

#batch-processing#boilerplate-reduction#domain-driven-design
Stars48
Forks1
Last commit8 months ago
dir_walker
dir_walkerElixir

A lazy, depth-first directory tree walker for Elixir that efficiently handles large filesystems.

#stream-processing#directory-traversal#elixir
Stars43
Forks14
Last commit5 years ago
pdfjuicer
pdfjuicerGo

A fast command-line tool written in Go for extracting PDF pages as customizable images and thumbnails.

#batch-processing#thumbnail-generation#command-line-tool
Stars43
Forks0
Last commit9 months ago
p-times
p-timesJavaScript

Run promise-returning and async functions a specific number of times concurrently with configurable options.

#async-control-flow#batch-processing#parallel-execution
Stars42
Forks6
Last commit4 years ago
NEFI2
NEFI2Python

A Python tool that extracts network structures from 2D images and outputs them as weighted undirected planar graphs.

#batch-processing#network-extraction#scientific-tools
Stars40
Forks14
Last commit5 years ago
AnimSheet
AnimSheetGDScript

A Godot editor plugin that automatically converts sprite sheets into ready-to-use AnimationPlayer or AnimatedSprite2D nodes with batch processing.

#batch-processing#workflow-automation#animation-tools
Stars39
Forks5
Last commit4 months ago
ai
aiGo

A comprehensive Go library for building AI agents and applications with unified multi-provider LLM support, tool calling, streaming, and cost tracking.

#ai#batch-processing#aws-bedrock
Stars39
Forks7
Last commit7 days ago
Rhizovision Explorer
Rhizovision ExplorerC++

Open-source software for extracting root system architecture traits from plant root images acquired with scanners or cameras.

#root-analysis#batch-processing#opencv
Stars30
Forks15
Last commit10 months ago
Send Logs to Logdna
Send Logs to LogdnaJavaScript

A Cloudflare Worker recipe that batches and sends logs to LogDNA for centralized logging.

#cloudflare-workers#batch-processing#serverless
Stars26
Forks6
Last commit5 years ago
buckwheat
buckwheatJupyter Notebook

A multi-language tokenizer for extracting identifiers from source code using tree-sitter and pygments parsers.

#multi-language#research-tool#identifier-extraction
Stars24
Forks7
Last commit4 years ago
Tapnesh-CLI
Tapnesh-CLIShell

A CLI bash script that optimizes images in parallel for efficiency and speed.

#batch-processing#jpegoptim#image-optimization
Stars21
Forks3
Last commit6 years ago
bgc
bgcGo

A Go library providing SQL-based datastore connectivity for BigQuery with streaming and load insert methods.

#database-driver#batch-processing#streaming-api
Stars21
Forks8
Last commit2 years ago
nibbler
nibblerGo

A resilient, zero-dependency Go package for in-application micro-batch processing with bounded latency.

#stream-processing#event-processing#batch-processing
Stars17
Forks1
Last commit8 months ago
dynatomic
dynatomicGo

A Go library for using DynamoDB as a fast and reliable atomic counter.

#database#batch-processing#counter
Stars17
Forks3
Last commit5 years ago
MIA
MIAJava

A modular ImageJ/Fiji plugin for assembling image and object analysis workflows with batch processing capabilities.

#image-analysis#batch-processing#modular
Stars17
Forks3
Last commit6 days ago
bqwriter
bqwriterGo

A high-throughput Go package for concurrently streaming data into Google BigQuery using InsertAll or Storage Write APIs.

#batch-processing#concurrent-writes#go-library
Stars16
Forks2
Last commit3 years ago
pachka
pachkaElixir

A reliable message batching library for Elixir applications that collects and delivers messages in configurable batches.

#event-processing#elixir#batch-processing
Stars16
Forks0
Last commit1 year ago
jet
jetGo

A fast command-line tool for find & replace operations using regular expressions across files and directories.

#directory-traversal#batch-processing#file-processing
Stars14
Forks0
Last commit1 year ago
Em-scalebartools
Em-scalebartoolsImageJ Macro

Fiji/ImageJ macros to quickly add a scale bar to an image, with size relative to image dimensions for consistent appearance.

#macro#image-analysis#batch-processing
Stars13
Forks1
Last commit1 year ago
array.chunk
array.chunkJavaScript

A JavaScript utility to split arrays and TypedArrays into chunks of a specified size.

#batch-processing#typedarray#nodejs
Stars12
Forks0
Last commit4 years ago
go-accumulator
go-accumulatorGo

A Go library for batching events and processing them asynchronously or synchronously based on size or time intervals.

#async-processing#batch-processing#data-batching
Stars11
Forks0
Last commit2 months ago
tikalinkextract
tikalinkextractHTML

Extracts hyperlinks from files using Apache Tika for batch processing and web archiving workflows.

#text-extraction#digitalpreservation#code4lib
Stars11
Forks0
Last commit1 year ago
datatrax
datatraxGo

A pure Go toolkit for data engineering and classic machine learning with zero external dependencies.

#batch-processing#deduplication#zero-dependencies
Stars10
Forks0
Last commit3 months ago
Cascading
CascadingJava

Provides HBase adapters for reading and writing data within Cascading data processing workflows on Hadoop clusters.

#cascading#batch-processing#lingual
Stars10
Forks11
Last commit8 years ago
LogLib
LogLib

A Delphi library providing visual and non-visual logging controls with configurable verbosity levels and real-time message display.

#debugging-tools#batch-processing#library
Stars9
Forks3
Last commit3 years ago
PreviousPage 3 of 4

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
4 months ago
Next
#Java17
#Etl15
#Command Line Tool15
#Stream Processing15
#Python11
#Data Processing11
#Image Processing11
#Data Pipeline11
#Data Ingestion10
#Machine Learning10
#Go10
#Big Data9