Data Processing
Showing 36 of 361 projects
A complete, high-performance JSONPath implementation for Swift, enabling efficient querying and modification of JSON data.
A fluent builder for lazy streams and generators in Groovy, enabling functional-style data processing.
Feature generation code for the Kaggle Acquire Valued Shoppers Challenge, focusing on customer behavior prediction.
A unit test framework for Hive scripts that provides an embedded Hive environment with Derby database and HiveThriftService.
A Go library that converts XML documents into map[string]interface{} structures for flexible data handling.
A command-line JSON formatter and query tool with syntax highlighting and colorization.
Code samples demonstrating how to use popular applications on Amazon Elastic MapReduce (EMR).
A pure PHP library for reading and writing Parquet columnar storage files without external dependencies.
A fast, header-only CSV parser for modern C++ with a versatile API and support for custom types and error handling.
A Common Lisp library providing bit vector arithmetic, type conversions, and measurement functions.
A server application for managing GTFS transit data as part of the TRANSIT-Data-Tools suite.
A generalized map-reduce library for parallel processing on multicore systems, handling large files and infinite streams.
A machine learning solution for predicting job salaries from advertisements, developed for a Kaggle competition.
A Go library and CLI tool for reading, writing, and processing transit data in GTFS and related formats.
A Go library and CLI tool for reading, writing, and processing transit data in GTFS and related formats.
An R package for processing and analyzing high-dimensional morphological profiling data from image-based cell biology.
Python tools to download, process, and analyze data from the Online Encyclopedia of Integer Sequences (OEIS).
A simple XML parser for Elixir designed to parse RSS/Atom feeds.
A Node.js framework for building machine-learning bots with a modular event handling and data processing pipeline.
A Python SDK for deploying teams of AI research agents to forecast, score, classify, and gather data at scale.
A Python tool for stitching large volumetric images from light-sheet fluorescence microscopy.
A Python parser for React's GraphQL query language, converting GraphQL syntax into structured Python dictionaries.
A Node.js utility library for reading and processing GTFS public transit datasets with streaming and memory-efficient operations.
A Python tutorial demonstrating how to access and process Common Crawl's web archive datasets (WARC, WET, WAT) using tools like warcio, cdx_toolkit, and DuckDB.
A Common Lisp library providing functions and macros for manipulating arrays and performing numerical calculations.
A Python library providing tools to process and analyze OMOP-standardized clinical data from AP-HP's Clinical Data Warehouse.
A UNIX command line utility for parsing and formatting CSV files using printf-style syntax.
A framework for keeping biomedical text mining tools running on the latest publications from PubMed.
A curated list of software, tools, and resources for exploring, organizing, and analyzing neuroimaging data with a focus on MRI.
An ActionScript 3.0 library for reading .xlsx Open XML Excel and Open Office spreadsheet files in Flash, Flex, and Air applications.
A reactive stream programming framework for live data computation with concurrent asynchronous operations.
Generates GTFS shapes.txt and GeoJSON files from stop_times.txt using routing APIs like OSRM and Google Maps Directions.
An open-source Policy As Code Engine that programmatically creates and applies data policies to platforms like Snowflake, Databricks, and BigQuery.
A Meteor package that adds proper MongoDB aggregation support to Mongo.Collection instances.
A zero-dependency non-blocking buffered FIFO-pipeline library for Go that executes steps concurrently while maintaining output order.
An OCaml library for parsing RSS and Atom feeds with a focus on type safety and reliability.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.