chardet
A Python library that automatically detects the character encoding of text files and byte streams with high accuracy and speed.
What is chardet?
chardet is a Python library that automatically detects the character encoding of text files and byte streams. It solves the problem of handling unknown text encodings by analyzing byte patterns to determine whether data is UTF-8, Windows-1252, EUC-JP, or any of 99 supported encodings, preventing garbled text and decoding errors in applications that process diverse text sources.
Python developers working with text processing, data ingestion pipelines, web scraping, internationalization, or any application that handles files from unknown or multiple encoding sources.
Developers choose chardet for its exceptional 99.3% accuracy, 47x speed improvement over previous versions, language detection capabilities, and backward-compatible API that makes it a drop-in replacement while offering modern features like MIME type detection and encoding filters.
Overview
Python character encoding detector
Use Cases
Best For
- Processing text files with unknown character encodings in data pipelines
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
