ftfy
A Python library that fixes mojibake and other Unicode text glitches by detecting and correcting encoding mix-ups.
What is ftfy?
ftfy is a Python library that fixes mojibake and other Unicode text glitches by detecting and correcting encoding mix-ups. It solves the problem of corrupted text data, such as when UTF-8 is misdecoded as another encoding, restoring text to its intended form without altering valid content.
Developers and data scientists working with messy text data from sources like web scraping, legacy systems, or user inputs, particularly in natural language processing (NLP) and data cleaning pipelines.
ftfy offers a reliable, heuristic-based approach to fixing text corruption that avoids false positives, making it a trusted tool for preprocessing text where accuracy is critical. Its ability to handle complex, multi-layer encoding errors sets it apart from basic encoding converters.
Overview
Fixes mojibake and other glitches in Unicode text, after the fact.
Use Cases
Best For
- Cleaning text data from web scraping where encoding issues are common
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
