Word Segmentation
4 projects
Showing 4 of 4 projects
SentencePieceC++
An unsupervised text tokenizer and detokenizer for neural network-based text generation systems with subword units.
#machine-translation#neural-machine-translation#neural-networks
Stars11.9k
Forks1.4k
Last commit2 days ago
pkuseg-pythonPython
A multi-domain Chinese word segmentation toolkit offering higher accuracy and domain-specific models.
#part-of-speech-tagging#computational-linguistics#python-library
Stars6.7k
Forks982
Last commit3 years ago
SnowNLPPython
A Python library for processing simplified Chinese text, offering sentiment analysis, segmentation, and keyword extraction.
#part-of-speech-tagging#python-library#simplified-chinese
Stars6.6k
Forks1.4k
Last commit6 years ago
MMSEGOGo
A Go implementation of the MMSEG Chinese word segmentation algorithm for text processing.
#text-analysis#mmseg-algorithm#go-library
Stars62
Forks14
Last commit14 years ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.