NLP Tools & Text Processing

Libraries and utilities for core natural-language processing tasks such as language detection, text classification, tokenization, and text normalization.

124 projects

See methodology for ranking rules; order uses public GitHub metrics within this scenario.

21–40 of 124

Rank Project Stars Forks
21 libpostal

A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

4.9K 470
22 json_repair

Repair malformed JSON from LLMs, APIs, logs, and user input in Python.

5.1K 214
23 flashtext

Extract Keywords from sentence or Replace keywords in sentences.

5.7K 597
24 ltp

Language Technology Platform

5.3K 1.1K
25 WantWords

An open-source online reverse dictionary.

7.1K 611
26 spark-nlp

State of the Art Natural Language Processing

4.2K 744
27 Synonyms

:herb: Chinese synonyms: chatbot, intelligent Q&A toolkit

5.1K 886
28 nlpaug

Data augmentation for NLP

4.7K 473
29 simpletransformers

Transformers for Information Retrieval, Text Classification, NER, QA, Language Modelling, Language Generation, T5, Multi-Modal, and Conversational AI

4.3K 713
30 text2vec

text2vec, text to vector.

5.0K 428
31 DeepKE

[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction

4.5K 750
32 Promptify

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

4.6K 364
33 OpenPrompt

An Open-Source Framework for Prompt-Learning.

4.9K 476
34 gigatoken

Language model tokenization at GB/s

4.1K 218
35 TextAttack

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP https://textattack.readthedocs.io/en/master/

3.5K 459
36 JioNLP

中文 NLP 预处理、解析工具包,准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com

3.9K 441
37 sumy

Module for automatic summarization of text documents and HTML pages.

3.7K 539
38 textlint

textlint is the pluggable linter for natural language text.

3.2K 166
39 franc

Natural language detection

4.4K 182
40 MatchZoo

Facilitating the design, comparison and sharing of deep text matching models.

3.9K 890