TopOpenSourceAI
zh
← Back to scenarios

NLP Tools & Text Processing

Libraries and utilities for core natural-language processing tasks such as language detection, text classification, tokenization, and text normalization.

124 projects

See methodology for ranking rules; order uses public GitHub metrics within this scenario.

101–120 of 124

Rank Project Stars Forks
101 jiant

jiant is an nlp toolkit

1.7K 296
102 BERT-NER-Pytorch

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

2.2K 433
103 nlg-eval

Evaluation code for various unsupervised automated metrics for Natural Language Generation.

1.4K 226
104 insuranceqa-corpus-zh

:helicopter: Insurance industry corpus, chatbot

1.1K 340
105 konlpy

Python package for Korean natural language processing.

1.5K 325
106 Familia

A Toolkit for Industrial Topic Modeling

2.6K 583
107 named_entity_recognition

中文命名实体识别（包括多种模型：HMM，CRF，BiLSTM，BiLSTM+CRF的具体实现）

2.3K 527
108 magnitude

A fast, efficient universal vector embedding utility package.

1.7K 122
109 NeuroNER

Named-entity recognition using neural networks. Easy-to-use and state-of-the-art results.

1.7K 472
110 eda_nlp

Data augmentation for NLP, presented at EMNLP 2019

1.7K 312
111 bi-att-flow

Bi-directional Attention Flow (BiDAF) network is a multi-stage hierarchical process that represents context at different levels of granularity and uses a bi-directional attention flow mechanism to achieve a query-aware context representation without early summarization.

1.5K 667
112 NCRFpp

NCRF++, a Neural Sequence Labeling Toolkit. Easy use to any sequence labeling tasks (e.g. NER, POS, Segmentation). It includes character LSTM/CNN, word LSTM/CNN and softmax/CRF components.

1.9K 436
113 sentiment

AFINN-based sentiment analysis for Node.js.

2.7K 310
114 TextInfoExp

NLP experiments with Sogou dataset: TF-IDF, text classification, clustering, word vectors, sentiment recognition, relation extraction, etc.

1.7K 753
115 datumbox-framework

Datumbox is an open-source Machine Learning framework written in Java which allows the rapid development of Machine Learning and Statistical applications.

1.1K 279
116 textrank

TextRank implementation for Python 3.

1.3K 246
117 xmnlp

xmnlp: Provides Chinese word segmentation, part-of-speech tagging, named entity recognition, sentiment analysis, text correction, text-to-pinyin conversion, text summarization, radical extraction, sentence representation, and text similarity calculation.

1.3K 184
118 THUOCL

THUOCL（THU Open Chinese Lexicon）中文词库

1.1K 213
119 BertSum

Code for paper Fine-tune BERT for Extractive Summarization

1.5K 410
120 nlp_xiaojiang

自然语言处理（nlp），小姜机器人（闲聊检索式chatbot），BERT句向量-相似度（Sentence Similarity），XLNET句向量-相似度（text xlnet embedding），文本分类（Text classification）， 实体提取（ner，bert+bilstm+crf），数据增强（text augment, data enhance），同义句同义词生成，句子主干提取（mainpart），中文汉语短文本相似度，文本特征工程，keras-http-service调用

1.5K 390
< Previous
/ 7
Next >