#174 · Primary category: NLP Tools & Text Processing
BERT-Relation-Extraction
PyTorch implementation for "Matching the Blanks: Distributional Similarity for Relation Learning" paper
Project last updated:09/24/23
GitHub Stars
602
Forks
133
Contributors
1
License
Apache-2.0
Why we included this project
This repo is a working PyTorch implementation of the 'Matching the Blanks' relation-learning approach from ACL 2019, and it goes beyond the paper's plain BERT by also supporting ALBERT and BioBERT. The training pipeline pairs entities found in raw text, pre-trains with the matching-the-blanks objective, then fine-tunes on SemEval2010 Task 8; a small inference script lets you tag entities in a sentence and get back a predicted relation such as Cause-Effect. BioBERT support is the standout for anyone working on biomedical text, where domain-specific pretraining tends to help. It is a research codebase rather than a turnkey tool, so plan to adapt the scripts to your own data and label set, but the entity-pairing logic and fine-tuning flow are a solid foundation to build on.
Articles for this project
No articles for this project yet.
To suggest a topic or contribute an article, contact us.
Related projects in this category
flair
A very simple framework for state-of-the-art Natural Language Processing (NLP)
compromise
modest natural-language processing
tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
CoreNLP
CoreNLP: A Java suite of core NLP tools for tokenization, sentence segmentation, NER, parsing, coreference, sentiment analysis, etc.
Chinese-Word-Vectors
100+ Chinese Word Vectors 上百种预训练中文词向量