A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
💁 Awesome Treasure of Transformers Models for Natural Language processing contains papers, videos, blogs, official repo along with colab Notebooks. 🛫☑️
ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723
PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT
PhoBERT: Pre-trained language models for Vietnamese (EMNLP-2020 Findings)
:house_with_garden: Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.
Open-source offline translation library written in Python
Language models are open knowledge graphs ( non official implementation )