Kevin Canwen Xu

⛵️The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).

JetRunner

Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning".

JetRunner

Baseline code for NAACL 2021 paper "Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge"

JetRunner

🦮 Code and pretrained models for Findings of ACL 2022 paper "LaPraDoR: Unsupervised Pretrained Dense Retriever for Zero-Shot Text Retrieval"

JetRunner

Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".

JetRunner

Code for "Small Models are Valuable Plug-ins for Large Language Models"

JetRunner