Junki Ohmura

What are the biases in my word embedding? Nathaniel Swinger, Maria De-Arteaga, Neil Thomas Heffernan IV, Mark DM Leiserson, Adam Tauman Kalai At AIES 2019: the AAAI/ACM Conference on Artificial...

Generating Wikipedia by Summarizing Long Sequences Peter J. Liu, Mohammad Saleh, Etienne Pot, Ben Goodrich, Ryan Sepassi, Lukasz Kaiser, Noam Shazeer Published as a conference paper at ICLR 2018 https://arxiv.org/abs/1801.10198

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, Luke Zettlemoyer https://arxiv.org/abs/1910.13461

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson https://arxiv.org/abs/2003.11080 Google AI Blog: https://ai.googleblog.com/2020/04/xtreme-massively-multilingual-multi.html Jeff Dean氏のツイート: https://twitter.com/JeffDean/status/1249941468300500998...

Weight Poisoning Attacks on Pre-trained Models Keita Kurita, Paul Michel, Graham Neubig Published as a long paper at ACL 2020 https://arxiv.org/abs/2004.06660 code: https://github.com/neulab/RIPPLe/ ## 概要

Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context Zihang Dai, Zhilin Yang, Yiming Yang, Jaime Carbonell, Quoc V. Le, Ruslan Salakhutdinov ACL 2019 long paper. Code and pretrained models are...

Unified Language Model Pre-training for Natural Language Understanding and Generation Li Dong, Nan Yang, Wenhui Wang, Furu Wei, Xiaodong Liu, Yu Wang, Jianfeng Gao, Ming Zhou, Hsiao-Wuen Hon Accepted by...

The Curious Case of Neural Text Degeneration Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, Yejin Choi Published in ICLR 2020 https://arxiv.org/abs/1904.09751

Optimal Transport-based Alignment of Learned Character Representations for String Similarity Derek Tam, Nicholas Monath, Ari Kobren, Aaron Traylor, Rajarshi Das, Andrew McCallum ACL Long Paper https://arxiv.org/abs/1907.10165v1

Discovering Discrete Latent Topics with Neural Variational Inference Yishu Miao, Edward Grefenstette, Phil Blunsom ICML 2017 https://arxiv.org/abs/1706.00359