Paper reading (2019)

このセミナーについて (About this seminar)

担当者が見つけた面白い研究を紹介するセミナーです．以下の内容で構成されます． In this seminar, presenters share interesting studies that they found. The seminar consists of the following elements.

  1. 論文紹介 (Paper presentation): 面白いと思う論文を選んで，その内容を著者の代わりになったつもりで発表する． A presenter reads a paper that he or she finds interesting, and explains the content as if he or she was an author of the paper.
  2. 著者プレゼンの上映と解説 (Watching talk videos): 担当者は面白いと思う研究の発表動画を選び，その論文の内容を把握する．担当者の補足説明を聞きながら，参加者みんなで発表動画を鑑賞する． Finding an interesting video presentation, a presenter reads and understands the content of the paper. Attendees watch the presentation video of the author of the paper. The presenter is expected to explain supplementary information about the research.

前者 (1) はプレゼンテーションの練習を兼ねています．後者 (2) は「よい」プレゼンテーションを鑑賞しながら，英語でのプレゼンテーションやディスカッションに慣れることを狙っています． The former (1) aims at practicing presentations. The latter (2) aims at improving listening and discussion skills in English as we enjoy good presentations.

日時 (Date and time)

  • Wednesday 16:50~

参加者 (Attendee)

  • 全員



As of September 9, there are no videos for NAACL 2019 and ACL 2019.


今後の予定 (Planned schedule)

2019-10-23 (Wed) 16:50

  • Erick: Mix-review: Alleviate Forgetting in the Pretrain-Finetune Framework for Neural Language Generation Models. In review for ICLR 2020. slides.

  • Nakamura: Tianxiao Shen · Myle Ott · Michael Auli · Marc’Aurelio Ranzato, Mixture Models for Diverse Machine Translation: Tricks of the Trade, ICML 2019, paper, video

2019-10-30 (Wed) 16:50

  • Matsumaru
  • Nobori

2019-11-06 (Wed) 16:50

  • Takase
  • Sasazawa

2019-11-13 (Wed) 16:50

  • Fukushima
  • Mizuki: FRANKLE, Jonathan; CARBIN, Michael. The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks. In: ICLR 2019. 2018. paper, video
    • ICLR 2019 Best Paper Awards

2019-11-20 (Wed) 16:50

  • Nakamura
  • Koyama
    • Improving Grammatical Error Correction via Pre-Training a Copy-Augmented Architecture with Unlabeled Data.
      • Wei Zhao, Liang Wang, Kewei Shen, Ruoyu Jia, Jingming Liu. NAACL 2019. paper, video.

2019-11-27 (Wed) 16:50

  • Sasazawa
  • Ma

2019-12-04 (Wed) 16:50

  • Yang
  • Wiem

2019-12-11 (Wed) 16:50

  • Niwa
  • Ueki

2019-12-18 (Wed) 16:50

  • Nobori
  • Takase

2019-12-25 (Wed) 16:50

  • Koyama
    • An Empirical Study of Incorporating Pseudo Data into Grammatical Error Correction.
      • Shun Kiyono, Jun Suzuki, Masato Mita, Tomoya Mizumoto, Kentaro Inui. EMNLP 2019. paper.
    • or(I will choose later)
    • Levenshtein Transformer.
      • Jiatao Gu, Changhan Wang, Jake Zhao. paper.
  • Sangwhan

2020-01-01 (Wed) 16:50

  • Ueki
  • Hiraoka

過去の記録 (Past seminars)

2019-04-03 (Wed) 16:50

  • sasazawa:A Deep Neural Network Sentence Level Classification Method with Context Information.Xingyi Song, Johann Petrak, Angus Roberts.EMNLP 2018:(slide)
  • matsumaru: SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inference. Rowan Zellers, Yonatan Bisk, Roy Schwartz, Yejin Choi. EMNLP 2018. (paper, video)

2019-04-10 (Wed) 16:50

  • ema: Linguistically-Informed Self-Attention for Semantic Role Labeling. Emma Strubell, Patrick Verga, Daniel Andor, David Weiss, Andrew McCallum. EMNLP 2018. [slides] [paper] [video]

2019-04-17 (Wed) 16:50

  • Erick: Attention Based Natural Language Grounding by Navigating Virtual Environment. Akilesh B, Abhishek Sinha, Mausoom Sarkar, Balaji Krishnamurthy [slides]
  • Okazaki: Jie Lei, Licheng Yu, Mohit Bansal, and Tamara L. Berg. TVQA: Localized, Compositional Video Question Answering. EMNLP 2018. [paper] [video]

2019-04-24 (Wed) 16:50

  • mizuki: KUMAR, Sachin; TSVETKOV, Yulia. Von Mises-Fisher Loss for Training Sequence to Sequence Models with Continuous Outputs. In: ICLR 2019. 2019. slides
  • yang: Xianda Zhou, William Yang Wang. Mojitalk: Generating emotional responses at scale. ACL 2018 video, Paper

2019-05-08 (Wed) 16:50

  • Wan: Nan Wang, Xibin Zhao, Yu Jiang, Yue Gao, Iterative Metric Learning for Imbalance Data Classification IJCAI2018 slide,paper
  • niwa : Rashkin, Hannah, et al. “Modeling naive psychology of characters in simple commonsense stories.” ACL2018 paper, video

2019-05-15 (Wed) 16:50

  • okazaki
  • ema: Beyond Error Propagation in Neural Machine Translation: Characteristics of Language Also Matter. Lijun Wu, Xu Tan, Di He, Fei Tian, Tao Qin, Jianhuang Lai, Tie-Yan Liu. EMNLP 2018. [paper][video]

2019-05-22 (Wed) 16:50

  • yang: Text Understanding from Scratch. Xiang Zhang, Yann LeCun slides
  • sasazawa: Rumor Detection on Twitter with Tree-structured Recursive Neural Networks.Jing Ma, Wei Gao, Kam-Fai Wong.ACL 2018. (video, paper)

2019-05-29 (Wed) 16:50

Cancelled due to the talk in Tokyo univ.

2019-06-05 (Wed) 16:50

  • matsumaru: Attention is not Explanation. Sarthak Jain and Byron C. Wallace. NAACL 2019. slides
  • Erick: Localizing Moments in Video with Temporal Language. Hendricks et al 2018. EMNLP 2018 paper, talk

2019-06-12 (Wed) 16:50

  • ema: Choosing Transfer Languages for Cross-Lingual Learning. Lin et al. ACL 2019. [slides]
  • Takase Mizuki: Discovering Discrete Latent Topics with Neural Variational Inference. Yishu Miao et al. ICML 2017. summary

2019-06-19 (Wed) 16:50

  • Nakamura: A Unified Model for Extractive and Abstractive Summarization using Inconsistency Loss, [paper](https://aclweb.org/anthology/P18-1013), [talk](https://vimeo.com/showcase/5391494/video/285800568)

2019-06-26 (Wed) 16:50

  • niwa: Text Generation with Exemplar-based Adaptive Decoding. Hao Peng et al. NAACL2019. slides
  • takase: Alexey Romanov, Anna Rumshisky, Anna Rogers, David Donahue. Adversarial Decomposition of Text Representation. NAACL 2019. slide
  • Sangwhan: Simplified Abugidas. Ding et al. ACL 2018. paper, talk

2019-07-03 (Wed) 16:50

  • sasazawa: Han Guo,Ramakanth Pasunuru,Mohit Bansal. Soft Layer-Specific Multi-Task Summarization with Entailment and Question Generation .ACL 2018 slide
  • Hiraoka: Learning Neural Templates for Text Generation. EMNLP2018. paper, video

2019-07-10 (Wed) 16:50

  • Erick: Dense Procedure Captioning in Narrated Instructional Videos. ACL 2019 pdf

2019-07-17 (Wed) 16:50

  • Hiraoka: Misspelling Oblivious Word Embeddings, NAACL 2019, slides
  • Ueki:Numeracy for Language Models: Evaluating and Improving their Ability to Predict Numbers(ACL2018) paper,video

2019-07-24 (Wed) 16:50

  • Sangwhan: Universal Language Model Fine-tuning for Text Classification. Slides
  • Fukushima: Hierarchical Neural Story Generation, ACL 2018, paper, video

2019-07-31 (Wed) 16:50

  • Nakamura: Jointly Extracting and Compressing Documents with Summary State Representations, NACCL2019 pdf
  • Nobori:Did the Model Understand the Question? paper, video

2019-08-07 (Wed) 16:50

  • Nobori : Asking the Right Question: Inferring Advice-Seeking Intentions from Personal Narratives (paper,slide)
  • Koyama:Fluency Boost Learning and Inference for Neural Grammatical Error Correction (paper,video)
    • additional experiments are refered to in
      • Reaching Human-Level Performance in Automatic Grammatical Error Correction: An Empirical Study (paper)

2019-09-04 (Wed) 16:50

  • Koyama Corpora Generation for Grammatical Error Correction NAACL 2019 slide

  • Mizuki Takase Erick: Phrase-Based & Neural Unsupervised Statistical Machine Translation Emnlp 2018 video, paper

2019-09-11 (Wed) 16:50

  • Fukushima: Ankur Bapna et al., Non-Parametric Adaptation for Neural Machine Translation, NAACL 2019 slide

  • Okazaki Takase: Jiaji Huang, Yi Li, Wei Ping, Liang Huang. Large Margin Neural Language Model. EMNLP 2018. paper, video

2019-09-18 (Wed) 16:50

  • Ueki:Consistency by Agreement in Zero-shot Neural Machine Translation NAACL 2019: slide

  • Matsumaru: Kaitao Song, Xu Tan, Tao Qin, Jianfeng Lu, Tie-Yan Liu. MASS: Masked Sequence to Sequence Pre-training for Language Generation. ICML 2019. paper, video, slide by author

2019-09-25 (Wed) 16:50

  • Mizuki: Fabio Petroni et al. Language Models as Knowledge Bases?. To appear: EMNLP 2019. 2019. slide

  • Erick Okazaki: Xiang Li, Luke Vilnis, Dongxu Zhang, Michael Boratko, Andrew McCallum. Smoothing the Geometry of Probabilistic Box Embeddings. ICLR 2019. paper, video

2019-10-02 (Wed) 16:50

  • Okazaki: Yau-Shian Wang, Hung-Yi Lee, Yun-Nung Chen. Tree Transformer: Integrating Tree Structures into Self-Attention. to appear in EMNLP 2019. slides (3.5 MB)

  • Yang: Caglayan, Ozan, Pranava Madhyastha, Lucia Specia, and Loïc Barrault. “Probing the Need for Visual Context in Multimodal Machine Translation.” arXiv preprint arXiv:1903.08678 (2019).paper, video, starts from 39:18.

2019-10-09 (Wed) 16:50

  • Hiraoka
    • ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
    • Zhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel, Piyush Sharma, Radu Soricut. ICLR2020 under-review.
    • slides
  • Niwa : Reinald Kim Amplayo, Seonjae Lim, Seung-won Hwang. Entity Commonsense Representation for Neural Abstractive Summarization. NAACL 2018. paper, video, github

2019-10-16 (Wed) 16:50

  • Sangwhan: Extreme Language Model Compression with Optimal Subwords and Shared Projections. Sanqiang Zhao, Raghav Gupta, Yang Song, Denny Zhou. ICLR2020 under-review. Slides An Embarrassingly Simple Approach for Transfer Learning from Pretrained Language Models. Chronopoulou A. et al. Proceedings of NAACL-HLT 2019, pages 2089–2095. Paper, Slides (I’ll revisit this one of these days, don’t worry.)
  • Fukushima: Jingjing Xu et al,. Unpaired Sentiment-to-Sentiment Translation: A Cycled Reinforcement Learning Approach. ACL 2019. paper, video, presentation