Publications

Awards

  1. Best Paper Award, the 27th Annual Meeting of The Association for Natural Language Processing (2021-03-18)

    Sakae Mizuki, Naoaki Okazaki

    Hyponymy Detection using Hierarchical Code Learning

    URL

  2. Young Researcher’s Encouragement Award, the 27th Annual Meeting of The Association for Natural Language Processing (2021-03-18)

    Tatsuya Hiraoka

    Optimizing Word Segmentation using Loss Values of Downstream Tasks

    URL

  3. Young Researcher’s Encouragement Award, the 27th Annual Meeting of The Association for Natural Language Processing (2021-03-18)

    Youmi Ma

    Named Entity Recognition and Relation Extraction by Table-Filling using BERT

    URL

  4. Committee Special Award, the 27th Annual Meeting of The Association for Natural Language Processing (2021-03-18)

    Kosuke Yamada ,Yuta Hitomi,Hideaki Tamori, Naoaki Okazaki, Kentaro Inui

    Headline Generation that Reliably Contains the Specified Words

    URL

  5. Sponsor Award, the 27th Annual Meeting of The Association for Natural Language Processing (2021-03-18)

    Kosuke Yamada ,Yuta Hitomi,Hideaki Tamori, Naoaki Okazaki, Kentaro Inui

    Headline Generation that Reliably Contains the Specified Words

    URL

  6. Presentation award, the 15th NTCIR (2020-12-17)

    Yuichi Sasazawa, Naoaki Okazaki

    WER99 at the NTCIR-15 QA Lab-PoliInfo-2 Classification Task

    URL

  7. Winning the Video-guided Machine Translation (VMT) Challenge 2020 (2020-07-13)

    Tosho Hirasawa, Zhishen Yang, Mamoru Komachi, and Naoaki Okazaki

    Keyframe Segmentation and Positional Encoding for Video-guided Machine Translation Challenge 2020

    URL

  8. Language resource award, the 26th Annual Meeting of The Association for Natural Language Processing (2020-03-20)

    Yuta Hitomi, Yuya Taguchi, Hideaki Tamori, Naoaki Okazaki, Kentaro Inui

    Style Transfer for Abstractive Summarization in a Small-scale Resource

    URL

  9. Young researcher’s encouragement award, the 26th Annual Meeting of The Association for Natural Language Processing (2020-03-20)

    Kazuki Matsumaru

    Improving Truthfulness of Headline Generation

    URL

  10. Young researcher’s encouragement award, the 242nd Meeting of Special Interest Group of Natural Language Processing (SIGNL), Information Processing Society of Japan (IPSJ) (2019-10-25)

    Tatsuya Hiraoka

    HMM-based Neural Network Capturing Latent History with RNN

    URL

  11. Best Paper Award, the 240th Meeting of Special Interest Group of Natural Language Processing (SIGNL), Information Processing Society of Japan (IPSJ) (2019-06-14)

    Kazuki Matsumaru, Sho Takase, Naoaki Okazaki

    Re-examinating the Task of Headline Generation based on Textual Entailment

    URL

  12. JSAI 2018 Best Paper Award (2018-06-27)

    Sho Takase, Naoaki Okazaki, Kentaro Inui

    Learning to Compose Distributed Representations of Relational Patterns

    URL

  13. Best Paper Award, the 24th Annual Meeting of The Association for Natural Language Processing (2018-03-15)

    Shun Kiyono, Sho Takase, Jun Suzuki, Naoaki Okazaki, Kentaro Inui, Masaaki Nagata

    Reducing odd generation in neural headline generation

    URL

Research Publications

Journal papers

  1. Sangwhan Moon and Naoaki Okazaki. The Effects and Mitigation of Out-of-Vocabulary in Universal Language Models. Journal of Information Processing, 90(to appear):(to appear), July 2021.

  2. Kaori Abe, Yuichiroh Matsubayashi, Naoaki Okazaki, and Kentaro Inui. Multi-dialect Neural Machine Translation for 48 Low-resource Japanese Dialects. Journal of Natural Language Processing, 27(4):781–800, December 2020. (doi: 10.5715/jnlp.27.781)

    DOI

  3. Hayate Iso, Yui Uehara, Tatsuya Ishigaki, Hiroshi Noji, Eiji Aramaki, Ichiro Kobayashi, Yusuke Miyao, Naoaki Okazaki, and Hiroya Takamura. Learning to Select, Track, and Generate for Data-to-Text. Journal of Natural Language Processing, 27(3):599–626, September 2020. (doi: 10.5715/jnlp.27.599)

    DOI

  4. Diana Galvan-Sosa, Koji Matsuda, Naoaki Okazaki, and Kentaro Inui. Empirical Exploration of the Challenges in Temporal Relation Extraction from Clinical Text. Journal of Natural Language Processing, 27(2):383–409, June 2020. (doi: 10.5715/jnlp.27.383)

    DOI

  5. image
    Kazuaki Hanawa, Akira Sasaki, Naoaki Okazaki, and Kentaro Inui. Stance Detection Attending External Knowledge from Wikipedia. Journal of Information Processing, 27:499–506, August 2019. (doi: 10.2197/ipsjjip.27.499)

    URL DOI

  6. Masatoshi Suzuki, Koji Matsuda, Satoshi Sekine, Naoaki Okazaki, and Kentaro Inui. A Joint Neural Model for Fine-Grained Named Entity Classification of Wikipedia Articles. IEICE Transactions on Information and Systems, Special Section on Semantic Web and Linked Data, E101.D(1):73–81, January 2018. (doi: 10.1587/transinf.2017SWP0005)

    URL DOI

  7. Ran Tian, Naoaki Okazaki, and Kentaro Inui. The mechanism of additive composition. Machine Learning, 106(7):1083–1130, July 2017. (doi: 10.1007/s10994-017-5634-8)

    URL DOI

  8. Sho Takase, Naoaki Okazaki, and Kentaro Inui. Learning to Compose Distributed Representations of Relational Patterns. Transactions of the Japanese Society for Artificial Intelligence (in Japanese), 32(4):D-G96_1-11, July 2017. (doi: 10.1527/tjsai.D-G96)

    URL DOI

  9. Shuangshuang Zhou, Naoaki Okazaki, Koji Matsuda, Ran Tian, and Kentaro Inui. Supervised Approaches for Japanese Wikification. Journal of Information Processing, 25:341–350, April 2017. (doi: 10.2197/ipsjjip.25.341)

    URL DOI

International conferences

  1. Sho Takase and Shun Kiyono. Rethinking Perturbations in Encoder-Decoders for Fast Training. In Proceedings of the 2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL2021), pages (to appear), June 2021.

  2. Zhishen Yang and Naoaki Okazaki. Image caption generation for news articles. In Proceedings of the 28th International Conference on Computational Linguistics (COLING2020), pages (to appear), December 2020.

  3. Sho Takase and Sosuke Kobayashi. All Word Embeddings from One Embedding. In Proceedings of the Thirty-fourth Conference on Neural Information Processing System (NeurIPS 2020), pages (to appear), December 2020.

    arXiv

  4. Won Ik Cho, Sangwhan Moon, and Youngsook Song. Open Korean Corpora: A Practical Report. In Proceedings of Second Workshop for NLP Open Source Software (NLP-OSS), pages 85–93, Association for Computational Linguistics, November 2020.

    URL

  5. Shin Kanouchi, Masato Neishi, Yuta Hayashibe, Hiroki Ouchi, and Naoaki Okazaki. You May Like This Hotel Because...: Identifying Evidence for Explainable Recommendations. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing (AACL-IJCNLP 2020), pages (to appear), December 2020.

  6. Tatsuya Hiraoka, Sho Takase, Kei Uchiumi, Atsushi Keyaki, and Naoaki Okazaki. Optimizing Word Segmentation for Downstream Task. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 1341–1351, Association for Computational Linguistics, November 2020.

    URL

  7. Won Ik Cho, Youngki Moon, Sangwhan Moon, Seok Min Kim, and Nam Soo Kim. Machines Getting with the Program: Understanding Intent Arguments of Non-Canonical Directives. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 329–339, Association for Computational Linguistics, November 2020.

    URL

  8. Sangwhan Moon and Naoaki Okazaki. PatchBERT: Just-in-Time, Out-of-Vocabulary Patching. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP 2020), pages 7846–7852, Association for Computational Linguistics, November 2020.

    URL

  9. Tosho Hirasawa, Zhishen Yang, Mamoru Komachi, and Naoaki Okazaki. Keyframe Segmentation and Positional Encoding for Video-guided Machine Translation Challenge 2020. In First Workshop on Advances in Language and Vision Research (ALVR 2020), ACL 2020, July 2020.

    arXiv

  10. Wiem Ben Rim and Naoaki Okazaki. SWAGex at SemEval-2020 Task 4: Commonsense Explanation as Next Event Prediction. In Proceedings of the 14th International Workshop on Semantic Evaluation (SemEval 2020), pages (to appear), December 2020.

  11. Zhishen Yang, Lars Wolfsteller, and Naoaki Okazaki. TextLearner at SemEval-2020 Task 10: A Contextualized Ranking System in Solving Emphasis Selection in Text. In Proceedings of the 14th International Workshop on Semantic Evaluation (SemEval 2020), pages (to appear), December 2020.

  12. Emanuele Bugliarello, Sabrina J. Mielke, Antonios Anastasopoulos, Ryan Cotterell, and Naoaki Okazaki. It’s Easier to Translate out of English than into it: Measuring Neural Translation Difficulty by Cross-Mutual Information. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1640–1649, Online, Association for Computational Linguistics, July 2020.

    URL arXiv

  13. Emanuele Bugliarello and Naoaki Okazaki. Enhancing Machine Translation with Dependency-Aware Self-Attention. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1618–1627, Online, Association for Computational Linguistics, July 2020.

    URL arXiv

  14. Zixia Jia, Youmi Ma, Jiong Cai, and Kewei Tu. Semi-Supervised Semantic Dependency Parsing Using CRF Autoencoders. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 6795–6805, Online, Association for Computational Linguistics, July 2020.

    URL

  15. Kazuki Matsumaru, Sho Takase, and Naoaki Okazaki. Improving Truthfulness of Headline Generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1335–1346, Online, Association for Computational Linguistics, July 2020.

    URL

  16. Sangwhan Moon and Naoaki Okazaki. Jamo Pair Encoding: Subcharacter Representation-based Extreme Korean Vocabulary Compression for Efficient Subword Tokenization. In Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020), pages 3490–3497, May 2020.

    URL

  17. Sho Shimazu, Sho Takase, Toshiaki Nakazawa, and Naoaki Okazaki. Evaluation Dataset for Zero Pronoun in Japanese to English Translation. In Proceedings of the 12th Conference on Language Resources and Evaluation (LREC 2020), pages 3630–3634, May 2020.

    URL

  18. Sakae Mizuki and Naoaki Okazaki. Analyzing the Variation Property of Contextualized Word Representations. In AI 2019: Advances in Artificial Intelligence, pages 393–405, December 2019. (doi: 10.1007/978-3-030-35288-2_32)

    URL DOI

  19. Yuichi Sasazawa, Sho Takase, and Naoaki Okazaki. Neural Question Generation using Interrogative Phrases. In Proceedings of the 12th International Conference on Natural Language Generation (INLG 2019), pages 106–111, October 2019.

    URL

  20. Emanuele Bugliarello, Swayambhoo Jain, and Vineeth Rakesh. Matrix Completion in the Unit Hypercube via Structured Matrix Factorization. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (IJCAI-19), pages 2038–2044, August 2019. (doi: 10.24963/ijcai.2019/282)

    URL DOI

  21. Tatsuya Hiraoka, Hiroyuki Shindo, and Yuji Matsumoto. Stochastic Tokenization with a Language Model for Neural Text Classification. In Proceedings of the 57th Conference of the Association for Computational Linguistics (ACL 2019), pages 1620–1629, July 2019.

    URL

  22. Hayate Iso, Yui Uehara, Tatsuya Ishigaki, Hiroshi Noji, Eiji ARAMAKI, Ichiro Kobayashi, Yusuke Miyao, Naoaki Okazaki, and Hiroya Takamura. Learning to Select, Track, and Generate for Data-to-Text. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), pages 2102–2113, July 2019.

    URL

  23. Sho Takase and Naoaki Okazaki. Positional Encoding to Control Output Sequence Length. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019), pages 3999–4004, June 2019.

    URL arXiv

  24. Zhishen Yang, Sam Vijlbrief, and Naoaki Okazaki. TokyoTech_NLP at SemEval-2019 Task 3: Emotion-related Symbols in Emotion Detection. In Proceedings of the 13th International Workshop on Semantic Evaluation (SemEval 2019), pages 350–354, June 2019.

    URL

  25. Sho Takase, Jun Suzuki, and Masaaki Nagata. Character n-gram Embeddings to Improve RNN Language Models. In Proceedings of the Thirty-Third AAAI Conference on Artificial Intelligence (AAAI 2019), pages 5074–5082, January 2019.

    URL

  26. Shun Kiyono, Sho Takase, Jun Suzuki, Naoaki Okazaki, Kentaro Inui, and Masaaki Nagata. Reducing Odd Generation from Neural Headline Generation. In The 32nd Pacific Asia Conference on Language, Information and Computation (PACLIC 32), pages 289–303, December 2018.

    URL

  27. Kaori Abe, Yuichiroh Matsubayashi, Naoaki Okazaki, and Kentaro Inui. Multi-dialect Neural Machine Translation and Dialectometry. In The 32nd Pacific Asia Conference on Language, Information and Computation (PACLIC 32), pages 1–10, December 2018.

    URL

  28. Sho Takase, Jun Suzuki, and Masaaki Nagata. Direct Output Connection for a High-Rank Language Model. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP 2018), pages 4599–4609, 2018.

    URL arXiv

  29. Shun Kiyono, Sho Takase, Jun Suzuki, Naoaki Okazaki, Kentaro Inui, and Masaaki Nagata. Unsupervised Token-wise Alignment to Improve Interpretation of Encoder-Decoder Models. In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 74–81, 2018.

    URL

  30. Diana Galvan, Naoaki Okazaki, Koji Matsuda, and Kentaro Inui. Investigating the Challenges of Temporal Relation Extraction from Clinical Text. In Proceedings of the Ninth International Workshop on Health Text Mining and Information Analysis (LOUHI 2018), pages 55–64, October 2018.

    URL

  31. Akira Sasaki, Kazuaki Hanawa, Naoaki Okazaki, and Kentaro Inui. Predicting Stances from Social Media Posts using Factorization Machines. In Proceedings of the 27th International Conference on Computational Linguistics (Coling 2018), pages 3381–3390, August 2018.

    URL

  32. Yuta Hitomi, Hideaki Tamori, Naoaki Okazaki, and Kentaro Inui. Proofread Sentence Generation as Multi-Task Learning with Editing Operation Prediction. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (IJCNLP 2017), pages 436–441, November 2017.

    URL

  33. Sosuke Kobayashi, Naoaki Okazaki, and Kentaro Inui. A Neural Language Model for Dynamically Representing the Meanings of Unknown Words and Entities in a Discourse. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (IJCNLP 2017), pages 473–483, November 2017.

    URL

  34. Kazuaki Hanawa, Akira Sasaki, Naoaki Okazaki, and Kentaro Inui. A Crowdsourcing Approach for Annotating Causal Relation Instances in Wikipedia. In Proceedings of the 31st Pacific Asia Conference on Language, Information and Computation (PACLIC 2017), pages 336–345, November 2017.

    URL

  35. Shota Sasaki, Sho Takase, Naoya Inoue, Naoaki Okazaki, and Kentaro Inui. Handling Multiword Expressions in Causality Estimation. In Proceedings of the 12th International Conference on Computational Semantics (IWCS 2017), pages (6 pages), September 2017.

    URL

  36. Hideaki Tamori, Yuta Hitomi, Naoaki Okazaki, and Kentaro Inui. Analyzing the Revision Logs of a Japanese Newspaper for Article Quality Assessment. In Proceedings of the 2017 EMNLP Workshop: Natural Language Processing meets Journalism, pages 46–50, September 2017.

    URL

  37. Sho Yokoi, Daichi Mochihashi, Ryo Takahashi, Naoaki Okazaki, and Kentaro Inui. Learning Co-Substructures by Kernel Dependence Maximization. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI 2017), pages 3329–3335, August 2017.

    URL

  38. Akira Sasaki, Kazuaki Hanawa, Naoaki Okazaki, and Kentaro Inui. Other Topics You May Also Agree or Disagree: Modeling Inter-Topic Preferences using Tweets and Matrix Factorization. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (ACL 2017), pages 398–408, July 2017.

    URL

Invited talks

  1. Naoaki Okazaki. Neural Machine Translation and Summarization for News. In International Workshop on Speech to Speech Machine Translation (IWSSMT), November 2020.

  2. Naoaki Okazaki. Towards Natural Language Processing that Understands Context. In AI Shooting Stars Session, Artificial Intelligence — International Research and Applications: 1st Japanese-German-French DWIH Symposium, November 2018.

    URL

  3. Naoaki Okazaki. How Deep Learning Changes Natural Language Processing. In Fourth Asia Pacific Corpus Linguistics Conference (APCLC 2018), September 2018.

    URL

  4. Naoaki Okazaki. Bridging Knowledge and Text with Deep Neural Networks. In Second International Workshop on Symbolic-Neural Learning (SNL-2018), July 2018.

    URL

  5. Naoaki Okazaki. Generating Text with Deep Neural Networks. In Deep Learning: Theory, Algorithms, and Applications, March 2018.

    URL