Tatsuya Aoki, Ph.D.

Senior Machine Learning Engineer, Apple Inc.

[CV] [github] [LinkedIn] tatsuya_aoki

---

Publications

Journals and others

• Discovering Unusual Word Usages with Masked Language Model via Pseudo-label Training.
  Tatsuya Aoki, Jey Han Lau, Hidetaka Kamigaito, Hiroya Takamura, Timothy Baldwin, and Manabu Okumura.
  Journal of Natural Language Processing, The Association for Natural Language Processing, Vol. 32, No. 1, 2025.
• Detecting Non-standard Word Usages from Social Media. (in Japanese)
  Tatsuya Aoki, Ryohei Sasano, Hiroya Takamura and Manabu Okumura.
  Journal of Natural Language Processing, The Association for Natural Language Processing, Vol. 26, No. 2, 2019.
• Detecting Earthquake Survivors with Serious Mental Affliction.
  Tatsuya Aoki, Katsumasa Yoshikawa, Tetsuya Nasukawa, Hiroya Takamura and Manabu Okumura.
  Computational Linguistics, Springer Nature, Vol. 781, pp. 3-14, 2018.

International Conferences

• Neural Text Normalization Leveraging Similarities of Strings and Sounds
  Riku Kawamura, Tatsuya Aoki, Hidetaka Kamigaito, Hiroya Takamura and Manabu Okumura.
  In Proceedings of the Conference on Computational Linguistics (COLING). 2020.
• Controlling Contents in Data-to-Document Generation with Human-Designed Topic Labels [paper]
  Kasumi Aoki, Akira Miyazawa, Tatsuya Ishigaki, Tatsuya Aoki, Hiroshi Noji, Keiichi Goshima, Ichiro Kobayashi, Hiroya Takamura and Yusuke Miyao.
  In Proceedings of the Conference on Natural Language Generation (INLG). 2019.
• Generating Market Comments Referring to External Resources [paper]
  Tatsuya Aoki, Akira Miyazawa, Kasumi Aoki, Keiichi Goshima, Tatsuya Ishigaki, Ichiro Kobayashi, HiroyaTakamura and Yusuke Miyao.
  In Proceedings of the Conference on Natural Language Generation (INLG). 2018.
• Distinguishing Japanese Non-standard Usages from Standard Ones [paper]
  Tatsuya Aoki, Ryohei Sasano, Hiroya Takamura and Manabu Okumura.
  In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP). 2017.
• Detecting Earthquake Survivors with Serious Mental Affliction.
  Tatsuya Aoki, Katsumasa Yoshikawa, Tetsuya Nasukawa, Hiroya Takamura and Manabu Okumura.
  In Proceedings of the Conference of the Pacific Association for Computational Linguistics (PACLING). 2017.

Domestic Conferences +

Experience

2022.05 - Present   Machine Learning Engineer
Apple Inc.


2020.10 - 2020.04   Input Method Engineer
Apple Japan Inc.


2019.07 - 2019.11   ML/NLP Intern
Apple Inc.


2018.06 - 2019.05   Visiting Student
UniMelb NLP Group, working with Prof. Timothy Baldwin,
The University of Melbourne


2017.05 - 2018.05   Technical Staff
Perception and Language Understanding Group,
National Institute of Advanced Industrial Science and Technology (AIST)


2016.12 - 2017.02   Research Assistant
Tokyo Institute of Technology



2016.09 - 2016.11   Research Intern
IBM Research - Tokyo

Miscellaneous

PyTorch implementation

• Dependency Parsing as Head Selecton, Zhang et al., EACL 2017 [github]
  with an emperical result that ELMo embedding can gain accuracy.
  
• context2vec: Learning Generic Context Embedding with Bidirectional LSTM, Melamud et al., CoNLL 2016 [github]
  with 3x speed up compared to the original implementation.