Experiences

Research

Research Scientist, Sony Group Corporation

Oct 2024 – Present, Tokyo

• Leading a small research team on multimodal LLMs, spanning problem formulation, academic collaboration, and deployment-oriented research.
• Research interests include multimodal LLMs for understanding, retrieval, and benchmarking across language, vision, and music.

Ph.D. Researcher, Tsuruoka Lab at The University of Tokyo

Oct 2021 – Sep 2024, Tokyo

• Worked on word-level preference for LLM-based machine translation and word alignment pre-training.
• Worked on text embeddings, generation, compression, and cross-lingual sentence representations.

Visiting Student, UC San Diego

Jan 2023 – Feb 2023, San Diego

• Worked on generalized diffusion models for unified generation, reconstruction, and representation learning.

Research Intern, Microsoft Research Asia

Apr 2020 – Feb 2022, Beijing

• Worked on sentence embeddings with contrastive learning using multiple positive examples.
• Worked on faster language pre-training through improved rare-word representations.

R&D Intern, Baidu Research

Oct 2019 – Feb 2020, Beijing

• Worked on multi-task transportation prediction and route mode recommendation for Baidu Maps.

Education

The University of Tokyo

Oct 2021 – Sep 2024, Tokyo

Ph.D. in Information Science and Technology.
Tsuruoka Lab; JSPS DC2 Fellowship; JST SPRING Fellowship.

Peking University

Sep 2018 – Jul 2021, Beijing

M.Sc. in Computer Software and Theory.

Sichuan University

Sep 2014 – Jul 2018, Chengdu

B.Eng. in Computer Science and Technology.

Advising and Services

Advised Students

Youngtaek Oh [M3], Daeyong Kwon [M6], Dominick Reilly [M4], Jongsuk Kim [M1], Zhongtao Miao [M5, C8, C11], Kaiyan Zhao [C7, W3], Yutao Xie [J1].

Academic Service

Area Chair of ACL Rolling Review (2025 – Present); NeurIPS (2026 – Present).

Reviewer of ACL Rolling Review, EMNLP, ICLR, NeurIPS, ICML, etc. (2021 – Present).

Organizer of GenProCC Workshop at NeurIPS 2025.

Awards and Other Experience

JSPS DC2 Fellowship (2024).

Teaching Assistant of Social Implications of Computing at Peking University (2019).