Experiences

Research

Research Scientist, Sony Group Corporation

Oct 2024 – Present, Tokyo

• Leading a small research team on multimodal LLMs, spanning problem formulation, academic collaboration, and deployment-oriented research.
• Research interests include multimodal LLMs for understanding, retrieval, and benchmarking across language, vision, and music.

Ph.D. Researcher, Tsuruoka Lab at The University of Tokyo

Oct 2021 – Sep 2024, Tokyo

• Worked on word-level preference for LLM-based machine translation and word alignment pre-training.
• Worked on text embeddings, generation, compression, and cross-lingual sentence representations.

Visiting Student, UC San Diego

Jan 2023 – Feb 2023, San Diego

• Worked on generalized diffusion models for unified generation, reconstruction, and representation learning.

Research Intern, Microsoft Research Asia

Apr 2020 – Feb 2022, Beijing

• Worked on sentence embeddings with contrastive learning using multiple positive examples.
• Worked on faster language pre-training through improved rare-word representations.

R&D Intern, Baidu Research

Oct 2019 – Feb 2020, Beijing

• Worked on multi-task transportation prediction and route mode recommendation for Baidu Maps.

Education

The University of Tokyo

Oct 2021 – Sep 2024, Tokyo

Ph.D. in Information Science and Technology.
Tsuruoka Lab; JSPS DC2 Fellowship; JST SPRING Fellowship.

Peking University

Sep 2018 – Jul 2021, Beijing

M.Sc. in Computer Software and Theory.

Sichuan University

Sep 2014 – Jul 2018, Chengdu

B.Eng. in Computer Science and Technology.

Advising and Services

Advised Students

• Youngtaek Oh: Syn-Omni.
• Daeyong Kwon: MusTBench.
• Dominick Reilly: Mixture of Probes.
• Jongsuk Kim: MLLMCLIP.
• Zhongtao Miao: GRC, Cross-lingual Sentence Embedding, Semi-supervised Word Alignment.
• Kaiyan Zhao: Multilingual Contrastive Learning, Prompt Tuning for Text Encoders.
• Yutao Xie: Pseudo-Siamese Mutual Learning.

Academic Service

Session Chair for “Semantics: Lexical and Sentence-Level” at EMNLP 2026.

Area Chair of ACL Rolling Review (2025 – Present); NeurIPS (2026 – Present).

Reviewer of ACL Rolling Review, EMNLP, ICLR, NeurIPS, ICML, etc. (2021 – Present).

Organizer of GenProCC Workshop at NeurIPS 2025.

Awards and Other Experience

NeurIPS 2026 Top Area Chair (2026).

ACL 2026 Outstanding Reviewer (Top 1.4%, 2026).

JSPS DC2 Fellowship (2024).

Teaching Assistant of Social Implications of Computing at Peking University (2019).