I am currently a second-year Ph.D. student in Information Engineering at Shanghai Jiao Tong University. I abtain my Bachelor’s degree in Computer Science from Beihang University in 2023.

My research interest includes multimodal learning, RL and Generative AI.

🔥 News

• [2025-06-26] BootStrap3D, Visual-RFT, X-Prompt are accepted by ICCV 2025.
• [2024-09-28] Make-it-Real is accepted by NeurIPS 2024.
• [2024-03-02] Alpha-CLIP, GPT4Point are accepted by CVPR 2024.

📝 Selected Publications (* Equal Contribution)

Bootstrap3D: Improving Multi-view Diffusion Model with Synthetic Data

Zeyi Sun, Tong Wu, Pan Zhang, Yuhang Zang, Xiaoyi Dong, Yuanjun Xiong, Dahua Lin, Jiaqi Wang

[ICCV 2025]

Github | Arxiv | HF | Page

Visual-RFT: Visual Reinforcement Fine-Tuning

Ziyu Liu*, Zeyi Sun*, Yuhang Zang, Xiaoyi Dong, Yuhang Cao, Haodong Duan, Dahua Lin, Jiaqi Wang

[ICCV 2025]

Early Exploration of Deepseek-R1’s RL strategy to the multimodal field

Github | Arxiv | HF Model

Make-it-Real: Unleashing Large Multimodal Model for Painting 3D Objects with Realistic Materials

Ye Fang*, Zeyi Sun*, Tong Wu, Jiaqi Wang, Ziwei Liu, Gordon Wetzstein, Dahua Lin

[NeurIPS 2024]

Github | Arxiv | Page

Alpha-CLIP: A CLIP Model Focusing on Wherever Your Want

Zeyi Sun*, Ye Fang*, Tong Wu, Pan Zhang, Yuhang Zang, Shu Kong, Yuanjun Xiong, Dahua Lin, Jiaqi Wang

[CVPR 2024] Strong Accept By All Reviewers

Region Level Contrastive Learning Fundation model based on CLIP.

Github | Arxiv | HF | Page

GPT4Point: A Unified Framework for Point-Language Understanding and Generation

Zhangyang Qi*, Ye Fang*, Zeyi Sun*, Xiaoyang Wu, Tong Wu, Jiaqi Wang, Dahua Lin, Hengshuang Zhao

[CVPR 2024] Highlight

Github | Arxiv | Page

🎖 Honors and Awards

• 2023.06, Beihang University Outstanding Graduates (Top 5%).
• 2021,2022 Beihang University Undergraduate Excellent Scholarship.
• 2018.05, NFirst Prize, 35th Chinese Physics Olympiad (CPhO), Provincial Round (ranked 13th).

📖 Educations

• 2023.09 - until now, P.HD. at Shanghai Jiao Tong University (SJTU).
• 2019.09 - 2023.06, Bachelor in Computer Science, Beihang University (BUAA).

📌 Services

• Conference reviewer of CVPR, ICCV, ICML, NeurIPS.
• Workshop organizing community of VPLOW@CVPR2024.
• S.T.A.R teaching assistant of OS-2022-Spring in CS department, BUAA (founded by Qian Liu).