Here is Yifan Jia.
I am a junior student studying in the School of Information Science and Engineering(Chongxin College), Shandong University in China,supervised by Yuntao Du. My primary research interests focus on multimodal learning, generative models, and interpretability.
Specifically, my research focuses on AI systems based on MLLMs, such as RAG and Agents. My previous work has concentrated on knowledge conflicts in MLLMs and prompt/context engineering. At the same time, I am also very interested in generative systems based on multimodal learning, such as T2I, T2V, and 3D generation.I enjoy exploring the essence of things, which makes me very interested in interpretability. I view interpretability as an analytical tool that helps us understand the effectiveness of AI systems, for example, through data attribution.
Looking to the future, I am currently applying for the PHD/Mphil program of 26Fall. If you are interested in any aspect of me that I would like to chat about and collaborate with, please email me at 2597077223jyf[at]gmail.com
🔥 News
- 2025.06.18: 🎉🎉 Our paper has been accepted by MICCAI2025
- 2024.07.05: 🎉🎉 Our paper has been accepted by Neurocomputing
- 2024.04.19: 🎉🎉 Our paper has been accepted by 2024 5th International Conference on Computer Vision, Image and Deep Learning (CVIDL)
📝 Publications
Benchmarking Multimodal Knowledge Conflict for Large Multimodal Models
Yifan Jia, Kailin Jiang, Yuyang Liang, Qihan Ren,Yi Xin, Rui Yang, Fenze Feng, Mingcai Chen, Hengyang Lu, Haozhe Wang, Xiaoye Qu, Dongrui Liu, Lizhen Cui, Yuntao Du
AAttributing Data for Sharpness-Aware Minimization
Chenyang Ren, Yifan Jia,Huanyi Xie, Zhaobin Xu, Tianxing Wei, Liangyu Wang, Lijie Hu, Di Wang
BioD2C: A Dual-level Semantic Consistency Constraint Framework for Biomedical VQA
Zhengyang Ji, Shang Gao, Li Liu, Yifan Jia,Yutao Yue
Interpreting Social Bias in LVLMs via Information Flow Analysis and Multi-Round Dialogue Evaluation
Zhengyang Ji, Yifan Jia, Shang Gao,Yutao Yue
A comprehensive review of community detection in graphs
Jiakang Li, Songning Lai, Zhihao Shuai, Yuan Tan, Yifan Jia, Mianyang Yu, Zichen Song, Xiaokang Peng, Ziyang Xu, Yongxin Ni, Haifeng Qiu, Jiayu Yang, Yutong Liu, Yonggang Lu
🎖 Honors and Awards
- 2023.09 Academic Scholarship from Shandong University
- 2024.12 Third prize in the National Intelligent Car Competition
- 2023.4 National Third Prize in the Asia-Pacific Mathematical Modeling Competition
- 2024.7 Second prize of provincial level in mathematical Modeling Contest for college students
📖 Educations
- 2024.11 - 2025.5, HKUST(GZ) (Intern)
- 2022.09 - now,Shandong University
💻 Internships
- 2024.05 - 2025.02,Initial Certification for the Taichu Yuanqi AI Competition.
- 2024.05 - now,AI Engineer,HUAWEI