Fuxiao Liu

			Fuxiao Liu (刘赋骁)
		
		Hi! I'm a 3rd-year CS Ph.D at University of Maryland, College Park, working with Abhinav Shrivastava and Yaser Yacoob.
		
		I have broad interests in vision and language tasks, including image/video captioning, multimodal semantic alignment, fact-checking, document understanding. 
	         My recent focus is on building customizable large models that follow humans' intent.
		
		Google Scholar/ LinkedIn/Github/Twitter/Instagram

Experience

[Spring 2024] Nvidia ADLR, with Guilin Liu and Zhiding Yu on building Large Multimodal Models.
[Summer 2023] Tencent AI, with Xiaoyang Wang, Jianshu Chen, Kaiqiang Song, Wenlin Yao on Visual Chart Understanding: [NAACL'24].
[Spring 2023] Microsoft Research, with Linjie Li, Kevin Lin, Jianfeng Wang on Robust Visual instruction tunning: [ICLR'24],[CVPR'24].
[Summer 2022] Adobe Research, with Chris Tensmeyer, Hao Tan and Ani Nenkova on Visual document Understanding: [ICPRAI'24].
[Spring 2022] UMIACS, with Abhinav Shrivastava on Fact Checking on Short Video: [EACL'23].
[Spring 2021] UVa Vislang Lab, with Vicente Ordonez on News Image Captioning: [EMNLP'21].

First-Author Publications

New! Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

Fuxiao Liu*, Kevin Lin, Linjie Li, Jianfeng Wang, Yaser Yacoob, Lijuan Wang

ICLR 2024 [paper] [code] [bibtex]

New! HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

Fuxiao Liu*, Tianrui Guan*, Xiyang Wu, Ruiqi Xian, Xijun Wang, Zongxia Li, Lichang Chen, Yaser Yacoob, Dinesh Manocha, Tianyi Zhou

CVPR 2024 [paper] [code] [bibtex]

New! MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning

Fuxiao Liu*, Xiaoyang Wang, Wenlin Yao, Jianshu Chen, Kaiqiang Song, Sangwoo Cho, Yaser Yacoob, Dong Yu

NAACL 2024 [paper] [code] [bibtex]

DocumentCLIP: Linking Figures and Main Body Text in Reflowed Documents

Fuxiao Liu*, Hao Tan, Chris Tensmeyer

ICPRAI 2023 [paper] [code] [bibtex]

COVID-VTS: Fact Extraction and Verification on Short Video Platforms

Fuxiao Liu*, Yaser Yacoob, Abhinav Shrivastava

EACL 2023 (~Oral presentation) [paper] [code] [bibtex]

Visual News: Benchmark and Challenges in News Image Captioning

Fuxiao Liu*, Yinghan Wang, Tianlu Wang, Vicente Ordonez

EMNLP 2021 (~Oral presentation) [paper] [code] [bibtex]

Tutorials

New! From Multimodal LLM to Human-level AI: Modality, Instruction, Reasoning, Efficiency and Beyond

Hao Fei, Yuan Yao, Zhuosheng Zhang, Fuxiao Liu*, Ao Zhang, Tat-seng Chua

LREC-COLING 2024 & CVPR 2024 [paper] [code] [bibtex]

Service

Conference Reviewer: AISTATS,CVPR,NAACL,ACL,IJCAI,ACMMM
Journal Reviewer: JMIR

More About Myself

I'm crazy about basketball since I was a little boy. I love it for its ultimate technical and mentality requirements. No one in the world can become a master without great talent and extensive training. My favorite basketball player is Kobe Bryant, who is noted for his rapid playing style, strong will, and his ambivalent relationship with the sport. I am always immersed in his phenomenal performance in the game.