Personal Information

I am currently a Master’s student in Computer Science and Technology at Beijing Jiaotong University and work with Prof. Jitao Sang. I obtained a Bachelor’s degree in Computer Science and Technology from Hebei University of Technology.

Research

I participated in the MLLMs-based AI Agent system project, Mobile Agent V2, which aims to develop a multi-agent system for mobile tasks automation. In this project, multiple agents—including a planning agent, a decision-making agent, and a reflection agent—work collaboratively to automate mobile tasks. Additionally, I was involved in the AMBER project, a hallucination study for MLLMs(multimodal large language models), focusing on hallucinations in both discriminative and generative tasks.

Recently, I have developed a strong interest in designing efficient LLMs-based and MLLMs-based agents, as well as exploring human-agent interaction. I am currently investigating ways to enhance agent decision-making capabilities through supervised and reinforcement learning algorithms. My current research interests include:

  • MLLM-based Agent
  • Human-centered AI
  • Human-agent Interaction
  • Intelligent Decision-making

Publications

Inline HTML Layout Example
the framework of mobile agent v2

Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration

Junyang Wang, Haiyang Xu, Haitao Jia, Xi Zhang, Ming Yan, Weizhou Shen, Ji Zhang, Fei Huang, Jitao Sang

NeurIPS 2024

Education

·M.S (Computer Science), Beijing Jiaotong University
2023.9 - 2026.6

·B.S (Computer Science), Hebei University of Technology
2019.9 - 2023.6

Contact

email:

23120356@bitu.edu.cn

jiaht1101@gmail.com