Yiming Dou 窦铱明

Hi! I am a first-year PhD student at the University of Michigan, advised by Prof. Andrew Owens. I received my B.Eng. degree with honor and B.Ec. degree from Shanghai Jiao Tong University in 2023. Prior to that, I worked with Dr. Ruohan Gao as a research intern at Stanford University, supervised by Prof. Jiajun Wu and Prof. Fei-Fei Li. I also worked closely with Prof. Yong-Lu Li and Prof. Cewu Lu at SJTU during my undergraduate.

My research interests mainly lie in multimodal perception, reasoning and robot learning.

I'm always happy to make friends and collaborate with people from various backgrounds. Feel free to contact my Email or WeChat: 18017112986.

Email  ·  Google Scholar  ·  Twitter  ·  Github

profile photo
News

  • 06/2023: 🥳 Graduated from SJTU with honors degree!
  • 04/2023: 🚀 Selected as an SJTU Outstanding Graduate (special commendation).
  • 04/2023: 🥳 I will join Prof. Andrew Owens's group at the University of Michigan as a PhD student this fall. Looking forward to the wonderful life in Ann Arbor!
  • 02/2023: 🎉 Our paper "The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects" is accepted by CVPR 2023.

    • Research Interests

    Humans perceive the world with multiple senses, based on which we establish abstract concepts to understand it. From the concepts we develop logical reasoning ability, and thus creating brilliant achievements. Inspired by the fascinating human intelligence, my dream is to design human-like intelligent systems, which can be divided into four specific problems:

  • Multimodal Perception: how to effectively incorporate multiple modalities (e.g., vision, touch, audio, language and even smell or taste) into AI systems to make them extract as much information from the surrounding world as possible.
  • Concept Learning: how to abstract and summarize the perceived information into high-level concepts (e.g., languages or symbols), thus enabling generalizable cross-domain understanding.
  • Reasoning: how to extract relations from complex scenes and perform causal reasoning on the basis of concepts.
  • Robot Learning: how to enable robots to interact with the real-world environments and humans by leveraging the intelligence learnt from the former three stages.

    • Publications

    (* indicates equal contribution)
    Bridging The Isolated Islands in Human Action Understanding
    Yong-Lu Li*, Xiaoqian Wu*, Xinpeng Liu, Yiming Dou, Yikun Ji, Junyi Zhang, Yixing Li, Xudong Lu, Jingru Tan, Cewu Lu
    Preprint, 2023
    arXiv · Project Page
    The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects
    Ruohan Gao*, Yiming Dou*, Hao Li*, Tanmay Agarwal, Jeannette Bohg, Yunzhu Li, Li Fei-Fei, Jiajun Wu
    Conference on Computer Vision and Pattern Recognition (CVPR), 2023
    arXiv · Project Page · Code · Interactive Demo · Video
    Discovering A Variety of Objects in Spatio-Temporal Human-Object Interactions
    Yong-Lu Li*, Hongwei Fan*, Zuoyu Qiu, Yiming Dou, Liang Xu, Hao-Shu Fang, Peiyang Guo, Haisheng Su, Dongliang Wang, Wei Wu, Cewu Lu
    Technical report, 2022
    arXiv · Code
    Teaching

  • Graduate Student Instructor (GSI), EECS 442: Computer Vision, Fall 2023

    • Service

  • Reviewer for CVPR 2023, ICCV 2023.

    • Experience
    University of Michigan
    2023.04 ~ Present
    Ann Arbor, U.S.A.
    Ph.D. Student in Computer Science and Engineering
    Advisor: Prof. Andrew Owens
    Stanford University
    2022.03 ~ 2023.04
    Stanford, U.S.A.
    Visiting Research Intern
    Supervisor: Prof. Jiajun Wu and Prof. Fei-Fei Li
    Shanghai Jiao Tong University
    2019.09 ~ 2023.06
    Shanghai, China
    B.Eng. (Summa Cum Laude) in Computer Science and Technology
    B.Ec. (Minor) in Economics
    Member of Zhiyuan Honors Program
    Supervisor: Prof. Cewu Lu and Prof. Yong-Lu Li
    Selected Honors

  • Zhiyuan Scholarship (top 30 students), SJTU, 2023
  • SJTU Outstanding Graduate(Special Commendation), SJTU, 2023
  • SJTU Overseas Scholarship (two winners at SJTU), SJTU, 2022
  • Academic Excellence Scholarship (top 10%), SJTU, 2022
  • Zhanjiajun Scholarship (six winners at SJTU), SJTU, 2022
  • Meritorious Winner (top 7%), MCM, 2022
  • Merit Student Award (top 5%), SJTU, 2021
  • Zhiyuan Honors Scholarship (top 5%), SJTU, 2019, 2020, 2021, 2022

    • Miscellaneous

    Outside of work, I enjoy photography, biking and hiking! I love taking my camera to various places in the city, nature, etc. to take interesting photos. I will randomly put some of my photography on Xiaohongshu and Instragram.

    Template from Jon Barron's website
    Last updated on Sept 1, 2023