Dr. Xucong Zhang
Assistant Professor
Computer Vision Lab
Pattern Recognition and Bioinformatics Section
Faculty of EEMCS
Delft University of Technology
E-Mail: xucong.zhang [AT] tudelft.nl
Office: Room 6.E.320 (6th floor east)
Van Mourik Broekmanweg 6 (building 28)
2628 XE Delft
the Netherlands
Links: Google Scholar, CV [PDF], LinkedIn, Twitter
Research Interest
My core research interest is human-centered computing as developing technologies to sense and serve human users.
Building on extensive experience in gaze estimation and human-computer interaction, I am expanding my research to holistic human motion modeling for advanced human-AI interaction, including gaze, face, hand, and body. This work aims to enable intelligent and natural human-AI interactions, which is the core of human-robot collaboration and dynamic avatar generation in XR environments.
As a lifelong research dream, I aim to facilitate biology/healthcare/medical-related research with computer vision and machine learning, with the end goal of enhancing human physical ability through human-AI integration.
Short Bio
I am an assistant professor at TU Delft, a guest scientist at the Max Planck Institute for Intelligent Systems, and an ELISE Scholar. I joined TU Delft in 2021 as an assistant professor and obtained the permanent position in 2023. I was a postdoc from 2018 to 2021 in the Advanced Interaction Technologies Lab at ETH Zurich in Switzerland, under the leadership of Prof. Otmar Hilliges. I completed my PhD research (summa cum laude) from 2013 to 2018 at Max Planck Institute for Informatics in Germany, under the supervision of Prof. Andreas Bulling.
Funding
Honda Research Institute (Japan) + Netherlands TKI program, "Intelligent Human-robot Interaction". EUR 950k, sole PI, 2023 - 2027.
Internal funding from our INSY department for Dual Capture Systems, EUR 250k, leading PI of 17 PIs, 2023 - 2024.
Meta Research Award Gift, "Privacy-preserving Eye Tracking for AR/VR with Adversarial Learning". USD 70k, co-PI with Guohao Lan, 2022 - 2024.
Media
I cooridnated the upgrade and Open Day of the INSYGHT Lab:
I am thrilled to be promoted from ELISE Member to Scholar:
9 researchers from ELLIS Unit Delft honoured with Fellows or Scholars title
Our capture system is reported on our faculty news:
Cutting-Edge Multi-Camera System for Multi-Modal Data Capture
My collaboration with HRI is reported on our faculty news:
Latest News
[11.2024] I cooridinated the upgrade and Open Day of the INSYGHT lab, which is reported on our faculty news website.
[10.2024] I am thrilled to be promoted from ELISE Member to Scholar.
[09.2024] Our multi-camera capture system is reported on our faculty news website.
[09.2024] I will serve as Area Chair of CVPR 2025.
[07.2024] I will join the organization team of ETRA 2025 as one of the short paper chairs.
[07.2024] Our collaboration with Honda Research Institute is reported on our faculty news website.
[06.2024] We will organize the workshop "Nonverbal Cues for Human-Robot Cooperative Intelligence" at IROS 2024.
[05.2024] I will serve as Area Chair of NeurIPS 2024.
[01.2024] Our GAZE workshop at CVPR is accepted. See you in Seattle!
[12.2023] I received a 250k euro joint funding from Honda Research Institute (Japan).
More news
Teaching
BSc course "Image Processing", responsible, 2022 -- present.
MSc course "Seminar Computer Vision by Deep Learning", co-teach, 2022 -- present.
BSc course "Image Analysis" course, guest lecturer, 2024.
Professional Activities, Awards and Talks
Organizing Committee
Organizer committee:
Workshop "GAZE" at ICCV/ECCV/CVPR from 2019 to 2024.
Workshop "Nonverbal Cues for Human-Robot Cooperative Intelligence" at IROS 2024
Co-chair of short paper track: ETRA 2024 , ETRA 2025.
Area Chairs: NeurIPS 2024, CVPR 2025.
Reviewing
CVPR 2023 Outstanding Reviewers
Highlighted Reviewers of ICLR 2022
Journals: TPAMI, MM, TIP, Nature Communications
Conferences: CVPR, ECCV, ICCV, ICLR, NeurIPS, CHI, UIST, IMWUT, BMVC, WACV, ETRA
Awards and Fellowships
The first place in OpenEDS Challenge 2019 at ICCV 2019.
Best paper honorable mention award, ACM Symposium on User Interface Software and Technology (UIST 2017)
Best paper honorable mention award, ACM Symposium on User Interface Software and Technology (UIST 2016)
International Max Planck Research School for Computer Science (IMPRS-CS) Scholarship (2013-2015), Germany
Talks
June 2024, University of California San Diego. Hosted by Prof. Pamela Cosman.
April 2024, The University of Tokyo, Japan. Keynote at International Workshop on Human-Centered Vision and Media Technologies.
February 2024, University of Stuttgart. Hosted by Prof. Andreas Bulling.
August 2022, Max Planck Institute for Intelligent Systems (MPI-IS). Hosted by Prof. Michael Black.
August 2022, Microsoft UK. Hosted by Dr. David Wong.
November 2021, Facebook Reality Labs Pittsburgh.
May 2018, ETH Zurich, Switzerland. Hosted by Prof. Otmar Hilliges.
March 2018, The University of Tokyo, Japan. Hosted by Prof. Yoichi Sato.
March 2018, Osaka University, Japan. Hosted by Prof. Yusuke Sugano.
March 2018, Keio University, Japan. Hosted by Prof. Kai Kunze.
Funding:
