Dr. Xucong Zhang
I am a postdoctoral researcher at ETH Zurich in the Advanced Interaction Technologies Lab, led by Prof. Otmar Hilliges.
My current research is about computer vision, machine learning, and their applications in human-computer interactions. My research interest is human-centred computing as developing techniques for sensing, understanding, and serving the human user. Specifically, I am working on human attention estimation and corresponding applications in real-world settings. I am extending my research to the range of the full human body including hand pose, body gesture, and speech.
E-Mail: xucong.zhang(AT)inf.ethz.ch
Links: Google Scholar, CV [PDF], DBLP, LinkedIn, Twitter
I will join TU Delft as an assistant professor in August 2021.
One PhD position at TU Delft is available. Please submit your application on the website, do not send your application to my email.
Short Bio
I finished my PhD (summa cum laude, 2013-2018) at Max Planck Institute for Informatics, German, under the supervision of Prof. Andreas Bulling. Prior to that, I received my Master degree (2010-2013) from Beihang University and Bachelor degree (2007-2010) from China Agricultural University (Honor Program) in China. I worked as an intern in CBSR Lab, the Chinese Academy of Sciences from 2011 to 2013.
Latest news
[01.2021] I will join TU Delft as an assistant professor in August 2021. One PhD position from me will be available soon. Very much looking forward to the new life in Delft.
[12.2020] We are going to organize "GAZE" workshop at CVPR 2021.
[09.2020] One paper is accepted at NeurIPS 2020. See you online!
[07.2020] One paper is accepted at BMVC 2020. See you online!
[05.2020] Two papers are accepted at ECCV 2020. See you online!
[04.2020] One paper is accepted by TIP.
[01.2020] We are going to organize "OpenEyes" workshop at ECCV 2020.
[09.2019] We won the OpenEDS Challenge 2019 (Synthetic Eye Generation Challenge).
[07.2019] One paper is accepted at ICCV 2019.
Publications
2020
Self-Learning Transformations for Improving Gaze and Head Redirection
Yufeng Zheng, Seonwook Park, Xucong Zhang, Shalini De Mello, and Otmar Hilliges. NeurIPS 2020.
[Project page] [PDF]
Learning-based Region Selection for End-to-End Gaze Estimation
Xucong Zhang, Yusuke Sugano, Andreas Bulling, and Otmar Hilliges. BMVC 2020.
[PDF]
ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation
Xucong Zhang, Seonwook Park, Thabo Beeler, Derek Bradley, Siyu Tang, and Otmar Hilliges. ECCV 2020.
Accepted as spotlight.
[Project page] [PDF]
Towards End-to-end Video-based Eye-tracking
Seonwook Park, Emre Aksan, Xucong Zhang, and Otmar Hilliges. ECCV 2020.
[Project page] [PDF]
Gaze Estimation by Exploring Two-Eye Asymmetry
Yihua Cheng, Xucong Zhang, Feng Lu, Yoichi Sato. TIP 2020.
[PDF]
2019
Evaluation of Appearance-Based Methods for Gaze-Based Applications
Xucong Zhang, Yusuke Sugano, and Andreas Bulling. CHI 2019.
[Project page] [PDF]
Photo-realistic Monocular Gaze Redirection Using Generative Adversarial Networks
Zhe He, Adrian Spurr, Xucong Zhang, Otmar Hilliges. ICCV 2019.
[Project page] [PDF] [Code]
Content-Consistent Generation of Realistic Eyes with Style
Marcel Buhler, Seonwook Park, Shalini De Mello, Xucong Zhang, and Otmar Hilliges. ICCVW 2019.
[Project page] [PDF]
2018
Training Person-Specific Gaze Estimators from User Interactions with Multiple Devices
Xucong Zhang, Yusuke Sugano, and Andreas Bulling. CHI 2018.
[PDF]
Learning to find eye region landmarks for remote gaze estimation in unconstrained settings
Seonwook Park , Xucong Zhang, Andreas Bulling, and Otmar Hilliges . ETRA 2018.
[Project page] [PDF] [Code]
Revisiting data normalization for appearance-based gaze estimation
Xucong Zhang, Yusuke Sugano, and Andreas Bulling. ETRA 2018.
[Project page] [PDF]
Robust Eye Contact Detection in Natural Multi-Person Interactions Using Gaze and Speaking Behaviour
Philipp Müller, Xucong Zhang, Michael Xuelin Huang, and Andreas Bulling. ETRA 2018.
[Project page] [PDF]
2017
Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery
Xucong Zhang, Yusuke Sugano, and Andreas Bulling. UIST 2017.
Best paper honorable mention award .
[PDF]
It’s written all over your face: Full-face appearance-based gaze estimation
Xucong Zhang, Yusuke Sugano, and Andreas Bulling. CVPRW 2017.
[Project page][PDF]
MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation
Xucong Zhang, Yusuke Sugano, Mario Fritz , and Andreas Bulling. TPAMI 2017.
[PDF]
2016
AggreGaze: Collective Estimation of Audience Attention on Public Displays
Yusuke Sugano, Xucong Zhang, Andreas Bulling. UIST 2016.
Best paper honorable mention award.
[PDF]
Labelled pupils in the wild: A dataset for studying pupil detection in unconstrained environments
Marc Tonsen, Xucong Zhang, Yusuke Sugano, Andreas Bulling. ETRA 2016.
[Project page] [PDF]
Combining Eye Tracking with Optimizations for Lens Astigmatism in modern wide-angle HMDs
Daniel Pohl , Xucong Zhang, Andreas Bulling. VR 2016.
[PDF]
2015
Rendering of eyes for eye-shape registration and gaze estimation
Erroll Wood, Tadas Baltrušaitis, Xucong Zhang, Yusuke Sugano, Peter Robinson, Andreas Bulling. ICCV 2015.
[Project page] [PDF]
Appearance-based gaze estimation in the wild
Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling. CVPR 2015.
[Project page]
2013 and before
Robust multi-resolution pedestrian detection in traffic scenes
Junjie Yan, Xucong Zhang, Zhen Lei, Shengcai Liao, and Stan Z. Li. CVPR 2013.
Accepted as oral.
[PDF]
Water Filling: Unsupervised People Counting via Vertical Kinect Sensor
Xucong Zhang, Junjie Yan, Shikun Feng , Zhen Lei, Dong Yi, and Stan Z. Li . AVSS 2012.
Accepted as oral.
[PDF]
Professional activity, awards and talks
Organizing committee
Organiser committee of the "GAZE" workshop at CVPR 2021.
Organiser committee of the "OpenEyes" workshop at ECCV 2020.
Organiser committee of the Gaze Estimation and Prediction in the Wild workshop at ICCV 2019
Teaching
Two lecture on Machine Perception - SS'19 at ETH Zurich
One lecture on Ubiquitous Computing -SS'20 at ETH Zurich
Supervision/Co-supervision
Master thesis, Aoming Liu, Monocular RGB Gaze Estimation with Multi-View Consistency Training. 2021.
Semester Project, Kaifeng Zhao, Hand-eye coordinate interaction with public display. 2020.
Master thesis, Valentin Venzin, Person-Specific Human EyeGaze-Base Interactions. 2020
Master thesis, Yufeng Zheng, Accurate and Photo-realistic Person-specific Gaze Re-direction. 2020
Semester Project, Marcel Buhler, Feature Preserving Image Translation for Gaze Estimation. 2019
Reviewing
Journals: TPAMI 2017, TPAMI 2019, MM 2019.
Conferences: NeurIPS 2021, CHI 2021, WACV 2021, CVPR 2021, ETRA 2021, WACV 2020, CHI 2020, ACCV 2020, UIST 2020, CVPR 2020, ETRA 2020, CVPR 2020, IMWUT 2020, ETRA 2019, CHI 2019, CHI 2018, ETRA 2018, UIST 2017, IMWUT 2017, Augmented Human 2017, IWBF 2017, UIST 2017, Multimedia 2017, UIST 2016, ETRA 2016
Awards and Fellowships
2019, The first place of OpenEDS Challenge 2019 at ICCV 2019.
2017, Best paper honorable mention award, ACM Symposium on User Interface Software and Technology (UIST 2017)
2016, Best paper honorable mention award, ACM Symposium on User Interface Software and Technology (UIST 2016)
2013--2015, International Max Planck Research School for Computer Science (IMPRS-CS) Scholarship, Germany
Invited talks
May, 2018 ETH Zurich, Switzerland. Hosted by Prof. Otmar Hilliges.
March, 2018 The University of Tokyo, Japan. Hosted by Prof. Yoichi Sato.
March, 2018 Osaka University, Japan. Hosted by Prof. Yusuke Sugano.
March, 2018 Keio University, Japan. Hosted by Prof. Kai Kunze.