Carousel imageCarousel image

Dr. Xucong Zhang

I am a postdoctoral researcher working at ETH Zurich in the Advanced Interaction Technologies Lab, led by Prof. Otmar Hilliges.

My current research is about human-computer interaction, computer vision, and machine learning. My research interest is human-centred computing as developing techniques for sensing, understanding, and serving the human user. Specifically, I am working on gaze estimation and corresponding applications in real-world settings (step 1). I am trying to do research related to biology in the near future (step 2). My ultimate goal is integrating the human and machine to strengthen human ability (step 3).

E-Mail: xucong.zhang(AT)inf.ethz.ch

Links: Google Scholar, CV [PDF], DBLP, LinkedIn

Short Bio

I finished my PhD degree (summa cum laude, 2013-2018) at Max Planck Institute for Informatics, German, under the supervision of Prof. Andreas Bulling. Prior to that, I received my Master degree (2010-2013) from Beihang University and Bachelor degree (2007-2010) from China Agricultural University in China. I worked as an intern in CBSR Lab, the Chinese Academy of Sciences from 2011 to 2013.

Latest news

[07.2020] One paper is accepted at BMVC 2020. See you online!

[05.2020] Two papers are accepted at ECCV 2020. See you online!

[04.2020] One paper is accepted by TIP.

[01.2020] We are going to organise "OpenEyes" workshop at ECCV 2020.

[09.2019] We won the OpenEDS Challenge 2019 (Synthetic Eye Generation Challenge).

[07.2019] One paper is accepted at ICCV 2019.

Publications

2020

Learning-based Region Selection for End-to-End Gaze Estimation

Xucong Zhang, Yusuke Sugano, Andreas Bulling, Otmar Hilliges. BMVC 2020.

[To appear]

ETH-XGaze: A Large Scale Dataset for Gaze Estimation under Extreme Head Pose and Gaze Variation

Xucong Zhang, Seonwook Park, Thabo Beeler, Derek Bradley, Siyu Tang and Otmar Hilliges. ECCV 2020. Accepted as spotlight.

[Project page] [PDF]

Towards End-to-end Video-based Eye-tracking

Seonwook Park, Emre Aksan, Xucong Zhang, and Otmar Hilliges. ECCV 2020.

[Project page] [PDF]

Gaze Estimation by Exploring Two-Eye Asymmetry

Yihua Cheng, Xucong Zhang, Feng Lu, Yoichi Sato. TIP 2020.

[PDF]

2019

Evaluation of Appearance-Based Methods for Gaze-Based Applications

Xucong Zhang, Yusuke Sugano, and Andreas Bulling. CHI 2019.

[Project page] [PDF]

Photo-realistic Monocular Gaze Redirection Using Generative Adversarial Networks

Zhe He, Adrian Spurr, Xucong Zhang, Otmar Hilliges. ICCV 2019.

[Project page] [PDF] [Code]

Content-Consistent Generation of Realistic Eyes with Style

Marcel Buhler, Seonwook Park, Shalini De Mello, Xucong Zhang, and Otmar Hilliges. ICCVW 2019.

[Project page] [PDF]

2018

Gaze estimation and interaction in real-world environments

Xucong Zhang. PhD thesis.

[PDF]

Training Person-Specific Gaze Estimators from User Interactions with Multiple Devices

Xucong Zhang, Yusuke Sugano, and Andreas Bulling. CHI 2018.

[PDF]

Learning to find eye region landmarks for remote gaze estimation in unconstrained settings

Seonwook Park , Xucong Zhang, Andreas Bulling, and Otmar Hilliges . ETRA 2018.

[Project page] [PDF] [Code]

Revisiting data normalization for appearance-based gaze estimation

Xucong Zhang, Yusuke Sugano, and Andreas Bulling. ETRA 2018.

[Project page] [PDF]

Robust Eye Contact Detection in Natural Multi-Person Interactions Using Gaze and Speaking Behaviour

Philipp Müller, Xucong Zhang, Michael Xuelin Huang, and Andreas Bulling. ETRA 2018.

[Project page] [PDF]

2017

Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery

Xucong Zhang, Yusuke Sugano, and Andreas Bulling. UIST 2017. Best paper honorable mention award.

[PDF]

It’s written all over your face: Full-face appearance-based gaze estimation

Xucong Zhang, Yusuke Sugano, and Andreas Bulling. CVPRW 2017.

[Project page][PDF]

MPIIGaze: Real-World Dataset and Deep Appearance-Based Gaze Estimation

Xucong Zhang, Yusuke Sugano, Mario Fritz , and Andreas Bulling. TPAMI 2017.

[PDF]

2016

AggreGaze: Collective Estimation of Audience Attention on Public Displays

Yusuke Sugano, Xucong Zhang, Andreas Bulling. UIST 2016. Best paper honorable mention award.

[PDF]

Labelled pupils in the wild: A dataset for studying pupil detection in unconstrained environments

Marc Tonsen, Xucong Zhang, Yusuke Sugano, Andreas Bulling. ETRA 2016.

[Project page] [PDF]

Combining Eye Tracking with Optimizations for Lens Astigmatism in modern wide-angle HMDs

Daniel Pohl , Xucong Zhang, Andreas Bulling. VR 2016.

[PDF]

2015

Rendering of eyes for eye-shape registration and gaze estimation

Erroll Wood, Tadas Baltrušaitis, Xucong Zhang, Yusuke Sugano, Peter Robinson, Andreas Bulling. ICCV 2015.

[Project page] [PDF]

Appearance-based gaze estimation in the wild

Xucong Zhang, Yusuke Sugano, Mario Fritz, Andreas Bulling. CVPR 2015.

[Project page]

2011-2013

Robust multi-resolution pedestrian detection in traffic scenes

Junjie Yan, Xucong Zhang, Zhen Lei, Shengcai Liao, and Stan Z. Li. CVPR 2013. Accepted as oral.

[PDF]

Water Filling: Unsupervised People Counting via Vertical Kinect Sensor

Xucong Zhang, Junjie Yan, Shikun Feng , Zhen Lei, Dong Yi, and Stan Z. Li . AVSS 2012.

[PDF]

Professional activity, awards and talks

Organizing committee

Organiser committee of the "OpenEyes" workshop at ECCV 2020.

Organiser committee of the Gaze Estimation and Prediction in the Wild workshop at ICCV 2019

Teaching

Two classes on Machine Perception - SS '19 at ETH Zurich

Supervision/Co-supervision

Mater thesis, Valentin Venzin, Person-Specific Human EyeGaze-Base Interactions. 2020

Master thesis, Yufeng Deng, Accurate and Photo-realistic Person-specific Gaze Re-direction. 2020

Semester Project, Marcel Buhler, Feature Preserving Image Translation for Gaze Estimation. 2019

Reviewing

Journals: TPAMI 2017, TPAMI 2019, MM 2019.

Conferences: ACCV 2020, UIST 2020, CVPR 2020, ETRA 2020, CVPR 2020, IMWUT 2020, ETRA 2019, CHI 2019, CHI 2018, ETRA 2018, UIST 2017, IMWUT 2017, Augmented Human 2017, IWBF 2017, UIST 2017, Multimedia 2017, UIST 2016, ETRA 2016

Awards and Fellowships

2019, The first place of OpenEDS Challenge 2019 at ICCV 2019.

2017, Best paper honorable mention award, ACM Symposium on User Interface Software and Technology (UIST 2017)

2016, Best paper honorable mention award, ACM Symposium on User Interface Software and Technology (UIST 2016)

2013--2015, International Max Planck Research School for Computer Science (IMPRS-CS) Scholarship, Germany

Invited talks

May, 2018 ETH Zurich, Switzerland. Hosted by Prof. Otmar Hilliges.

March, 2018 The University of Tokyo, Japan. Hosted by Prof. Yoichi Sato.

March, 2018 Osaka University, Japan. Hosted by Prof. Yusuke Sugano.

March, 2018 Keio University, Japan. Hosted by Prof. Kai Kunze.