Xiaohang Zhan (詹晓航)
ORCID iD iconorcid.org/0000-0003-2136-7592

Email: xiaohangzhan[AT]outlook[dot]com

About Me (GitHub) (Google scholar) (LinkedIn)

Xiaohang Zhan is currently a senior research scientist in AI Lab, Tencent from 2023. Before that, He received his B.Eng. degree from Tsinghua University in 2016, and Ph.D. degree from the Multimedia Laboratory (MMLab) at the Chinese University of Hong Kong in 2020 (1 year shortened), supervised by Chen Change Loy and Xiaoou Tang. Afterwards, he joined Huawei via Huawei Genius Youth Program (2020). His research interests include unsupervised learning from 2016, and AI+CG from 2020. He is the reviewer of most top conferences and journals in AI&CV. He was awarded Top 100 Chinese New Stars in Artificial Intelligence by Baidu Scholar in 2021. Besides, he was the major contributor of the repo MMSelfsup in OpenMMLab project.

Experience

AI Lab, Tencent

March 2023 - Now.
Title: Group leader, Senior research scientist.
Experience: Research in computer graphics, character animation, 3D content generation and technology productization in Game/XR industry.
 Recruiting interns! Feel free to drop me an email.
2012 Labs, Huawei

August 2020 - March 2023.
Title: Project leader, Huawei Genius Youth, Huawei assistant scientist.
Experience: Research and productization of digital human technologies, including parametric modeling, auto rigging, body & face motion capture & synthesis.

Education

The Chinese University of Hong Kong (MMLab)

August 2017 - August 2020 (1 year shortened). Ph.D. in Information Engineering.
August 2016 - August 2017. Research assistant.
Tsinghua University

August 2012 - July 2016. Bachelor.
With "Outstanding Undergraduates Award" (top 1%).

Projects

2022
HMS Auto-Rigging Solution for Biped Characters @Huawei

My duty: project leader, first author.
Achievements: robust results for variance in shape, pose and mesh topology, industry-leading accuracy and efficiency, the first auto-rigging service on mobile terminals.
Productization: HMS Core.
Publicity: Huawei Developer Conference 2022 (start from 1:01:00), Bilibili.
2021
MMSelfSup: An open source self-supervised representation learning toolbox @OpenMMLab

My duty: first author.
Project page: mmselfsup

Publications

Preprints
HeadEvolver: Text to Head Avatars via Locally Learnable Mesh Deformation

Duotun Wang*, Hengyu Meng*, Zeyu Cai*, Zhijing Shao, Qianxi Liu, Lin Wang, Mingming Fan, Ying Shan, Xiaohang Zhan, Zeyu Wang
arXiv preprint

[Paper] [Project Page]
2024
Programmable Motion Generation for Open-Set Motion Control Tasks

Hanchao Liu, Xiaohang Zhan, Shaoli Huang, Tai-Jiang Mu, Ying Shan
CVPR 2024

HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting

Xian Liu, Xiaohang Zhan, Jiaxiang Tang, Ying Shan, Gang Zeng, Dahua Lin, Xihui Liu, Ziwei Liu
CVPR 2024

[Paper] [Project Page] [Code] [Demo]
TapMo: Shape-aware Motion Generation of Skeleton-free Characters

Jiaxu Zhang, Shaoli Huang, Zhigang Tu, Xin Chen, Xiaohang Zhan, Gang Yu, Ying Shan
ICLR 2024

[Paper]
2023
RaBit: Parametric Modeling of 3D Biped Cartoon Characters with a Topological-consistent Dataset

Zhongjin Luo*, Shengcai Cai*, Jinguo Dong, Ruibo Ming, Liangdong Qiu, Xiaohang Zhan, Xiaoguang Han
CVPR 2023

[Paper] [Project Page] [Dataset]
Masked Frequency Modeling for Self-Supervised Visual Pre-Training

Jiahao Xie, Wei Li, Xiaohang Zhan, Ziwei Liu, Yew Soon Ong, Chen Change Loy
ICLR 2023

[Paper] [Project Page]
2022
Delving into Inter-Image Invariance for Unsupervised Visual Representations

Jiahao Xie, Xiaohang Zhan, Ziwei Liu, Yew Soon Ong, Chen Change Loy
IJCV 2022

[Paper] [Code]
Open Long-Tailed Recognition in a Dynamic World

Ziwei Liu*, Zhongqi Miao*, Xiaohang Zhan, Jiayun Wang, Boqing Gong, Stella X. Yu
TPAMI 2022

[Paper] [Project Page] [Code] [Demo]
Style‐ERD: Responsive and Coherent Online Motion Style Transfer

Tianxin Tao, Xiaohang Zhan, Zhongquan Chen, Michiel van de Panne
CVPR 2022

[Paper] [Project Page] [Code]
Beyond Single Instance Multi-view Unsupervised Representation Learning

Xiangxiang Chu, Xiaohang Zhan, Xiaolin Wei
BMVC 2022

[Paper]
2021
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation

Xingang Pan, Xiaohang Zhan, Bo Dai, Dahua Lin, Chen Change Loy, Ping Luo
TPAMI 2021

[Paper] [Project Page] [Code]
Unsupervised Object-Level Representation Learning from Scene Images

Jiahao Xie, Xiaohang Zhan, Ziwei Liu, Yew Soon Ong, Chen Change Loy
NeurIPS 2021

[Paper] [Project Page] [Code]
DetCo: Unsupervised Contrastive Learning for Object Detection

Enze Xie*, Jian Ding*, Wenhai Wang, Xiaohang Zhan, Hang Xu, Zhenguo Li, Ping Luo
ICCV 2021

[Paper] [Code]
2020
Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation

Xingang Pan, Xiaohang Zhan, Bo Dai, Dahua Lin, Chen Change Loy, Ping Luo
ECCV 2020 (Oral)

[Paper] [Project Page] [Code]
Self-Supervised Scene De-occlusion

Xiaohang Zhan, Xingang Pan, Bo Dai, Ziwei Liu, Dahua Lin, Chen Change Loy
CVPR 2020 (Oral)

[Paper] [Project Page] [Code] [Demo]
Online Deep Clustering for Unsupervised Representation Learning

Xiaohang Zhan*, Jiahao Xie*, Ziwei Liu, Yew-Soon Ong, Chen Change Loy
CVPR 2020

[Paper] [Code]
Learning to Cluster Faces via Confidence and Connectivity Estimation

Lei Yang, Dapeng Chen, Xiaohang Zhan, Rui Zhao, Chen Change Loy, Dahua Lin
CVPR 2020

[Paper] [Project Page] [Code]
Compound Domain Adaptation in an Open World

Ziwei Liu*, Zhongqi Miao*, Xingang Pan, Xiaohang Zhan, Stella X. Yu, Dahua Lin, Boqing Gong
CVPR 2020 (Oral)

[Paper] [Project Page] [Demo] [Code]
2019
Collaborative Online Deep Clustering for Unsupervised Representation Learning

Xiaohang Zhan, Jiahao Xie, Ziwei Liu, Yew Soon Ong, Chen Change Loy
The Champion of Facebook AI Self-Supervision Challenge (all tracks), in ICCV Extreme Vision Workshop, 2019

Switchable Whitening for Deep Representation Learning

Xingang Pan, Xiaohang Zhan, Jianping Shi, Xiaoou Tang, Ping Luo
ICCV 2019

[Paper] [Code]
Large-scale Long-Tailed Recognition in an Open World

Ziwei Liu*, Zhongqi Miao*, Xiaohang Zhan, Jiayun Wang, Boqing Gong, Stella X. Yu
CVPR 2019 (Oral)

[Paper] [Project Page] [Code]
Learning to Cluster Faces on an Affinity Graph

Lei Yang, Xiaohang Zhan, Dapeng Chen, Junjie Yan, Chen Change Loy, Dahua Lin
CVPR 2019 (Oral)

[PDF] [Paper] [Code]
Self-Supervised Learning via Conditional Motion Propagation

Xiaohang Zhan, Xingang Pan, Ziwei Liu, Dahua Lin, Chen Change Loy
CVPR 2019

[Paper] [Project Page] [Code] [Demo]
2018
Consensus-Driven Propagation in Massive Unlabeled Data for Face Recognition

Xiaohang Zhan, Ziwei Liu, Junjie Yan, Dahua Lin, Chen Change Loy
ECCV 2018

[Paper] [Project Page] [Code]
Mix-and-Match Tuning for Self-Supervised Semantic Segmentation

Xiaohang Zhan, Ziwei Liu, Ping Luo, Xiaoou Tang, Chen Change Loy
AAAI 2018 (Spotlight)

[Paper] [Project Page] [Code]

Professional activities

  • Reviewer of T-PAMI, IJCV, CVPR, ICCV, ECCV, AAAI, BMVC, NeurIPS.
  • CULane Dataset: a large-scale challenging dataset for traffic lane detection.

    • Honors and Awards

  • Top 100 Chinese New Stars in Artificial Intelligence, AI华人新星百强 (100 out of 45205), 2021, Baidu Scholar.
  • Huawei Genius Youth Program, 2020
  • Winner of Facebook AI Self-Supervision Challenge 2019
  • Hong Kong PhD Fellowship, 2017, the Research Grants Council (RGC) of Hong Kong
  • Outstanding Undergraduates Award of Tsinghua University, 2016 (63 winners out of about 3500 graduates)
  • Outstanding Undergraduates Award of Beijing, 2016
  • National Scholarship, 2014, Ministry of Education of China
  • Technological Innovation Scholarship, 2014, 2015, Tsinghua University
  • First class Academic Scholarship, 2013, 2014, Tsinghua University
  • Special class Integrated Excellence Scholarship, 2013, Tsinghua University
  • “Spark” Innovative Talent Cultivation Program for Students of Tsinghua University (50 out of about 3500)

    • Published with GitHub Pages