I am currently a principal researcher at Microsoft Cloud + AI. Before that, I obtained my PhD degree in University of Science and Technology of China (USTC) under the joint PhD program between MSRA and USTC in 2019. I was luckily advised by Gang Hua, Lu Yuan, Jing Liao and Prof. Nenghai Yu. My research interests are in computer vision and deep learning. I'm particularly interested in the areas of image generation, style transfer, object detection and AI security. You can find my cv here.

Publications

Peco: Perceptual codebook for bert pre-training of vision transformers
Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, Nenghai Yu
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI 2023)
[pdf] [code]
Frido: Feature Pyramid Diffusion for Complex Scene Image Synthesis
Wan-Cyuan Fan, Yen-Chun Chen, Dongdong Chen, Yu Cheng, Lu Yuan, Yu-Chiang Frank Wang
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI 2023)
[pdf] [code]
i-Code: An Integrative and Composable Multimodal Learning Framework
Ziyi Yang, Yuwei Fang, Chenguang Zhu, Reid Pryzant, Dongdong Chen, et.al, Xuedong Huang
Thirty-Seventh AAAI Conference on Artificial Intelligence (AAAI 2023)
[pdf] [code]
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks
Junke Wang, Dongdong Chen, Zuxuan Wu, Chong Luo, Luowei Zhou, Yucheng Zhao, Yujia Xie, Ce Liu, Yu-Gang Jiang, Lu Yuan
Thirty-sixth Conference on Neural Information Processing Systems (NeurIPs 2022)
[pdf] [code]
REVIVE: Regional Visual Representation Matters in Knowledge-Based Visual Question Answering
Yuanze Lin, Yujia Xie, Dongdong Chen, Yichong Xu, Chenguang Zhu, Lu Yuan
Thirty-sixth Conference on Neural Information Processing Systems (NeurIPs 2022)
[pdf] [code]
Bootstrapped Masked Autoencoders for Vision BERT Pretraining
Xiaoyi Dong, Jianmin Bao, Ting Zhang, Dongdong Chen, Weiming Zhang, Lu Yuan, Dong Chen, Fang Wen, Nenghai Yu
European Conference on Computer Vision (ECCV 2022)
[pdf] [code]
Should All Proposals be Treated Equally in Object Detection?
Yunsheng Li, Yinpeng Chen, Xiyang Dai, Dongdong Chen, Mengchen Liu, Pei Yu, Jing Yin, Lu Yuan, Zicheng Liu, Nuno Vasconcelos
European Conference on Computer Vision (ECCV 2022)
[pdf] [code]
BEVT: BERT Pretraining of Video Transformers
Rui Wang, Dongdong Chen, Zuxuan Wu, Yinpeng Chen, Xiyang Dai, Mengchen Liu, Yugang Jiang, Luowei Zhou, Lu Yuan
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)
[pdf] [code]
Large Scale Pre-training for Person Re-identification with Noisy Labels
Dengpan Fu, Dongdong Chen, Hao Yang, Jianmin Bao, Lu Yuan, Lei Zhang, Houqiang Li, Dong Chen, Fang Wen
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)
[pdf] [code]
HairCLIP: Design Your Hair by Text and Reference Image
Tianyi Wei, Dongdong Chen, Wenbo Zhou, Jing Liao, Zhentao Tan, Lu Yuan, Weiming Zhang, Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)
[pdf] [code]
CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields
Can Wang, Menglei Chai, Mingming He, Dongdong Chen, Jing Liao
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)
[pdf] [code]
General Facial Representation Learning in a Visual-Linguistic Manner
Yinglin Zheng, Hao Yang, Ting Zhang, Jianmin Bao, Dongdong Chen, Yangyu Huang, Lu Yuan, Dong Chen, Ming Zeng, Fang Wen
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022 Oral)
[pdf] [code]
Vector Quantized Diffusion Model for Text-to-Image Synthesis
Shuyang Gu, Dong Chen, Jianmin Bao, Fang Wen, Bo Zhang, Dongdong Chen, Lu Yuan, Baining Guo
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022 Oral)
[pdf] [code]
Mobile-Former: Bridging MobileNet and Transformer
Yinpeng Chen, Xiyang Dai, Dongdong Chen, Mengchen Liu, Xiaoyi Dong, Lu Yuan, Zicheng Liu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022 Oral)
[pdf] [code]
CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windows
Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Weiming Zhang, Nenghai Yu, Lu Yuan, Dong Chen, Baining Guo
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)
[pdf] [code]
Reduce Information Loss in Transformers for Pluralistic Image Inpainting
Qiankun Liu, Zhentao Tan, Dongdong Chen, Qi Chu, Xiyang Dai, Yinpeng Chen, Mengchen Liu, Lu Yuan, Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)
[pdf] [code]
Bringing Old Films Back to Life
Ziyu Wan, Bo Zhang, Dongdong Chen, Jing Liao
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)
[pdf] [code]
Protecting Celebrities from DeepFake with Identity Consistency Transformer
Xiaoyi Dong, Jianmin Bao, Dongdong Chen, Ting Zhang, Weiming Zhang, Nenghai Yu, Dong Chen, Fang Wen, Baining Guo
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)
[pdf] [code]
Shape-invariant 3D Adversarial Point Clouds
Qidong Huang, Xiaoyi Dong, Dongdong Chen, Hang Zhou, Weiming Zhang, Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)
[pdf] [code]
Stronger NAS with Weaker Predictors
Junru Wu, Xiyang Dai, Dongdong Chen, Yinpeng Chen, Mengchen Liu, Ye Yu, Zhangyang Wang, Zicheng Liu, Mei Chen, Lu Yuan
Advances in Neural Information Processing Systems (NeurIPs 2021)
[pdf] [bibtex] [code]
High-Fidelity Pluralistic Image Completion with Transformers
Ziyu Wan, Jingbo Zhang, Dongdong Chen, Jing Liao
International Conference on Computer Vision (ICCV 2021)
[pdf] [bibtex] [code] [Project Page]
Learning with Noisy Labels for Robust Point Cloud Segmentation
Shuquan Ye, Dongdong Chen, Songfang Han, Jing Liao
International Conference on Computer Vision (ICCV 2021 Oral)
[pdf] [bibtex] [code] [Project Page]
Improving Image Recognition with Extremely Low FLOPs
Yunsheng Li, Yinpeng Chen, Xiyang Dai, Dongdong Chen, Mengchen Liu, Lu Yuan, Zicheng Liu, Lei Zhang, Nuno Vasconcelos
International Conference on Computer Vision (ICCV 2021)
[pdf] [bibtex]
Improve Unsupervised Pretraining for Few-label Transfer
Suichan Li, Dongdong Chen, Yinpeng Chen, Lu Yuan, Lei Zhang, Qi Chu, Bin Liu, Nenghai Yu
International Conference on Computer Vision (ICCV 2021)
[pdf] [bibtex]
Unsupervised Pre-training for Person Re-identification
Dengpan Fu, Dongdong Chen, Jianmin Bao, Hao Yang, Lu Yuan, Lei Zhang, Houqiang Li, Dong Chen
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021)
[pdf] [bibtex] [code]
Dynamic Convolution via Matrix Decomposition
Yunsheng Li, Yinpeng Chen, Xiyang Dai, Mengchen Liu, Dongdong Chen, Ye Yu, Lu Yuan, Zicheng Liu, Mei Chen, Nuno Vasconcelos
ICLR 2021
[pdf] [code]
Improved Image Matting via Real-time User Clicks and Uncertainty Estimation
Tianyi Wei, Dongdong Chen, Wenbo Zhou, Jing Liao, Hanqing Zhao, Weiming Zhang, Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021)
[pdf] [bibtex]
Dynamic Head: Unifying Object Detection Heads with Attentions
Xiyang Dai, Yinpeng Chen, Bin Xiao, Dongdong Chen, Mengchen Liu, Lu Yuan, Lei Zhang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021)
[pdf] [bibtex] [code]
Multi-attentional Deepfake Detection
Hanqing Zhao, Wenbo Zhou, Dongdong Chen, Tianyi Wei, Weiming Zhang, Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021)
[pdf] [bibtex] [code]
Diverse Semantic Image Synthesis via Probability Distribution Modeling
Zhentao Tan, Menglei Chai, Dongdong Chen, Jing Liao, Qi Chu, Bin Liu, Gang Hua, Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021)
[pdf] [bibtex] [code]
Efficient Semantic Image Synthesis via Class-Adaptive Normalization
Zhentao Tan, Dongdong Chen, Qi Chu, Menglei Chai, Jing Liao, Mingming He, Lu Yuan, Gang Hua Nenghai Yu
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2021)
[pdf] [bibtex] [code]
Improving Person Re-identification with Iterative Impression Aggregation
Dengpan Fu, Bo Xin, Jingdong Wang, Dongdong Chen, Jianmin Bao, Gang Hua, Houqiang Li
TIP 2020
[pdf] [code]
GreedyFool: Distortion-Aware Sparse Adversarial Attack
Xiaoyi Dong, Dongdong Chen, Jianmin Bao, Chuan Qin, Lu Yuan, Weiming Zhang, Nenghai Yu, Dong Chen
Advances in Neural Information Processing Systems (NeurIPs 2020)
[pdf] [bibtex] [code]
Passport-aware Normalization for Deep Model Protection
Jie Zhang, Dongdong Chen, Jing Liao, Weiming Zhang, Gang Hua, Nenghai Yu
Advances in Neural Information Processing Systems (NeurIPs 2020)
[pdf] [bibtex] [code]
Dynamic ReLU
Yinpeng Chen, Xiyang Dai, Mengchen Liu, Dongdong Chen, Lu Yuan, Zicheng Liu
European Conference on Computer Vision (ECCV 2020)
[pdf] [bibtex]
DA-NAS: Data Adapted Pruning for Efficient Neural Architecture Search
Xiyang Dai, Dongdong Chen, Mengchen Liu, Yinpeng Chen, Lu Yuan
European Conference on Computer Vision (ECCV 2020)
[pdf] [bibtex]
MichiGAN: Multi-Input-Conditioned Hair Image Generation for Portrait Editing
Zhentao Tan, Menglei Chai, Dongdong Chen, Jing Liao, Qi Chu, Lu Yuan, Sergey Tulyakov, Nenghai Yu
ACM Transactions on Graphics (SIGGRAPH) 2020
[pdf] [code] [bibtex]
Dynamic Convolution: Attention over Convolution Kernels
Yinpeng Chen, Xiyang Dai, Mengchen Liu, Dongdong Chen, Lu Yuan, Zicheng Liu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020)
[pdf] [bibtex]
Bringing Old Photos Back to Life
Ziyu Wan, Bo Zhang, Dongdong Chen, Pan Zhang, Dong Chen, Jing Liao, Fan Wen
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020 Oral)
[pdf] [code] [bibtex] [PAMI extension]
Density-Aware Graph for Deep Semi-Supervised Visual Recognition
Suichan Li, Bin Liu, Dongdong Chen, Qi Chu, Lu Yuan, Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020)
[pdf] [bibtex]
Robust Superpixel-Guided Attentional Adversarial Attack
Xiaoyi Dong, Jiangfan Han, Dongdong Chen, et al., Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020)
[pdf] [bibtex]
Self-Robust 3D Point Recognition via Gather-vector Guidance
Xiaoyi Dong, Dongdong Chen, et al., Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020)
[pdf] [bibtex]
LG-GAN: Label Guided Adversarial Network for Flexible Targeted Attack of Point Cloud-based Deep Networks
Hang Zhou, Dongdong Chen, et al., Nenghai Yu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020)
[pdf] [bibtex]
Model Watermarking for Image Processing Networks
Jie Zhang*, Dongdong Chen, et al., Nenghai Yu
Thirty-Fourth AAAI Conference on Artificial Intelligence (AAAI 2020)
[pdf] [bibtex] [TPAMI Version]
Transductive Zero-Shot Learning with Visual Structure Constraint
Ziyu Wan*, Dongdong Chen*, Yan Li, Xingguang Yan, Junge Zhang, Yizhou Yu, Jing Liao (*Equal Contribution)
Thirty-third Conference on Neural Information Processing Systems (NeurIPS 2019)
[pdf] [bibtex] [IJCV Extension]
Once a MAN: Towards Multi-Target Attack via Learning Multi-Target Adversarial Network Once
Jiangfan Han, Xiaoyi Dong, Ruimao Zhang, Dongdong Chen, Weiming Zhang, Nenghai Yu, Ping Luo, Xiaogang Wang
Proceedings of the IEEE International Conference on Computer Vision (ICCV 2019)
[pdf] [bibtex]
A General Decoupled Learning Framework for Parameterized Image Operators
Qingnan Fan*, Dongdong Chen*, Lu Yuan, Gang Hua, Nenghai Yu, Baoquan Chen (*Equal Contribution)
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2019)
[pdf] [bibtex]
Progressive Color Transfer with Dense Semantic Correspondences
Mingming He, Jing Liao, Dongdong Chen*, Lu Yuan, Pedro V Sander
ACM TOG 2018
[pdf] [bibtex]
Mirror, Mirror, on the Wall, Who's Got the Clearest Image of Them All?-A Tailored Approach to Single Image Reflection Removal
Daniel Heydecker, Georg Maierhofer, Angelica I Aviles-Rivero, Qingnan Fan, Dongdong Chen, Carola-Bibiane Schönlieb, Sabine Süsstrunk
TIP 2019
[pdf]
Gated Context Aggregation Network for Image Dehazing and Deraining
Dongdong Chen*, Mingming He, Qingnan Fan, Jing Liao, Liheng Zhang, Dongdong Hou, Lu Yuan, Gang Hua
WACV 2019
[pdf] [code] [bibtex]
Decouple Learning for Parameterized Image Operators
Qingnan Fan*, Dongdong Chen*, Lu Yuan, Gang Hua, Nenghai Yu, Baoquan Chen (* Equal Contribution)
ECCV 2018
[pdf] [code] [bibtex]
Deep Exemplar-based Colorization
Mingming He*, Dongdong Chen*, Jing Liao, Pedro V.Sander, Lu Yuan (* Equal Contribution)
Siggraph 2018
[pdf] [code] [supplementary] [bibtex]
Stereoscopic Neural Style Transfer
Dongdong Chen, Lu Yuan, Jing Liao, Nenghai Yu, Gang Hua
CVPR 2018
[pdf] [supplementary] [video] [bibtex]
Coherent Online Video Style Transfer
Dongdong Chen, Jing Liao, Lu Yuan, Nenghai Yu, Gang Hua
ICCV 2017
[pdf] [video] [bibtex]
StyleBank: An Explicit Representation for Neural Image Style Transfer
Dongdong Chen, Lu Yuan, Jing Liao, Nenghai Yu, Gang Hua
CVPR 2017
[pdf] [supplementary] [video] [bibtex] [TPAMI Version]
Congrats! Our technique is adopted by Microsoft Pix.
Automatic Extraction of Moving Objects from Image and LIDAR Sequences
Jizhou Yan, Dongdong Chen, Heesoo Myeong, Takaaki Shiratori, Yi Ma
International Conference on 3D Vision 2014
[pdf] [bibtex]

Book Chapters

Gang Hua, Dongdong Chen, "Deep Conditional Image Generation: Towards Controllable Visual Pattern Modeling", in Advanced Methods and Deep Learning in Computer Vision, editted by E .R. Davies and Matthew Turk, Elsevier, 2021.
Dongdong Chen, Lu Yuan, Gang Hua, "Deep Style Transfer", in Computer Vision: A Reference Guide, Second Edition, edited by Katsushi Ikeuchi, Springer 2020
Dongdong Chen, Lu Yuan, Gang Hua, "Texutre Synthesis", in Computer Vision: A Reference Guide, Second Edition, edited by Katsushi Ikeuchi, Springer 2020

Experience

2010.08~2014.06:   Bachelor in Electrical Engineering in University of Science and Technology of China
2013.07~2014.05:   Intern in MSRA advised by Yi Ma and Jian Sun respectively
2015.07~2015.10:   Intern in Alibaba Group Beijing
2015.11~2018.03:   Intern in MSRA advised by Jian Sun and Gang Hua and Lu Yuan respectively.
2018.04~2018.09:   Intern in Microsoft Redmond advised Gang Hua.

Professional Activities

Invited as Area Chair of CVPR 2023
Invited as Area Chair of ECCV 2022
Invited as Associate Editor with Pattern Recognition from 2022
Invited as Area Chair of ICPR 2022
Invited as Senior Program Committee (SPC) of AAAI 2022 and Area Chair of CVPR 2022
Reviewer: CVPR 2021, ICCV 2021, NeurIPs 2021
Reviewer: CVPR 2020, ECCV 2020, NeurIPs 2020, AAAI 2020,
Reviewer: CVPR 2019, ICCV 2019, AAAI 2019, PRCV 2019, ICME 2019, ICIG 2019
Reviewer: CVPR2018, ECCV 2018, ACCV2018
Reviewer: IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI)
Reviewer: International Journal of Comuter Vision(IJCV)
Reviewer: IEEE Transactions on Image Processing(TIP)
Reviewer: IEEE Transactions on MultiMedia(TMM)
Reviewer: IEEE Transactions on Circuits and Systems for Video Technology(TCSVT)
Reviewer: Machine Vision and Applications(MVAP)
Reviewer: Journal of Selected Topics in Signal Processing (JSTSP)
Reviewer: Public Library of Science (PLOS ONE)

Awards and Honors

Outstanding Reviewer Award of CVPR 2020, CVPR 2021, ICCV 2021
Chinese Academy of Sciences President Award (Special), July 2019
National Scholarship for Graduate Students, Nov 2018
(3/2950 Teams) FashionAI Global Challenge—Attributes Recognition of Apparel 2018
(7/2322 Teams) FashionAI Global Challenge—Key Points Detection of Apparel 2018
National ScholarShip, Nov 2012
National ScholarShip, Nov 2013
Grand Prize (1/1438 teams) in CCF National Youth Innovation Contest of Big Data 2015
Top 5 in Tianyi Algorithm Contest of Big Data 2016
Best Demo Prize of Di-Tech Algorithm Contest of Big Data 2016