Associate Professor
Beihang University37 Xueyuan Rd. Haidian District, Room 419 Zengxianzi Building（曾宪梓楼）
Beijing, China Email: qianyu@buaa.edu.cn
[Google Scholar] [Github]
I am an associate professor at the School of Software, Beihang University . Before I joined Beihang in 2020, I was a postdoctoral research fellow at UC Berkeley / ICSI during 2018~2019, working with Prof. Stella Yu. I received my Ph.D. degree from Queen Mary University of London in 2018, advised by Prof. Yi-Zhe Song and Prof. Tao (Tony) Xiang.
My research is on computer vision and deep learning, with a foucs on sketch understanding and sketch-related applications. I am also interested in video understanding and medical image analysis.
For Prospective Students: I am actively looking for highly-motivated Ph.D., Master students and Research Assistants (undergraduate/graduate level). Please email me with your CV and transcripts if you are interested in my research.News
[Dec.2023] Three papers got accepted by AAAI'24!
[Aug.2023] Will serve as Area Chair of CVPR'24!
[Jul.2023] Will serve as Social Media & Web Chair of ACM MM'24!
[Sep.2023] Our DiffSketcher paper got accepted by NeurIPS 2023!
[Sep.2023] One paper got accepted by PG'23!
[Jul.2023] One paper got accepted by ACM MM'23!
[Jun.2023] One paper got accepted by MICCAI'23!
[Mar.2023] One paper got accepted by T-CSVT!
[Feb.2023] One paper got accepted by ICDE'23!
[Nov.2022] One paper got accepted by AAAI'23 (Student Abstract Track)!
[Oct.2022] One paper got accepted by WACV'22!
[Sep.2022] One paper got accepted by T-CSVT!
[Jul.2022] One paper got accepted by ECCV'22!
[Apr.2022] Our Workshop on Sketching for Human Expressivity has been accepted by ECCV'22.
[Dec.2021] Co-organized the workshop on Sketching Understanding and Advanced Applications at PRCV'21.
[Oct.2021] Co-organized the 1st workshop on Sketching for Human Expressivity (SHE) at ICCV'21!
[Jul.2021] One conference paper on spatio-temporal video grounding (STVG) got accepted by ICCV 2021!
[Jun.2021] One journal paper on human-centric STVG got accepted by IEEE T-CSVT!
[Apr.2021] Gave a talk "Sketch-based photo and 3D generation" at CCF-CV seminar (CCF-CV视界无限)
[Feb.2021] One journal paper on AI for Civil Engineering got published by Automation in Construction!
[Dec.2020] Organized the CCF-CV series talk (CCF-CV走进高校) at Beihang. See details here (in Chinese).
[Oct.2020] One journal paper on AI for Civil Engineering got published on EEEV!
[Sep.2020] One journal paper on sketch-based photo retrieval got accepted by IJCV!
[Jul.2020] One conference paper on sketch-based photo synthesis got accepted at ECCV 2020 as Oral presentation!
[Jan.2020] Joined School of Software, Beihang University. New journey!
Selected Publications [Google Scholar]
*: equal contribution
STVGBert: A Visual-Linguistic Transformer Based Framework for Spatio-Temporal Video Grounding
Rui Su, Qian Yu, Dong Xu.
IEEE International Conference on Computer Vision (ICCV), 2021.
[ Paper ]--
[ Bibtex ]
@InProceedings{Su_2021_ICCV,
author = {Su, Rui and Yu, Qian and Xu, Dong},
title = {STVGBert: A Visual-Linguistic Transformer Based Framework for Spatio-Temporal Video Grounding},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021},
pages = {1533-1542}
Fine-Grained Instance-Level Sketch-Based Image Retrieval
Qian Yu*, Jifei Song*, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales.
International Journal of Computer Vision (IJCV), 2021.
[ Paper ]--[ DOI ]--
[ Bibtex ]
@article{yu2021fine,
title={Fine-grained instance-level sketch-based image retrieval},
author={Yu, Qian and Song, Jifei and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M},
journal={International Journal of Computer Vision},
volume={129},
number={2},
pages={484--500},
year={2021},
publisher={Springer}
}
Human-centric Spatio-temporal Video grounding with Visual Transformers
Zongheng Tang, Yue Liao, Si Liu, Guanbin Li, Xiaojie Jin, Hongxu Jiang, Qian Yu, Dong Xu
IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), 2021.
[ Paper ]--[ DOI ]--[ HC-STVG Dataset ]--
[ Bibtex ]
@article{tang2021human,
title={Human-centric spatio-temporal video grounding with visual transformers},
author={Tang, Zongheng and Liao, Yue and Liu, Si and Li, Guanbin and Jin, Xiaojie and Jiang, Hongxu and Yu, Qian and Xu, Dong},
journal={IEEE Transactions on Circuits and Systems for Video Technology},
year={2021},
publisher={IEEE}
}
Machine learning-based regional scale intelligent modeling of building information for natural hazard risk management
Chaofeng Wang, Qian Yu, Kincho H. Law, Frank McKenna, Stella X. Yu, Ertugrul Taciroglu, Adam Zsarn{\'o}czay, Wael Elhaddad, Barbaros Cetiner.
Automation in Construction, 2021.
[ Paper ]--[ DOI ]--
[ Bibtex ]
@article{wang2021machine,
title={Machine learning-based regional scale intelligent modeling of building information for natural hazard risk management},
author={Wang, Chaofeng and Yu, Qian and Law, Kincho H and McKenna, Frank and Stella, X Yu and Taciroglu, Ertugrul and Zsarn{\'o}czay, Adam and Elhaddad, Wael and Cetiner, Barbaros},
journal={Automation in Construction},
volume={122},
pages={103474},
year={2021},
publisher={Elsevier}
}
Unsupervised Sketch to Photo Synthesis
Runtao Liu*, Qian Yu*, Stella X. Yu.
European Conference on Computer Vision (ECCV), 2020. Oral
[ Paper ]--[ supp ]--[ Code ]--[QMUL-Sketch Dataset (Google Drive)]
[QMUL-Sketch Dataset (Baidu Cloud)](Password:68uo)--
[ Bibtex ]
@inproceedings{liu2020unsupervised,
title={Unsupervised sketch to photo synthesis},
author={Liu, Runtao and Yu, Qian and Yu, Stella X},
booktitle={European Conference on Computer Vision},
pages={36--52},
year={2020},
organization={Springer}
}
Rapid visual screening of soft-story buildings from street view images using deep learning classification
Qian Yu, Chaofeng Wang, Frank McKenna, Stella X. Yu, Ertugrul Taciroglu, Barbaros Cetiner, Kincho H. Law.
Earthquake Engineering and Engineering Vibration, 2020.
[ Paper ]--[ DOI ]--
[ Bibtex ]
@article{yu2020rapid,
title={Rapid visual screening of soft-story buildings from street view images using deep learning classification},
author={Yu, Qian and Wang, Chaofeng and McKenna, Frank and Yu, Stella X and Taciroglu, Ertugrul and Cetiner, Barbaros and Law, Kincho H},
journal={Earthquake Engineering and Engineering Vibration},
volume={19},
number={4},
pages={827--838},
year={2020},
publisher={Springer}
}
Building Information Modeling and Classification by Visual Learning At A City Scale
Qian Yu, Chaofeng Wang, Barbaros Cetiner, Stella X. Yu, Frank McKenna, Ertugrul Taciroglu, Kincho H. Law.
AI + HADR workshop @ NeurIPS 2019.
[ arXiv Paper ]--
[ Bibtex ]
@article{yu2019building,
title={Building information modeling and classification by visual learning at a city scale},
author={Yu, Qian and Wang, Chaofeng and Cetiner, Barbaros and Yu, Stella X and Mckenna, Frank and Taciroglu, Ertugrul and Law, Kincho H},
journal={arXiv preprint arXiv:1910.06391},
year={2019}
}
SketchyScene: Richly-Annotated Scene Sketches
Changqing Zou*, Qian Yu*, Ruofei Du, Haoran Mo, Yi-Zhe Song, Tao Xiang, Chengying Gao, Baoquan Chen, Hao Zhang.
European Conference on Computer Vision (ECCV), 2018.
[ Paper ]--[ Project Page ]--
[ Bibtex ]
@InProceedings{Zou_2018_ECCV,
author = {Zou, Changqing and Yu, Qian and Du, Ruofei and Mo, Haoran and Song, Yi-Zhe and Xiang, Tao and Gao, Chengying and Chen, Baoquan and Zhang, Hao},
title = {SketchyScene: Richly-Annotated Scene Sketches},
booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
month = {September},
year = {2018}
}
Sketch-a-Net: A Deep Neural Network that Beats Humans
Qian Yu, Yongxin Yang, Feng Liu, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales.
International Journal of Computer Vision (IJCV), 2017.
[ Paper ]--[ DOI ]--[ Code ]--
[ Bibtex ]
@article{yu2017sketch,
title={Sketch-a-net: A deep neural network that beats humans},
author={Yu, Qian and Yang, Yongxin and Liu, Feng and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M},
journal={International journal of computer vision},
volume={122},
number={3},
pages={411--425},
year={2017},
publisher={Springer}
}
Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval
Jifei Song*, Qian Yu*, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales.
IEEE International Conference on Computer Vision (ICCV), 2017.
[ Paper ]--[ supp ]--[ Code ]--
[ Bibtex ]
@InProceedings{Song_2017_ICCV,
author = {Song, Jifei and Yu, Qian and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M.},
title = {Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval},
booktitle = {Proceedings of the IEEE International Conference on Computer Vision (ICCV)},
month = {Oct},
year = {2017}
}
Sketch Me That Shoe
Qian Yu, Feng Liu, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales, Chen-Change Loy.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. Oral
[ Paper ]--[ Code ]--[ Video ]--
[ Bibtex ]
@InProceedings{Yu_2016_CVPR,
author = {Yu, Qian and Liu, Feng and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M. and Loy, Chen-Change},
title = {Sketch Me That Shoe},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2016}
}
Sketch-a-Net that Beats Humans
Qian Yu*, Yongxin Yang*, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales.
British Machine Vision Conferenc (BMVC), 2015. Best Scientific Paper
Teaching
Postgraduate Courses:
Deep Learning (2021~)
Machine Learning (Spring 2021)
Undergraduate Course:
AI Computing Systems (2021~)
STVGBert: A Visual-Linguistic Transformer Based Framework for Spatio-Temporal Video Grounding
Rui Su, Qian Yu, Dong Xu.
IEEE International Conference on Computer Vision (ICCV), 2021.
[ Paper ]--
[ Bibtex ]
@InProceedings{Su_2021_ICCV,
author = {Su, Rui and Yu, Qian and Xu, Dong},
title = {STVGBert: A Visual-Linguistic Transformer Based Framework for Spatio-Temporal Video Grounding},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021},
pages = {1533-1542}
author = {Su, Rui and Yu, Qian and Xu, Dong},
title = {STVGBert: A Visual-Linguistic Transformer Based Framework for Spatio-Temporal Video Grounding},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021},
pages = {1533-1542}
Fine-Grained Instance-Level Sketch-Based Image Retrieval
Qian Yu*, Jifei Song*, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales.
International Journal of Computer Vision (IJCV), 2021.
[ Paper ]--[ DOI ]--
[ Bibtex ]
@article{yu2021fine,
title={Fine-grained instance-level sketch-based image retrieval},
author={Yu, Qian and Song, Jifei and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M},
journal={International Journal of Computer Vision},
volume={129},
number={2},
pages={484--500},
year={2021},
publisher={Springer}
}
title={Fine-grained instance-level sketch-based image retrieval},
author={Yu, Qian and Song, Jifei and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M},
journal={International Journal of Computer Vision},
volume={129},
number={2},
pages={484--500},
year={2021},
publisher={Springer}
}
Human-centric Spatio-temporal Video grounding with Visual Transformers
Zongheng Tang, Yue Liao, Si Liu, Guanbin Li, Xiaojie Jin, Hongxu Jiang, Qian Yu, Dong Xu
IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT), 2021.
[ Paper ]--[ DOI ]--[ HC-STVG Dataset ]--
[ Bibtex ]
@article{tang2021human,
title={Human-centric spatio-temporal video grounding with visual transformers},
author={Tang, Zongheng and Liao, Yue and Liu, Si and Li, Guanbin and Jin, Xiaojie and Jiang, Hongxu and Yu, Qian and Xu, Dong},
journal={IEEE Transactions on Circuits and Systems for Video Technology},
year={2021},
publisher={IEEE}
}
title={Human-centric spatio-temporal video grounding with visual transformers},
author={Tang, Zongheng and Liao, Yue and Liu, Si and Li, Guanbin and Jin, Xiaojie and Jiang, Hongxu and Yu, Qian and Xu, Dong},
journal={IEEE Transactions on Circuits and Systems for Video Technology},
year={2021},
publisher={IEEE}
}
Machine learning-based regional scale intelligent modeling of building information for natural hazard risk management
Chaofeng Wang, Qian Yu, Kincho H. Law, Frank McKenna, Stella X. Yu, Ertugrul Taciroglu, Adam Zsarn{\'o}czay, Wael Elhaddad, Barbaros Cetiner.
Automation in Construction, 2021.
[ Paper ]--[ DOI ]--
[ Bibtex ]
@article{wang2021machine,
title={Machine learning-based regional scale intelligent modeling of building information for natural hazard risk management},
author={Wang, Chaofeng and Yu, Qian and Law, Kincho H and McKenna, Frank and Stella, X Yu and Taciroglu, Ertugrul and Zsarn{\'o}czay, Adam and Elhaddad, Wael and Cetiner, Barbaros},
journal={Automation in Construction},
volume={122},
pages={103474},
year={2021},
publisher={Elsevier}
}
title={Machine learning-based regional scale intelligent modeling of building information for natural hazard risk management},
author={Wang, Chaofeng and Yu, Qian and Law, Kincho H and McKenna, Frank and Stella, X Yu and Taciroglu, Ertugrul and Zsarn{\'o}czay, Adam and Elhaddad, Wael and Cetiner, Barbaros},
journal={Automation in Construction},
volume={122},
pages={103474},
year={2021},
publisher={Elsevier}
}
Unsupervised Sketch to Photo Synthesis
Runtao Liu*, Qian Yu*, Stella X. Yu.
European Conference on Computer Vision (ECCV), 2020. Oral
[ Paper ]--[ supp ]--[ Code ]--[QMUL-Sketch Dataset (Google Drive)]
[QMUL-Sketch Dataset (Baidu Cloud)](Password:68uo)--[ Bibtex ]
[QMUL-Sketch Dataset (Baidu Cloud)](Password:68uo)--
@inproceedings{liu2020unsupervised,
title={Unsupervised sketch to photo synthesis},
author={Liu, Runtao and Yu, Qian and Yu, Stella X},
booktitle={European Conference on Computer Vision},
pages={36--52},
year={2020},
organization={Springer}
}
title={Unsupervised sketch to photo synthesis},
author={Liu, Runtao and Yu, Qian and Yu, Stella X},
booktitle={European Conference on Computer Vision},
pages={36--52},
year={2020},
organization={Springer}
}
Rapid visual screening of soft-story buildings from street view images using deep learning classification
Qian Yu, Chaofeng Wang, Frank McKenna, Stella X. Yu, Ertugrul Taciroglu, Barbaros Cetiner, Kincho H. Law.
Earthquake Engineering and Engineering Vibration, 2020.
[ Paper ]--[ DOI ]--
[ Bibtex ]
@article{yu2020rapid,
title={Rapid visual screening of soft-story buildings from street view images using deep learning classification},
author={Yu, Qian and Wang, Chaofeng and McKenna, Frank and Yu, Stella X and Taciroglu, Ertugrul and Cetiner, Barbaros and Law, Kincho H},
journal={Earthquake Engineering and Engineering Vibration},
volume={19},
number={4},
pages={827--838},
year={2020},
publisher={Springer}
}
title={Rapid visual screening of soft-story buildings from street view images using deep learning classification},
author={Yu, Qian and Wang, Chaofeng and McKenna, Frank and Yu, Stella X and Taciroglu, Ertugrul and Cetiner, Barbaros and Law, Kincho H},
journal={Earthquake Engineering and Engineering Vibration},
volume={19},
number={4},
pages={827--838},
year={2020},
publisher={Springer}
}
Building Information Modeling and Classification by Visual Learning At A City Scale
Qian Yu, Chaofeng Wang, Barbaros Cetiner, Stella X. Yu, Frank McKenna, Ertugrul Taciroglu, Kincho H. Law.
AI + HADR workshop @ NeurIPS 2019.
[ arXiv Paper ]--
[ Bibtex ]
@article{yu2019building,
title={Building information modeling and classification by visual learning at a city scale},
author={Yu, Qian and Wang, Chaofeng and Cetiner, Barbaros and Yu, Stella X and Mckenna, Frank and Taciroglu, Ertugrul and Law, Kincho H},
journal={arXiv preprint arXiv:1910.06391},
year={2019}
}
title={Building information modeling and classification by visual learning at a city scale},
author={Yu, Qian and Wang, Chaofeng and Cetiner, Barbaros and Yu, Stella X and Mckenna, Frank and Taciroglu, Ertugrul and Law, Kincho H},
journal={arXiv preprint arXiv:1910.06391},
year={2019}
}
SketchyScene: Richly-Annotated Scene Sketches
Changqing Zou*, Qian Yu*, Ruofei Du, Haoran Mo, Yi-Zhe Song, Tao Xiang, Chengying Gao, Baoquan Chen, Hao Zhang.
European Conference on Computer Vision (ECCV), 2018.
[ Paper ]--[ Project Page ]--
[ Bibtex ]
@InProceedings{Zou_2018_ECCV,
author = {Zou, Changqing and Yu, Qian and Du, Ruofei and Mo, Haoran and Song, Yi-Zhe and Xiang, Tao and Gao, Chengying and Chen, Baoquan and Zhang, Hao},
title = {SketchyScene: Richly-Annotated Scene Sketches},
booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
month = {September},
year = {2018}
}
author = {Zou, Changqing and Yu, Qian and Du, Ruofei and Mo, Haoran and Song, Yi-Zhe and Xiang, Tao and Gao, Chengying and Chen, Baoquan and Zhang, Hao},
title = {SketchyScene: Richly-Annotated Scene Sketches},
booktitle = {Proceedings of the European Conference on Computer Vision (ECCV)},
month = {September},
year = {2018}
}
Sketch-a-Net: A Deep Neural Network that Beats Humans
Qian Yu, Yongxin Yang, Feng Liu, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales.
International Journal of Computer Vision (IJCV), 2017.
[ Paper ]--[ DOI ]--[ Code ]--
[ Bibtex ]
@article{yu2017sketch,
title={Sketch-a-net: A deep neural network that beats humans},
author={Yu, Qian and Yang, Yongxin and Liu, Feng and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M},
journal={International journal of computer vision},
volume={122},
number={3},
pages={411--425},
year={2017},
publisher={Springer}
}
title={Sketch-a-net: A deep neural network that beats humans},
author={Yu, Qian and Yang, Yongxin and Liu, Feng and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M},
journal={International journal of computer vision},
volume={122},
number={3},
pages={411--425},
year={2017},
publisher={Springer}
}
Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval
Jifei Song*, Qian Yu*, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales.
IEEE International Conference on Computer Vision (ICCV), 2017.
[ Paper ]--[ supp ]--[ Code ]--
[ Bibtex ]
@InProceedings{Song_2017_ICCV,
author = {Song, Jifei and Yu, Qian and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M.},
title = {Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval},
booktitle = {Proceedings of the IEEE International Conference on Computer Vision (ICCV)},
month = {Oct},
year = {2017}
}
author = {Song, Jifei and Yu, Qian and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M.},
title = {Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval},
booktitle = {Proceedings of the IEEE International Conference on Computer Vision (ICCV)},
month = {Oct},
year = {2017}
}
Sketch Me That Shoe
Qian Yu, Feng Liu, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales, Chen-Change Loy.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. Oral
[ Paper ]--[ Code ]--[ Video ]--
[ Bibtex ]
@InProceedings{Yu_2016_CVPR,
author = {Yu, Qian and Liu, Feng and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M. and Loy, Chen-Change},
title = {Sketch Me That Shoe},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2016}
}
author = {Yu, Qian and Liu, Feng and Song, Yi-Zhe and Xiang, Tao and Hospedales, Timothy M. and Loy, Chen-Change},
title = {Sketch Me That Shoe},
booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2016}
}
Sketch-a-Net that Beats Humans
Qian Yu*, Yongxin Yang*, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales.
British Machine Vision Conferenc (BMVC), 2015. Best Scientific Paper