News

---

• [2024.03] Three papers were accepted by ICME 2024.
• [2024.02] One paper on novel class discovery accepted was by CVPR 2024 (Poster Highlight).
• [2023.12] Four papers were accepted by ICASSP 2024.
• [2023.07] Two papers (on Image Stitching and VQA) were accepted by ACM Multimedia 2023.
• [2023.01] Co-organize a special issue on "Open-domain Image Retrieval in the Wild" at IJMIR.
• [2022.11] One paper on VQA was accepted by AAAI 2023.
• [2022.11] One survey paper on instance image retrieval was accepted by IEEE TPAMI.
• [Paper] One paper on novel category discovery was accepted by IEEE TNNLS.
• [Paper] One paper on domain-incremental learning accepted was by ACM Multimedia 2022.
• [Service] Co-organize Open-world Machine Learning Workshop in VALSE 2022.
• [Paper] One paper on camouflaged object detection accepted was by CVPR 2022.
• [Service] Honored to be an Outstanding Reviewer of ICCV 2021.
• [Service] Co-organized the Challenge at the 2nd Continual Learning in Computer Vision Workshop in CVPR 2021. [Link]
• [Service] Co-organized Commands For Autonomous Vehicles Workshop in ECCV 2020.
• [Service] Co-organized Efficient Deep Learning in Computer Vision Workshop in CVPR 2020.
• [Service] Co-organized the 4th CEFRL workshop in ICCV 2019.

Research Interests

---

• Zero-/Few-shot Learning, Continual Learning, Multimedia Retrieval, Object Detection/Segmentation

Education & Employment

---

• Jan. 2021 - Now, Associate Professor
  International School of Information Science and Engineering, Dalian University of Technology, China
  

• Jan. 2019 - Dec. 2020, Postdoc Researcher
  Department of Electrical Engineering (ESAT), KU Leuven, Belgium
  Advisor: Prof. dr. Tinne Tuytelaars

• Sep. 2014 - Oct. 2018, PhD Degree
  PhD Thesis: Exploring Images with Deep Learning for Classification, Retrieval and Synthesis [Link]
  Computer Science Department (LIACS), Leiden University, Netherlands
  Advisor: Prof. dr. Michael S. Lew

• Sep. 2011 - Jul. 2014, Master Degree
  School of Software, Dalian University of Technology, China
  Advisor: Prof. He Guo

• Sep. 2007 - Jul. 2011, Bachelor Degree
  School of Software, Dalian University of Technology, China
  Advisor: Dr. Qi Jia

Publications     [Google Scholar]

---

[2024]  [2023]  [2022]  [2021]  [2020]  [2019]  [2018]  [2017]  [2016]  [2015 and before] 

2024

• Novel Class Discovery for Ultra-Fine-Grained Visual Categorization
  Yu Liu, Yaqi Cai, Qi Jia*, Binglin Qiu, Weimin Wang, Nan Pu
  IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024. Poster Highlight

• CSCNet: Class-specified Cascaded Network for Compositional Zero-shot Learning
  Yanyi Zhang, Qi Jia, Xin Fan, Yu Liu*, Ran He*
  IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024.

• Depth-guided Dominant Plane Perception for Unsupervised Homography Estimation
  Xiaomei Feng, Qi Jia*, Yu Liu*, Xin Fan, Longin Jan Latecki
  IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024.

• Sketch-based 3D Shape Retrieval with Multi-view Fusion Transformer
  Cunjuan Zhu, Dongdong Cui, Qi Jia*, Weimin Wang, Yu Liu*, Michael S. Lew
  IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024.

• Attribution-based Scanline Perturbation Attack on 3D Detectors of LiDAR Point Clouds
  Ziyang Yu, Ting Yang, Qiong Chang, Yu Liu, Weimin Wang
  IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024.

2023

• Edge-aware Correlation Learning for Unsupervised Progressive Homography Estimation
  Xiaomei Feng, Qi Jia, Zikun Zhao, Yu Liu*, Xinwei Xue, Xin Fan
  IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), (Early Access).

• Residual Tuning: Towards Novel Category Discovery without Labels
  Yu Liu, Tinne Tuytelaars
  IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 34(10):7271-7285, 2023.

• Broaden Your Positives: A General Rectification Approach for Novel Class Discovery
  Yaqi Cai, Nan Pu, Qi Jia, Weimin Wang, Yu Liu*
  Chinese Conference on Pattern Recognition and Computer Vision (PRCV), 2023.

• Snow Removal for LiDAR Point Clouds with Spatio-temporal Conditional Random Fields
  Weimin Wang, Ting Yang, Yu Du, Yu Liu*
  IEEE Robotics and Automation Letters (RA-L), 2023.

• Learning Pixel-wise Alignment for Unsupervised Image Stitching
  Qi Jia, Xiaomei Feng, Yu Liu*, Xin Fan, Longin Jan Latecki
  ACM International Conference on Multimedia (MM), 2023.

• Multi-Domain Lifelong Visual Question Answering via Self-Critical Distillation
  Mingrui Lao, Nan Pu, Yu Liu, Zhun Zhong, Erwin M. Bakker, Nicu Sebe, Michael S Lew
  ACM International Conference on Multimedia (MM), 2023.

• Deep Learning for Video-Text Retrieval: a Review
  Cunjuan Zhu, Qi Jia, Wei Chen, Yanming Guo, Yu Liu*
  International Journal of Multimedia Information Retrieval (IJMIR), 2023.

• Deep Learning for Instance Retrieval: A Survey
  Wei Chen, Yu Liu, Weiping Wang, Erwin M. Bakker, Theodoros Georgiou, Paul Fieguth, Li Liu, and Michael S. Lew
  IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023.

• COCA: COllaborative CAusal Regularization for Audio-Visual Question Answering
  Mingrui Lao, Nan Pu, Yu Liu, Kai He, Erwin M. Bakker, Michael S. Lew
  AAAI Conference on Artificial Intelligence (AAAI), 2023.

2022

• Lifelong Fine-grained Image Retrieval
  Wei Chen, Haoyang Xu, Nan Pu, Yu Liu, Mingrui Lao, Weiping Wang, Li Liu, and Michael S. Lew
  IEEE Transactions on Multimedia (TMM), 2022.

• Feature Estimations based Correlation Distillation for Incremental Image Retrieval
  Wei Chen, Yu Liu, Nan Pu, Weiping Wang, Li Liu, Michael S. Lew
  IEEE Transactions on Multimedia (TMM), 2022.

• Meta Reconciliation Normalization for Lifelong Person Re-Identification
  Nan Pu, Yu Liu, Wei Chen, Erwin M. Bakker, Michael S. Lew
  ACM International Conference on Multimedia (MM), 2022.

• Segment, Magnify and Reiterate: Detecting Camouflaged Objects the Hard Way
  Qi Jia, Shuilian Yao, Yu Liu*, Xin Fan, Risheng Liu, Zhongxuan Luo (* Corresponding author)
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.

2021

• Integrating Information Theory and Adversarial Learning for Cross-modal Retrieval
  Wei Chen, Yu Liu, Erwin M. Bakker, Michael S. Lew
  Pattern Recognition (PR), 2021.

• Multi-Stage Hybrid Embedding Fusion Network for Visual Question Answering
  Mingrui Lao, Yanming Guo, Nan Pu, Wei Chen, Yu Liu, Michael S. Lew
  Neurocomputing, 423:541-550, 2021.

• From Superficial to Deep: Language Bias driven Curriculum Learning for Visual Question Answering
  Mingrui Lao, Yanming Guo, Yu Liu, Wei Chen, Nan Pu, Michael S. Lew
  ACM International Conference on Multimedia (MM), 2021.

• Underwater Species Detection using Channel Sharpening Attention
  Lihao Jiang, Yi Wang, Qi Jia, Shengwei Xu, Yu Liu, Xin Fan, Haojie Li, Risheng Liu, Xinwei Xue, Ruili Wang
  ACM International Conference on Multimedia (MM), 2021.

• Lifelong Person Re-Identification via Adaptive Knowledge Accumulation
  Nan Pu, Wei Chen, Yu Liu*, Erwin M. Bakker, Michael S. Lew (* Corresponding author)
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.

• A Language Prior Based Focal Loss for Visual Question Answering
  Mingrui Lao, Yanming Guo, Yu Liu, Michael S. Lew
  IEEE International Conference on Multimedia and Expo (ICME), 2021.

2020

• A Deep Multi-modal Explanation Model for Zero-shot Learning
  Yu Liu, Tinne Tuytelaars
  IEEE Transactions on Image Processing (TIP), 2020. [Code]

• A survey of traditional and deep learning-based feature descriptors for high dimensional data in computer vision
  Theodoros Georgiou, Yu Liu, Wei Chen, Michael Lew
  International Journal of Multimedia Information Retrieval (IJMIR), 2020.

• More Classifiers, Less Forgetting: A Generic Multi-classifier Paradigm for Incremental Learning
  Yu Liu, Sarah Parisot, Gregory Slabaugh, Xu Jia, Ales Leonardis, Tinne Tuytelaars
  European Conference on Computer Vision (ECCV), 2020. [PDF] [Code]

• A Novel Baseline for Zero-shot Learning via Adversarial Visual-Semantic Embedding
  Yu Liu, Tinne Tuytelaars
  British Machine Vision Conference (BMVC), 2020. [Code]

• On the Exploration of Incremental Learning for Fine-grained Image Retrieval
  Wei Chen, Yu Liu, Weiping Wang, Tinne Tuytelaars, Erwin M. Bakker, Michael S. Lew
  British Machine Vision Conference (BMVC), 2020.

• Dual Gaussian-based Variational Subspace Disentanglement for Visible-Infrared Person Re-Identification
  Nan Pu, Wei Chen, Yu Liu, Erwin M. Bakker, Michael S. Lew
  ACM International Conference on Multimedia (MM), 2020.

2019

• SwapGAN: A Multistage Generative Approach for Person-to-Person Fashion Style Transfer
  Yu Liu, Wei Chen, Li Liu, Michael S. Lew
  IEEE Transactions on Multimedia (TMM), 2019.

• CycleMatch: A Cycle-consistent Embedding Network for Image-Text Matching
  Yu Liu, Yanming Guo, Li Liu, Erwin M. Bakker, Michael S. Lew
  Pattern Recognition (PR), 2019.

• Domain Uncertainty Based on Information Theory for Cross-modal Hash Retrieval
  Wei Chen, Nan Pu, Yu Liu, Erwin M. Bakker, Michael S. Lew
  IEEE International Conference on Multimedia and Expo (ICME), 2019.

• Ensemble of Convolutional Neural Networks for P300 Speller in Brain Computer Interface
  Hongchang Shan, Yu Liu, Todor Stefanov
  International Conference on Artificial Neural Networks (ICANN), 2019.

• An Empirical Study on Sensor-aware Design of Convolutional Neural Networks for P300 Speller in Brain Computer Interface
  Hongchang Shan, Yu Liu, Todor Stefanov
  IEEE International Conference on Human System Interaction (HSI), 2019.

2018

• Learning visual and textual representations for multimodal matching and classification
  Yu Liu, Li Liu, Yanming Guo, Michael S. Lew
  Pattern Recognition (PR), 2018.

• Fusion that Matters: Convolutional Fusion Networks for Visual Recognition
  Yu Liu, Yanming Guo, Theodoros Georgiou, Michael S. Lew
  Multimedia Tools and Applications, 2018.

• Bag of Surrogate Parts Feature for Visual Recognition
  Yanming Guo, Yu Liu, Songyang Lao, Erwin M Bakker, Liang Bai, Michael S. Lew
  IEEE Transactions on Multimedia (TMM), 2018.

• CNN-RNN: a large-scale hierarchical image classification framework
  Yanming Guo, Yu Liu, Erwin M. Bakker, Yuanhao Guo, Michael S. Lew
  Multimedia Tools and Applications, 2018.

• A review of semantic segmentation using deep neural networks
  Yanming Guo, Yu Liu, Theodoros Georgiou, Michael S. Lew
  International Journal of Multimedia Information Retrieval (ESI highly cited), 2018.

• An Extensive Study of Cycle-Consistent Generative Networks for Image-to-Image Translation
  Yu Liu, Yanming Guo, Wei Chen, Michael S. Lew
  International Conference on Pattern Recognition (ICPR), 2018.

• A Simple Convolutional Neural Network for Accurate P300 Detection and Character Spelling in Brain Computer Interface
  Hongchang Shan, Yu Liu, Todor Stefanov
  International Joint Conference on Artificial Intelligence (IJCAI), 2018.

• A Dual Prediction Network for Image Captioning
  Yanming Guo, Yu Liu, Maaike H.T. de Boer, Li Liu, Michael S. Lew
  IEEE International Conference on Multimedia and Expo (ICME), 2018.

• Learning Fluid Flows
  Theodoros Georgiou, Sebastian Schmitt, Markus Olhofer, Yu Liu, Thomas Back, Michael S. Lew
  International Joint Conference on Neural Networks (IJCNN), 2018.

2017

• Learning a Recurrent Residual Fusion Network for Multimodal Matching
  Yu Liu, Yanming Guo, Erwin M. Bakker, Michael S. Lew
  IEEE International Conference on Computer Vision (ICCV), 2017. [Code]

• Improving the Discrimination between Foreground and Background for Semantic Segmentation
  Yu Liu, Michael S. Lew
  IEEE International Conference on Image Processing (ICIP), 2017. [Code]

• On the Exploration of Convolutional Fusion Networks for Visual Recognition
  Yu Liu, Yanming Guo, Michael S. Lew
  International Conference on MultiMedia Modeling (MMM, Best Paper Award), 2017. [Code] [Demo]

• What Convnets Make for Image Captioning
  Yu Liu*, Yanming Guo*, Michael S. Lew (* denotes equal contribution)
  International Conference on MultiMedia Modeling (MMM), 2017.

2016

• Hierarchical projective invariant contexts for shape recognition
  Qi Jia, Xin Fan, Yu Liu, Haojie Li, Zhongxuan Luo, He Guo
  Pattern Recognition (PR), 2016. [Code]

• Deep learning for visual understanding: A review
  Yanming Guo, Yu Liu, Ard Oerlemans, Songyang Lao, Song Wu, Michael S. Lew
  Neurocomputing (ESI highly cited), 2016.

• Learning Relaxed Deep Supervision for Better Edge Detection
  Yu Liu, Michael S. Lew
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. [Code]

2015 and before

• DeepIndex for Accurate and Efficient Image Retrieval
  Yu Liu, Yanming Guo, Song Wu, Michael S. Lew
  ACM International Conference on Multimedia Retrieval (ICMR), 2015. [Code]

• Convolutional Neural Networks Features: Principal Pyramidal Convolution
  Yanming Guo, Songyang Lao, Yu Liu, Liang Bai, Shi Liu, Michael S. Lew
  Pacific-Rim Conference on Multimedia (PCM), 2015.

• A New Geometric Descriptor for Symbols with Affine Deformations
  Qi Jia, Xin Fan, Zhongxuan Luo, Yu Liu, He Guo
  Pattern Recognition Letters (PRL), 2014.

• A Shape Matching Framework Using Metric Partition Constraint
  Yu Liu, Qi Jia, He Guo, Xin Fan
  IEEE International Conference on Image Processing (ICIP), 2013.

Acdademic Services

---

Editorial Board of International Journal of Multimedia Information Retrieval

Workshop/Challenge co-organizer

• [CVPR 2021] 2nd Continual Learning in Computer Vision Workshop.
• [ECCV 2020] Commands For Autonomous Vehicles Workshop.
• [CVPR 2020] Efficient Deep Learning in Computer Vision Workshop.
• [ICCV 2019] Compact and Efficient Feature Representation and Learning in Computer Vision Workshop.

Reviewer

• IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018, 2020, 2021, 2022, 2023, 2024
• IEEE International Conference on Computer Vision (ICCV) 2019, 2021, 2023
• European Conference on Computer Vision (ECCV) 2020, 2022, 2024
• ACM Conference on Multimedia (MM) 2019, 2020, 2021, 2022, 2023, 2024
• AAAI Conference on Artificial Intelligence (AAAI) 2020, 2021, 2022, 2023, 2024
• International Conference on Machine Learning (ICML) 2024
• Annual Conference on Neural Information Processing Systems (NeurIPS) 2023
• International Conference on Learning Representation (ICLR) 2023
• Asian Conference on Computer Vision (ACCV) 2018, 2020
• British Machine Vision Conference (BMVC) 2020, 2021
• Winter Conference on Applications of Computer Vision (WACV) 2021
• European Chapter of the ACL (EACL) 2021
• IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)
• IEEE Transactions on Image Processing (TIP)
• IEEE Transactions on Neural Networks and Learning Systems (TNNLS)
• IEEE Transactions on Multimedia (TMM)
• IEEE Transactions on Circuits and Systems for Video Technology (TCSVT)
• International Journal of Multimedia Information Retrieval (IJMIR), etc.

Awards

---

• Outstanding Reviewer of ICCV 2021.
• NVIDIA GPU Grant, 2019.
• Best Paper Award, MMM 2017.
• Most cited deep learning research paper in the journal, Neurocomputing. [Link]
• Student Travel Scholarship, ICMR 2015.