Publications

Selected Publications

    (* indicates corresponding author. Full list: DBLP, Google Scholar)

2024

Federated learning for generalization, robustness, fairness: A survey and benchmark
Wenke Huang, Mang Ye*, Zekun Shi, Guancheng Wan, He Li, Bo Du, Qiang Yang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024
Paper Code
Prospective Representation Learning for Non-Exemplar Class-Incremental Learning
Wuxuan Shi, Mang Ye*
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2024.
Paper Code
Empowering Visible-Infrared Person Re-Identification with Foundation Models
Zhangyi Hu#, Bin Yang#, Mang Ye*
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2024.
Paper Code
Parameter Disparities Dissection for Backdoor Defense in Heterogeneous Federated Learning
Wenke Huang, Mang Ye*, Zekun Shi, Guancheng Wan, He Li*, Bo Du
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2024.
Paper Code
FedSSP: Federated Graph Learning with Spectral Knowledge and Personalized Preference
Zihan Tan#, Guancheng Wan#, Wenke Huang#, Mang Ye*
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2024.
Paper Code
All in One Framework for Multimodal Re-identification in the Wild
He Li, Mang Ye*, Ming Zhang, Bo Du
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Paper Code
FedAS: Bridging Inconsistency in Personalized Federated Learning
Xiyuan Yang, Wenke Huang, Mang Ye*
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Paper Code
Shallow-Deep Collaborative Learning for Unsupervised Visible-Infrared Person Re-Identification
Bin Yang, Jun Chen, Mang Ye*
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Paper Code
Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversity
Yuhang Chen#, Wenke Huang#, Mang Ye*
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Paper Code
Contextual Augmented Global Contrast for Multimodal Intent Recognition
Kaili Sun, Zhiwen Xie, Mang Ye*, Huyin Zhang
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
Paper Code
Self-Driven Entropy Aggregation for Byzantine-Robust Heterogeneous Federated Learning
Wenke Huang#, Zekun Shi#, Mang Ye*, He Li, Bo Du
International Conference on Machine Learning (ICML), 2024.
Paper Code
S3GCL: Spectral, Swift, Spatial Graph Contrastive Learning
Guancheng Wan, Yijun Tian, Wenke Huang, Nitesh V Chawla, Mang Ye*
International Conference on Machine Learning (ICML), 2024.
Paper Code
Synergy of Sight and Semantics: Visual Intention Understanding with CLIP
Qu Yang, Mang Ye*, Dacheng Tao
European Conference on Computer Vision (ECCV), 2024.
Paper Code
Adaptive High-Frequency Transformer for Diverse Wildlife Re-Identification
Chenyue Li#, Shuoyi Chen#, Mang Ye*
European Conference on Computer Vision (ECCV), 2024.
Paper Code
Fisher Calibration for Backdoor-Robust Heterogeneous Federated Learning
Wenke Huang, Mang Ye*, Zekun Shi, Bo Du, Dacheng Tao
European Conference on Computer Vision (ECCV), 2024.
Paper Code
TexFit: Text-Driven Fashion Image Editing with Diffusion Models
Tongxin Wang, Mang Ye*
Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2024.
Paper Code
Federated Graph Learning under Domain Shift with Generalizable Prototypes
Guancheng Wan, Wenke Huang, Mang Ye*
Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2024.
Paper Code
Negative Pre-aware for Noisy Cross-modal Matching
Xu Zhang, Hao Li, Mang Ye*
Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2024.
Paper Code
An Empirical Study of CLIP for Text-based Person Search
Min Cao, Yang Bai, Ziyin Zeng, Mang Ye*, Min Zhang
Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2024.
Paper Code
Cloth-Aware Augmentation for Cloth-Generalized Person Re-Identification
Fangyi Liu, Mang Ye*, Bo Du
ACM International Conference on Multimedia (ACM MM), 2024.
Paper Code
Resisting Over-Smoothing in Graph Neural Networks via Dual-Dimensional Decoupling
Wei Shen, Mang Ye*, Wenke Huang
ACM International Conference on Multimedia (ACM MM), 2024.
Paper Code
SecureReID: Privacy-Preserving Anonymization for Person Re-Identification
Mang Ye*, Wei Shen, Junwu Zhang, Yao Yang, Bo Du
IEEE Transactions on Information Forensics and Security (TIFS), 2024
Paper Code
EmoLLM: Multimodal Emotional Understanding Meets Large Language Models
Qu Yang, Mang Ye*, Bo Du
arXiv.
Paper Code
Transformer for Object Re-Identification: A Survey
Mang Ye*, Shuoyi Chen, Chenyue Li, Wei-Shi Zheng, David Crandall, Bo Du
arXiv.
Paper Code
Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey
Mang Ye*, Wei Shen, Bo Du, Eduard Snezhko, Vassili Kovalev, Pong C. Yuen
arXiv.
Paper Code

2023

Heterogeneous Federated Learning: State-of-the-art and Research Challenges
Mang Ye*, Xiuwen Fang, Bo Du, Pong C Yuen, Dachen Tao
ACM Computing Surveys, 2023.
Paper Code
SketchTrans: Disentangled Prototype Learning with Transformer for Sketch-Photo Recognition
Cuiqun Chen, Mang Ye*, Meibin Qi, Bo Du
IEEE Transactions on Pattern Analysis & Machine Intelligence, 2023.
Paper Code
Channel Augmentation for Visible-Infrared Re-Identification
Mang Ye*, Zesen Wu, Cuiqun Chen, Bo Du
IEEE Transactions on Pattern Analysis & Machine Intelligence, 2023.
Paper Code
Generalizable Heterogeneous Federated Cross-Correlation and Instance Similarity Learning
Wenke Huang, Mang Ye*, Zekun Shi, Bo Du
IEEE Transactions on Pattern Analysis & Machine Intelligence, 2023.
Paper Code
Dynamic Personalized Federated Learning with Adaptive Differential Privacy
Xiyuan Yang#, Wenke Huang#, Mang Ye*
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS), 2023.
Paper Code
Towards Grand Unified Representation Learning for Unsupervised Visible-Infrared Person Re-Identification
Bin Yang, Jun Chen*, Mang Ye*
International Conference on Computer Vision (ICCV), 2023.
Paper Code
Robust Heterogeneous Federated Learning under Data Corruption
Xiuwen Fang, Mang Ye*, Xiyuan Yang
International Conference on Computer Vision (ICCV), 2023.
Paper Code
Prototype Reminiscence and Augmented Asymmetric Knowledge Aggregation for Non-Exemplar Class-Incremental Learning
Wuxuan Shi, Mang Ye*
International Conference on Computer Vision (ICCV), 2023.
Paper Code
Cross-Modal Implicit Relation Reasoning and Aligning for Text-to-Image Person Retrieval
Ding Jiang, Mang Ye*
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Paper Code
Rethinking Federated Learning With Domain Shift: A Prototype View
Wenke Huang, Mang Ye*, Zekun Shi, He Li, Bo Du
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Paper Code
Towards Modality-Agnostic Person Re-identification with Descriptive Query
Cuiqun Chen, Mang Ye*, Ding Jiang
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Paper Code
Unsupervised Visible-Infrared Person Re-Identification via Progressive Graph Matching and Alternate Learning
Zesen Wu, Mang Ye*
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Paper Code
Federated Graph Semantic and Structural Learning
Wenke Huang#, Guancheng Wan#, Mang Ye*, Bo Du
International Joint Conference on Artificial Intelligence (IJCAI), 2023.
Paper Code
Cross-Modality Pyramid Alignment for Visual Intention Understanding
Mang Ye*, Qinghongya Shi, Kehua Su, Bo Du
IEEE Transactions on Image Processing (TIP), 2023.
Paper
Learnable Hierarchical Label Embedding and Grouping for Visual Intention Understanding
QingHongYa Shi, Mang Ye*, Ziyi Zhang, Bo Du
IEEE Transactions on Affective Computing (TAC), 2023.
Paper Code

2022

Robust Federated Learning With Noisy and Heterogeneous Clients
Xiuwen Fang, Mang Ye*
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Paper Code
Learn From Others and Be Yourself in Heterogeneous Federated Learning
Wenke Huang, Mang Ye*, Bo Du
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Paper Code
Rotation Invariant Transformer for Recognizing Object in UAVs
Shuoyi Chen, Mang Ye*, Bo Du
ACM International Conference on Multimedia (ACM MM), 2022.
Paper Code
Pyramidal Transformer with Conv-Patchify for Person Re-identification
He Li, Mang Ye*, Cong Wang, Bo Du
ACM International Conference on Multimedia (ACM MM), 2022.
Paper Code
Augmented Dual-Contrastive Aggregation Learning for Unsupervised Visible-Infrared Person Re-Identification
Bin Yang, Mang Ye*, Jun Chen, Zesen Wu
ACM International Conference on Multimedia (ACM MM), 2022.
Paper Code
Sketch Transformer: Asymmetrical Disentanglement Learning from Dynamic Synthesis
Cuiqun Chen, Mang Ye*, Meibin Qi, Bo Du
ACM International Conference on Multimedia (ACM MM), 2022.
Paper Code
Symmetric Uncertainty-Aware Feature Transmission for Depth Super-Resolution
Wuxuan Shi, Mang Ye*, Bo Du
ACM International Conference on Multimedia (ACM MM), 2022.
Paper Code
Few-Shot Model Agnostic Federated Learning
Wenke Huang, Mang Ye*, Bo Du, Xiang Gao
ACM International Conference on Multimedia (ACM MM), 2022.
Paper
Learnable Privacy-Preserving Anonymization for Pedestrian Images
Junwu Zhang, Mang Ye*, Yao Yang
ACM International Conference on Multimedia (ACM MM), 2022.
Paper Code
Complementary Data Augmentation for Cloth-Changing Person Re-Identification
Xuemei Jia, Xian Zhong, Mang Ye*, Wenxuan Liu, Wenxin Huang
IEEE Transactions on Image Processing (TIP), 2022.
Paper
Structure-Aware Positional Transformer for Visible-Infrared Person Re-Identification
Cuiqun Chen, Mang Ye*, Meibin Qi, Jingjing Wu, Jianguo Jiang, Chia-Wen Lin
IEEE Transactions on Image Processing (TIP), 2022.
Paper
Dynamic tri-level relation mining with attentive graph for visible infrared re-identification
Mang Ye, Cuiqun Chen, Jianbing Shen, Ling Shao
IEEE Transactions on Information Forensics and Security (TIFS), 2022.
Paper Code It is an extended version of our ECCV 2020 paper.
Learning From Synthetic CT Images via Test-Time Training for Liver Tumor Segmentation
Fei Lyu, Mang Ye, Andy J Ma, Terry Cheuk-Fung Yip, Grace Lai-Hung Wong, Pong C Yuen
IEEE Transactions on Medical Imaging (TMI), 2022.
Paper Code
Graph Complemented Latent Representation for Few-shot Image Classification
Xian Zhong, Cheng Gu, Mang Ye*, Wenxin Huang, Chia-Wen Lin
IEEE Transactions on Multimedia (TMM), 2022.
Paper
Saliency and Granularity: Discovering Temporal Coherence for Video-based Person Re-Identification
Cuiqun Chen, Mang Ye*, Meibin Qi, Jingjing Wu, Yimin Liu, Jianguo Jiang
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2022.
Paper

2021

Deep Learning for Person Re-identification: A Survey and Outlook
Mang Ye, Jianbing Shen, Gaojie Lin, Tao Xiang, Ling Shao, Steven C. H. Hoi.
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021.
Paper Code
Channel Augmented Joint Learning for Visible-Infrared Recognition
Mang Ye, Weijian Ruan, Bo Du, Mike Zheng Shou.
International Conference on Computer Vision (ICCV), 2021.
Paper Code
Cross-Modality Person Re-Identification via Modality Confusion and Center Aggregation
Xin Hao, Sanyuan Zhao, Mang Ye*, Jianbing Shen.
International Conference on Computer Vision (ICCV), 2021.
Paper Code
WePerson: Learning a Generalized Re-identification Model from All-weather Virtual Data
He Li, Mang Ye*, Bo Du.
ACM International Conference on Multimedia (ACM MM), 2021.
Paper Code
Imitative Learning for Multi-Person Action Forecasting
Yu-Ke Li, Pin Wang, Mang Ye, Ching-Yao Chan.
ACM International Conference on Multimedia (ACM MM), 2021.
Paper
Cooperative Joint Attentive Network for Patient Outcome Prediction on Irregular Multi-Rate Multivariate Health Data
Qingxiong Tan, Mang Ye*, Grace Lai-Hung Wong, Pong C. Yuen.
International Joint Conference on Artificial Intelligence (IJCAI), 2021.
Paper
Collaborative Refining for Person Re-Identification with Label Noise
Mang Ye, He Li, Bo Du, Jianbing Shen, Ling Shao, Steven C H Hoi.
IEEE Transactions on Image Processing (TIP), 2021.
Paper Code
Person Re-Identification by Context-aware Part Attention and Multi-Head Collaborative Learning
Dongming Wu, Mang Ye*, Gaojie Lin, Xin Gao, and Jianbing Shen.
IEEE Transactions on Information Forensics and Security (TIFS), 2021.
Paper Code
TICNet: A Target-Insight Correlation Network for Object Tracking
Weijian Ruan, Mang Ye*, Yi Wu, Jun Chen, Wu Liu, Chao Liang, Ge Li, Chia-Wen Lin.
IEEE Transactions on Cybernetics (TCYB), 2021.
Paper

2020

Augmentation Invariant and Instance Spreading Feature for Softmax Embedding
Mang Ye, Jianbing Shen, Xu Zhang, Pong C. Yuen, Shih-Fu Chang.
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020.
Paper Code It's an extended version of our CVPR 19 paper.
Probabilistic Structural Latent Representation for Unsupervised Embedding
Mang Ye, Jianbing Shen.
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
Paper Code
Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification
Mang Ye, Jianbing Shen, David J. Crandall, Ling Shao, Jiebo Luo
European Conference on Computer Vision (ECCV), 2020.
Paper Code
PurifyNet: A Robust Person Re-identification Model with Noisy Labels
Mang Ye, Pong C. Yuen.
IEEE Transactions on Information Forensics and Security(TIFS), 2020.
Paper Code
Cross-Modality Person Re-Identification via Modality-aware Collaborative Ensemble Learning
Mang Ye, Xiangyuan Lan, Qingming Leng, Jianbing Shen.
IEEE Transactions on Image Processing (TIP), 2020.
Paper Code It's an extended version of our ACM MM 19 paper.
Visible-Infrared Person Re-Identification via Homogeneous Augmented Tri-Modal Learning
Mang Ye, Jianbing Shen, Ling Shao.
IEEE Transactions on Information Forensics and Security(TIFS), 2020.
Paper Code
DATA-GRU: Dual-Attention Time-Aware Gated Recurrent Unit for Irregular Multivariate Time Series
Qingxiong Tan, Mang Ye, Baoyao Yang, Siqi Liu, Andy Jinhua Ma, Terry Cheuk-Fung Yip, Grace Lai-Hung Wong, Pong C. Yuen.
AAAI Conference on Artificial Intelligence(AAAI), 2020.
Paper
Explainable Uncertainty-Aware Convolutional Recurrent Neural Network for Irregular Medical Time Series
Qingxiong Tan, Mang Ye, Andy Jinhua Ma, Baoyao Yang, Terry Cheuk-Fung Yip, Grace Lai-Hung Wong, Pong C. Yuen.
IEEE Transactions on Neural Networks and Learning Systems(TNNLS), 2020.
Paper
Cross-domain Missingness-aware Time Series Adaptation with Similarity Distillation in Medical Applications
Baoyao Yang,Mang Ye, Qingxiong Tan, Pong C. Yuen.
IEEE Transactions on Cybernetics(TCYB), 2020.
Paper
Modality-correlation-aware Sparse Representation for RGB-infrared Object Tracking
Xiangyuan Lan, Mang Ye*, Shengping Zhang, Huiyu Zhou, Pong C Yuen.
Pattern Recognition Letters (PRL), 2020. ESI highly cited paper.
Paper

2019

Unsupervised Embedding Learning via Invariant and Spreading Instance Feature
Mang Ye, Xu Zhang, Pong C. Yuen, Shih-Fu Chang.
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Paper Code Received more than 200 citations.
Dynamic Graph Co-Matching for Unsupervised Video-based Person Re-Identification
Mang Ye, Jiawei Li, Andy J Ma, Liang Zheng, Pong C. Yuen.
IEEE Transactions on Image Processing (TIP), 2019.  ESI highly cited paper.
Paper Code It is an extended version of our ICCV 2017 paper.
Bi-directional Center-Constrained Top-Ranking for Visible Thermal Person Re-Identification
Mang Ye, Xiangyuan Lan, Zheng Wang, Pong C. Yuen.
IEEE Transactions on Information Forensics and Security (TIFS), 2019.  ESI highly cited paper.
Paper Code It is an extended version of our IJCAI 2018 paper.
A Survey of Open-World Person Re-identification
Qingming Leng*, Mang Ye*, Qi Tian.
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2019.
Paper
Improving Night-Time Pedestrian Retrieval with Distribution Alignment and Contextual Distance
Mang Ye, Yi Cheng, Xiangyuan Lan, Hongyuan Zhu.
IEEE Transactions on Industrial Informatics (TII), 2019.  ESI highly cited paper.
Paper Code
Modality-aware Collaborative Learning for Visible Thermal Person Re-Identification
Mang Ye, Xiangyuan Lan, Qingming Leng.
ACM International Conference on Multimedia (MM), 2019.
Paper
Variation Generalized Feature Learning via Intra-view Variation Adaptation
Jiawei Li, Mang Ye, Andy J. Ma, Pong C. Yuen.
International Joint Conference on Artificial Intelligence (IJCAI), 2019.
Paper
Learning Modality-consistency Feature Templates: A Robust RGB-infrared Tracking System
Xiangyuan Lan, Mang Ye, Rui Shao, Bineng Zhong, Pong C Yuen, Huiyu Zhou.
IEEE Transactions on Industrial Electronics (TIE), 2019.  ESI highly cited paper.
Paper

2018

Robust Anchor Embedding for Unsupervised Video Person Re-Identification in the Wild
Mang Ye, Xiangyuan Lan, Pong C. Yuen.
European Conference on Computer Vision (ECCV), 2018.
Paper Code
Visible Thermal Person Re-Identification via Dual-Constrained Top-Ranking
Mang Ye, Zheng Wang, Xiangyuan Lan, Pong C. Yuen.
International Joint Conference on Artificial Intelligence (IJCAI), 2018.
Paper Code
Cascaded SR-GAN for Scale-Adaptive Low Resolution Person Re-identification
Zheng Wang, Mang Ye, Fan Yang, Xiang Bai, Shin'ichi Satoh.
27th International Joint Conference on Artificial Intelligence (IJCAI), 2018.
Paper Code
Hierarchical Discriminative Learning for Visible Thermal Person Re-Identification
Mang Ye, Xiangyuan Lan, Jiawei Li, Pong C. Yuen.
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI), 2018.
Paper Code
Robust Collaborative Discriminative Learning for RGB-Infrared Tracking
Xiangyuan Lan, Mang Ye, Shengping Zhang, Pong C. Yuen.
Thirty-Second AAAI Conference on Artificial Intelligence (AAAI), 2018.
Paper

2017

Dynamic Label Graph Matching for Unsupervised Video Re-Identification
Mang Ye, Andy J Ma, Liang Zheng, Jiawei Li, Pong C. Yuen.
IEEE International Conference on Computer Vision (ICCV), 2017.
Paper Code

2016 and before

Person Re-identification via Ranking Aggregation of Similarity Pulling and Dissimilarity Pushing
Mang Ye, Chao Liang, Yi Yu , Zheng Wang, Qingming Leng, Chunxia Xiao , Jun Chen, Ruimin Hu.
IEEE Transactions on Multimedia (TMM), 2016.
Paper Video Code
Ranking Optimization for Person Re-identification via Similarity and Dissimilarity
Mang Ye, Chao Liang, Zheng Wang, Qingming Leng, Jun Chen.
ACM International Conference on Multimedia (MM), 2015.
Paper
Specific Person Retrieval via Incomplete Text Description
Mang Ye, Chao Liang, Zheng Wang, Qingming Leng, Jun Chen, Jun Liu.
International Conference on Multimedia Retrieval (ICMR), 2015.
Paper
Coupled-view Based Ranking Optimization for Person Re-identification
Mang Ye, Jun Chen, Qingming Leng, Chao Liang, Zheng Wang and Kaimin Sun.
International Conference on Multimedia Modelling (MMM), 2015. Oral.
Paper