Consistent prototype contrastive learning for weakly supervised person search

No Thumbnail Available
File version
Author(s)
Lin, Huadong
Yu, Xiaohan
Zhang, Pengcheng
Bai, Xiao
Zheng, Jin
Griffith University Author(s)
Primary Supervisor
Other Supervisors
Editor(s)
Date
2024
Size
File type(s)
Location
License
Abstract

Weakly supervised person search simultaneously addresses detection and re-identification tasks without relying on person identity labels. Prototype-based contrastive learning is commonly used to address unsupervised person re-identification. We argue that prototypes suffer from spatial, temporal, and label inconsistencies, which result in their inaccurate representation. In this paper, we propose a novel Consistent Prototype Contrastive Learning (CPCL) framework to address prototype inconsistency. For spatial inconsistency, a greedy update strategy is developed to introduce ground truth proposals in the training process and update the memory bank only with the ground truth features. To improve temporal consistency, CPCL employs a local window strategy to calculate the prototype within a specific temporal domain window. To tackle label inconsistency, CPCL adopts a prototype nearest neighbor consistency method that leverages the intrinsic information of the prototypes to rectify the pseudo-labels. Experimentally, the proposed method exhibits remarkable performance improvements on both the CUHK-SYSU and PRW datasets, achieving an mAP of 90.2% and 29.3% respectively. Moreover, it achieves state-of-the-art performance on the CUHK-SYSU dataset. The code will be available on the project website: https://github.com/JackFlying/cpcl.

Journal Title

Journal of Visual Communication and Image Representation

Conference Title
Book Title
Edition
Volume

105

Issue
Thesis Type
Degree Program
School
Publisher link
Patent number
Funder(s)
Grant identifier(s)
Rights Statement
Rights Statement
Item Access Status
Note
Access the data
Related item(s)
Subject

Visual arts

Computer vision and multimedia computation

Graphics, augmented reality and games

Persistent link to this record
Citation

Lin, H; Yu, X; Zhang, P; Bai, X; Zheng, J, Consistent prototype contrastive learning for weakly supervised person search, Journal of Visual Communication and Image Representation, 2024, 105, pp. 104321

Collections