Data-Efficient Large Scale Place Recognition With Graded Similarity Supervision

DOI

Visual place recognition (VPR) is a fundamental task of computer vision for visual localization. Existing methods are trained using image pairs that either depict the same place or not. Such a binary indication does not consider continuous relations of similarity between images of the same place taken from different positions, determined by the continuous nature of camera pose. The binary similarity induces a noisy supervision signal into the training of VPR methods, which stall in local minima and require expensive hard mining algorithms to guarantee convergence. Motivated by the fact that two images of the same place only partially share visual cues due to camera pose differences, we deploy an automatic re-annotation strategy to re-label VPR datasets. We compute graded similarity labels for image pairs based on available localization metadata. Furthermore, we propose a new Generalized Contrastive Loss (GCL) that uses graded similarity labels for training contrastive networks. We demonstrate that the use of the new labels and GCL allow to dispense from hard-pair mining, and to train image descriptors that perform better in VPR by nearest neighbor search, obtaining superior or comparable results than methods that require expensive hard-pair mining and re-ranking techniques.

Identifier
DOI https://doi.org/10.34894/W4LIGP
Metadata Access https://dataverse.nl/oai?verb=GetRecord&metadataPrefix=oai_datacite&identifier=doi:10.34894/W4LIGP
Provenance
Creator Leyva-Vallina, Maria ORCID logo; Strisciuglio, Nicola ORCID logo; Petkov, Nicolai ORCID logo
Publisher DataverseNL
Contributor Nicola Strisciuglio
Publication Year 2022
Rights CC0-1.0; info:eu-repo/semantics/openAccess; http://creativecommons.org/publicdomain/zero/1.0
OpenAccess true
Contact Nicola Strisciuglio (University of Twente)
Representation
Resource Type Dataset
Format application/zip; text/plain; charset=US-ASCII; text/markdown
Size 204060023; 5092116334; 168079946; 37; 5096; 83120600
Version 3.0
Discipline Other