Spatially-consistent Feature Matching and Learning for Heritage Image Analysis - École nationale des chartes Accéder directement au contenu
Article Dans Une Revue International Journal of Computer Vision Année : 2022

Spatially-consistent Feature Matching and Learning for Heritage Image Analysis

Xi Shen
  • Fonction : Auteur
  • PersonId : 173126
  • IdHAL : xi-shen
Spyros Gidaris
  • Fonction : Auteur
K Bender
  • Fonction : Auteur
Mathieu Aubry
Marc H. Smith
  • Fonction : Auteur
  • PersonId : 917541

Résumé

Progress in the digitization of cultural assets leads to online databases that become too large for a human to analyze. Moreover, some analyses might be challenging, even for experts. In this paper, we explore two applications of computer vision to analyze historical data: watermark recognition and one-shot repeated pattern detection in artwork collections. Both problems present computer vision challenges which we believe to be representative of the ones encountered in cultural heritage applications: limited supervision is available, the tasks are fine-grained recognition, and the data comes in several different modalities. Both applications are also highly practical, as recognizing watermarks makes it possible to date and locate documents, while detecting repeated patterns allows exploring visual links between artworks. We demonstrate on both tasks the benefits of relying on deep mid-level features. More precisely, we define an image similarity score based on geometric verification of mid-level features and show how spatial consistency can be used to fine-tune out-of-the-box features for the target dataset with weak or no supervision. This paper relates and extends our previous works. Our code and data are available at \url{http://imagine.enpc.fr/~shenx/HisImgAnalysis/}.
Fichier principal
Vignette du fichier
IJCV_HisImgAnalysis.pdf (12.18 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03620996 , version 1 (27-03-2022)
hal-03620996 , version 2 (30-03-2022)

Identifiants

Citer

Xi Shen, Robin Champenois, Shiry Ginosar, Ilaria Pastrolin, Morgane Rousselot, et al.. Spatially-consistent Feature Matching and Learning for Heritage Image Analysis. International Journal of Computer Vision, 2022, ⟨10.1007/s11263-022-01576-x⟩. ⟨hal-03620996v2⟩
229 Consultations
91 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More