Local image descriptors with statistical losses

We present a novel regularization technique for learning local feature descriptors based on statistical information extracted from batches of training samples. With the proposed regularization term, we learn a descriptor distribution in Euclidean space that aims at minimizing the overlap between the distributions of positive pairs and that of negative pairs. The proposed method is able to improve the performance of pairwise and triplet losses with various deep convolution network architectures. This improvement is demonstrated through two different types of architectures, able to obtain state-of-the-art results on the reference benchmark for local feature matching.