2022 article
REFINING SELF-SUPERVISED LEARNING IN IMAGING: BEYOND LINEAR METRIC
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, pp. 76–80.
author keywords: Self-Supervised learning; Contrastive Learning; Jaccard Index; Non-linearity
TL;DR:
A new statistical perspective is introduced, exploiting the Jaccard similarity metric, as a measure-based metric to effectively invoke non-linear features in the loss of self-supervised contrastive learning.
(via Semantic Scholar)
arxiv.org (repository)
UN Sustainable Development Goal Categories
3. Good Health and Well-being
(Web of Science)
Source: Web Of Science
Added: October 23, 2023
We introduce in this paper a new statistical perspective, exploiting the Jaccard similarity metric, as a measure-based metric to effectively invoke non-linear features in the loss of self-supervised contrastive learning. Specifically, our proposed metric may be interpreted as a dependence measure between two adapted projections learned from the so-called latent representations. This is in contrast to the cosine similarity measure in the conventional contrastive learning model, which accounts for correlation information. To the best of our knowledge, this effectively non-linearly fused information embedded in the Jaccard similarity, is novel to self-supervision learning with promising results. The proposed approach is compared to two state-of-the-art self-supervised contrastive learning methods on three image datasets. We not only demonstrate its amenable applicability in current ML problems, but also its improved performance and training efficiency.
