Discover this podcast and so much more

Podcasts are free to enjoy without a subscription. We also offer ebooks, audiobooks, and so much more for just $11.99/month.

3: VICReg

3: VICReg

FromArgmax


3: VICReg

FromArgmax

ratings:
Length:
45 minutes
Released:
Mar 21, 2022
Format:
Podcast episode

Description

Todays paper: VICReg (https://arxiv.org/abs/2105.04906)Summary of the paperVICReg prevents representation collapse using a mixture of variance, invariance and covariance when calculating the loss. It does not require negative samples and achieves great performance on downstream tasks.Highlights of discussionThe VICReg architecture (Figure 1)Sensitivity to hyperparameters (Table 7)Top 5 metric usefulness
Released:
Mar 21, 2022
Format:
Podcast episode