55 min listen
3: VICReg
FromArgmax
ratings:
Length:
45 minutes
Released:
Mar 21, 2022
Format:
Podcast episode
Description
Todays paper: VICReg (https://arxiv.org/abs/2105.04906)Summary of the paperVICReg prevents representation collapse using a mixture of variance, invariance and covariance when calculating the loss. It does not require negative samples and achieves great performance on downstream tasks.Highlights of discussionThe VICReg architecture (Figure 1)Sensitivity to hyperparameters (Table 7)Top 5 metric usefulness
Released:
Mar 21, 2022
Format:
Podcast episode
Titles in the series (16)
1: Reward is Enough by Argmax