Oddbean new post about | logout
 📝 Understanding Masked Autoencoders From a Local Contrastive Perspective 🔭

"Explores a new perspective to explain what truly contributes to the "rich hidden representations inside the MAE" and reformulate the reconstruction based MAE into a local-contrastive version." [gal30b+] 🤖 #CV

🔗 https://arxiv.org/abs/2310.01994v1 #arxiv

https://creative.ai/system/media_attachments/files/111/183/687/327/880/081/original/d83da1624e852b32.jpg

https://creative.ai/system/media_attachments/files/111/183/687/385/427/934/original/05f83c3be3d4b93b.jpg

https://creative.ai/system/media_attachments/files/111/183/687/436/681/313/original/7a9911234b981a23.jpg

https://creative.ai/system/media_attachments/files/111/183/687/490/953/173/original/d794a5262111dd00.jpg