Oddbean new post about | logout
 📝 ClusterFormer: Clustering as a Universal Visual Learner 🔭

"Introduces a new vision model, named ClusteRFormer, based on the CLUSTERing paradigm with TransFORMer, a new Transformer architecture that introduces recurrent cross-attention, a mechanism for updating cluster centers that facilitates strong representation learning." [gal30b+] 🤖 #CV

🔗 https://arxiv.org/abs/2309.13196v1 #arxiv

https://creative.ai/system/media_attachments/files/111/134/204/493/959/095/original/18ffc8f7011a9775.jpg

https://creative.ai/system/media_attachments/files/111/134/204/550/389/724/original/a158123c6c23d1fd.jpg