📝 Keep It SimPool: Who Said Supervised Transformers Suffer From Attention Deficit? 🔭🧠

"Simpool replaces global average pooling by spatial similarity attention to improve performance and provide attention maps delineating object boundaries without explicit losses or modifying the architecture, whether supervised or self-supervised." [gal30b+] 🤖 #CV #LG

⚙️ https://github.com/billpsomas/simpool
🔗 https://arxiv.org/abs/2309.06891v1 #arxiv

https://creative.ai/system/media_attachments/files/111/067/186/512/645/317/original/7b0176085e27acac.jpg

https://creative.ai/system/media_attachments/files/111/067/186/567/794/569/original/bb1cf09340beaaa9.jpg