📝 RBFormer: Improve Adversarial Robustness of Transformer by Robust Bias 🔭

"We enhance the adversarial robustness by increasing the proportion of high-frequency structural robust biases, thus mitigating the susceptibility to robustness issues, and introduce a novel Robust Bias Transformer-based Structure (RBFormer) that shows robust superiority compared to several existing baseline structures." [gal30b+] 🤖 #CV

🔗 https://arxiv.org/abs/2309.13245v1 #arxiv

https://creative.ai/system/media_attachments/files/111/134/794/424/338/136/original/4c534a782ef2c8cf.jpg