Learning What Not to Learn: Adversarial Disentangled Prompt Tuning for Robust Vision-Language Models
arXiv:2608.17306v1 Announce Type: new Abstract: While adversarial prompt tuning can enhance robustness of vision-language models efficiently, we find that existing methods aggravate robust generalization overfitting on seen classes, leading to a rapid degradation in performance against adversarial…