Multi-Prompt Alignment for Multi-Source Unsupervised Domain Adaptation (original) (raw)
Abstract:Most existing methods for unsupervised domain adaptation (UDA) rely on a shared network to extract domain-invariant features. However, when facing multiple source domains, optimizing such a network involves updating the parameters of the entire network, making it both computationally expensive and challenging, particularly when coupled with min-max objectives. Inspired by recent advances in prompt learning that adapts high-capacity models for downstream tasks in a computationally economic way, we introduce Multi-Prompt Alignment (MPA), a simple yet efficient framework for multi-source UDA. Given a source and target domain pair, MPA first trains an individual prompt to minimize the domain gap through a contrastive loss. Then, MPA denoises the learned prompts through an auto-encoding process and aligns them by maximizing the agreement of all the reconstructed prompts. Moreover, we show that the resulting subspace acquired from the auto-encoding process can easily generalize to a streamlined set of target domains, making our method more efficient for practical usage. Extensive experiments show that MPA achieves state-of-the-art results on three popular datasets with an impressive average accuracy of 54.1% on DomainNet.
Submission history
From: Haoran Chen [view email]
[v1] Fri, 30 Sep 2022 03:40:10 UTC (1,282 KB)
[v2] Fri, 27 Jan 2023 04:56:47 UTC (1,065 KB)
[v3] Wed, 17 May 2023 17:27:45 UTC (992 KB)
[v4] Sun, 29 Oct 2023 13:47:13 UTC (993 KB)
[v5] Thu, 30 May 2024 17:51:36 UTC (993 KB)