Estimation of effective temperatures in quantum annealers for sampling applications: A case study with possible applications in deep learning (original) (raw)
Abstract:An increase in the efficiency of sampling from Boltzmann distributions would have a significant impact on deep learning and other machine-learning applications. Recently, quantum annealers have been proposed as a potential candidate to speed up this task, but several limitations still bar these state-of-the-art technologies from being used effectively. One of the main limitations is that, while the device may indeed sample from a Boltzmann-like distribution, quantum dynamical arguments suggest it will do so with an {\it instance-dependent} effective temperature, different from its physical temperature. Unless this unknown temperature can be unveiled, it might not be possible to effectively use a quantum annealer for Boltzmann sampling. In this work, we propose a strategy to overcome this challenge with a simple effective-temperature estimation algorithm. We provide a systematic study assessing the impact of the effective temperatures in the learning of a special class of a restricted Boltzmann machine embedded on quantum hardware, which can serve as a building block for deep-learning architectures. We also provide a comparison to kkk-step contrastive divergence (CD-$k$) with kkk up to 100. Although assuming a suitable fixed effective temperature also allows us to outperform one step contrastive divergence (CD-1), only when using an instance-dependent effective temperature do we find a performance close to that of CD-100 for the case studied here.
Submission history
From: Alejandro Perdomo-Ortiz [view email]
[v1] Mon, 26 Oct 2015 19:46:34 UTC (944 KB)
[v2] Tue, 27 Oct 2015 19:14:21 UTC (944 KB)
[v3] Wed, 2 Mar 2016 08:54:39 UTC (716 KB)
[v4] Tue, 9 Aug 2016 14:59:34 UTC (965 KB)