Accelerating Large-Scale Inference with Anisotropic Vector Quantization (original) (raw)

View PDF

Abstract:Quantization based techniques are the current state-of-the-art for scaling maximum inner product search to massive databases. Traditional approaches to quantization aim to minimize the reconstruction error of the database points. Based on the observation that for a given query, the database points that have the largest inner products are more relevant, we develop a family of anisotropic quantization loss functions. Under natural statistical assumptions, we show that quantization with these loss functions leads to a new variant of vector quantization that more greatly penalizes the parallel component of a datapoint's residual relative to its orthogonal component. The proposed approach achieves state-of-the-art results on the public benchmarks available at \url{this http URL}.

Submission history

From: Ruiqi Guo [view email]
[v1] Tue, 27 Aug 2019 18:27:17 UTC (881 KB)
[v2] Wed, 11 Sep 2019 20:41:46 UTC (879 KB)
[v3] Tue, 12 May 2020 20:17:08 UTC (823 KB)
[v4] Fri, 17 Jul 2020 22:24:16 UTC (942 KB)
[v5] Fri, 4 Dec 2020 21:29:31 UTC (706 KB)