Graduate School and Research Center in Digital Sciences

SAVED - Space alternating variational estimation for sparse Bayesian learning with parametric dictionaries

Kurisummoottil, Thomas Christo; Slock, Dirk TM

ASILOMAR 2018, 52nd Asilomar Conference on Signals, Systems and Computers, 28-31 October 2018, Pacific Grove, USA

In this paper, we address the fundamental problem of sparse signal recovery in a Bayesian framework, where the received signal is a multi-dimensional tensor. We further consider the problem of dictionary learning, where the tensor observations are assumed to be generated from a Khatri-Rao structured dictionary matrix multiplied by the sparse coefficients. We consider a Bayesian approach using variational Bayesian (VB) inference. VB allows one to obtain analytical approximations to the posterior distributions of interest even when an exact inference of these distributions is intractable. We propose a novel fast algorithm called space alternating variational estimation with dictionary learning (SAVED), which is a version of VB(-SBL) pushed to the scalar level. Similarly, as for SAGE (space-alternating generalized expectation maximization) compared to EM, the componentwise approach of SAVED compared to sparse Bayesian learning (SBL) renders it less likely to get stuck in bad local optima and its inherent damping (more cautious progression) also leads to typically faster convergence of the non-convex optimization process. Simulation results show that the proposed algorithm has a faster convergence rate and lower mean squared error (MSE) compared to the alternating least squares based method for tensor decomposition. 

Document Doi Bibtex

Title:SAVED - Space alternating variational estimation for sparse Bayesian learning with parametric dictionaries
Keywords:Sparse Bayesian Learning, Variational Bayes, Tensor Decomposition, Dictionary Learning, Alternating Optimization
Type:Conference
Language:English
City:Pacific Grove
Country:UNITED STATES
Date:
Department:Communication systems
Eurecom ref:5764
Copyright: © 2018 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Bibtex: @inproceedings{EURECOM+5764, doi = {http://dx.doi.org/10.1109/ACSSC.2018.8645208}, year = {2018}, title = {{SAVED} - {S}pace alternating variational estimation for sparse {B}ayesian learning with parametric dictionaries}, author = {{K}urisummoottil, {T}homas {C}hristo and {S}lock, {D}irk {TM}}, booktitle = {{ASILOMAR} 2018, 52nd {A}silomar {C}onference on {S}ignals, {S}ystems and {C}omputers, 28-31 {O}ctober 2018, {P}acific {G}rove, {USA}}, address = {{P}acific {G}rove, {UNITED} {STATES}}, month = {10}, url = {http://www.eurecom.fr/publication/5764} }
See also: