Graduate School and Research Center in Digital Sciences

On the performance of joint linear minimum mean squared error (LMMSE) filtering and parameter estimation

Bensaid, Siouar; Slock, Dirk T M

SPAWC 2013, 14th IEEE International Workshop on Signal Processing Advances in Wireless Communications, June 16-19, 2013, Darmstadt, Germany

We consider the problem of LMMSE estimation (such as Wiener and Kalman filtering) in the presence of a number of unknown parameters in the second-order statistics, that need to be estimated also. This well-known joint filtering and parameter estimation problem has numerous applications. It is a hybrid estimation problem in which the signal to be estimated by linear filtering is random, and the unknown parameters are deterministic. As the signal is random, it can also be eliminated, allowing parameter estimation from the marginal distribution of the data. An intriguing question is then the relative performance of joint vs. marginalized parameter estimation. In this paper, we consider jointly Gaussian signal and data and we first provide contributions to Cramer-Rao bounds (CRBs). We characterize the difference between the Hybrid Fisher Information Matrix (HFIM) and the classical marginalized FIM on the one hand, and between the FIM (with CRB asymptotically attained by ML) and the popular Modified FIM (MFIM, inverse of Modified CRB) which is a loose bound. We then investigate three iterative (alternating optimization) joint estimation approaches: Alternating Maximum A Posteriori for Signal and Maximum Likelihood for parameters (AMAPML), which in spite of a better HFIM suffers from inconsistent parameter bias, Expectation-Maximization (EM) which converges to (marginalized) ML (but with AMAPML signal estimate), and Variational Bayes (VB) which yields an improved signal estimate with the parameter estimate asymptotically becoming ML.

Document Doi Bibtex

Title:On the performance of joint linear minimum mean squared error (LMMSE) filtering and parameter estimation
Keywords:Joint Estimation, Maximum Likelihood (ML), Variational Bayes (VB), Expectation-Maximization (EM), Cramer-Rao Bound (CRB)
Type:Conference
Language:English
City:Darmstadt
Country:GERMANY
Date:
Department:Communication systems
Eurecom ref:4054
Copyright: © 2013 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Bibtex: @inproceedings{EURECOM+4054, doi = {http://dx.doi.org/10.1109/SPAWC.2013.6612084}, year = {2013}, title = {{O}n the performance of joint linear minimum mean squared error ({LMMSE}) filtering and parameter estimation}, author = {{B}ensaid, {S}iouar and {S}lock, {D}irk {T} {M}}, booktitle = {{SPAWC} 2013, 14th {IEEE} {I}nternational {W}orkshop on {S}ignal {P}rocessing {A}dvances in {W}ireless {C}ommunications, {J}une 16-19, 2013, {D}armstadt, {G}ermany }, address = {{D}armstadt, {GERMANY}}, month = {06}, url = {http://www.eurecom.fr/publication/4054} }
See also: