Variational bayesian learning for channel estimation and transceiver determination