A novel neural-network-based retrieval method is proposed that combines the flexibility and computational efficiency of machine learning retrievals with the consistent treatment of uncertainties of Bayesian methods. Numerical experiments are presented that show the consistency of the proposed method with the Bayesian formulation as well as its ability to represent non-Gaussian retrieval errors. With this, the proposed method overcomes important limitations of traditional methods.