Projects per year
Abstract
We propose the Laplace method to derive approximate inference for Gaussian process (GP) regression in the location and scale parameters of the student-t probabilistic model. This allows both mean and variance of data to vary as a function of covariates with the attractive feature that the student-t model has been widely used as a useful tool for robustifying data analysis. The challenge in the approximate inference for the model, lies in the analytical intractability of the posterior distribution and the lack of concavity of the log-likelihood function. We present the natural gradient adaptation for the estimation process which primarily relies on the property that the student-t model naturally has orthogonal parametrization. Due to this particular property of the model the Laplace approximation becomes significantly more robust than the traditional approach using Newton’s methods. We also introduce an alternative Laplace approximation by using model’s Fisher information matrix. According to experiments this alternative approximation provides very similar posterior approximations and predictive performance to the traditional Laplace approximation with model’s Hessian matrix. However, the proposed Laplace–Fisher approximation is faster and more stable to calculate compared to the traditional Laplace approximation. We also compare both of these Laplace approximations with the Markov chain Monte Carlo (MCMC) method. We discuss how our approach can, in general, improve the inference algorithm in cases where the probabilistic model assumed for the data is not log-concave.
Original language | English |
---|---|
Journal | Statistics and Computing |
Volume | 29 |
Issue number | 4 |
Pages (from-to) | 753–773 |
Number of pages | 21 |
ISSN | 0960-3174 |
DOIs | |
Publication status | Published - Jul 2019 |
MoE publication type | A1 Journal article-refereed |
Fields of Science
- 112 Statistics and probability
- 113 Computer and information sciences
- 111 Mathematics
Projects
- 2 Finished
-
Applying species distribution modeling in marine spatial planning and fisheries management
Vanhatalo, J., Hartmann, M., Liu, J. & Kaurila, K.
01/10/2016 → 30/09/2018
Project: Research project
-
New models and methods to fuse spatial information from complementary sources
Vanhatalo, J., Hartmann, M., Liu, J. & Mäkinen, J. A.
Valtion perusrahoitus/hankkeet, Unknown funder
01/01/2015 → 31/12/2018
Project: University of Helsinki Three-Year Research Project