Scandinavian Working Papers in Economics

Working Paper Series,
Sveriges Riksbank (Central Bank of Sweden)

No 307: SPEEDING UP MCMC BY DELAYED ACCEPTANCE AND DATA SUBSAMPLING

Matias Quiroz ()
Additional contact information
Matias Quiroz: Research Department, Central Bank of Sweden, Postal: Sveriges Riksbank, SE-103 37 Stockholm, Sweden

Abstract: The complexity of Markov Chain Monte Carlo (MCMC) algorithms arises from the requirement of a likelihood evaluation for the full data set in each iteration. Payne and Mallick (2014) propose to speed up the Metropolis-Hastings algorithm by a delayed acceptance approach where the acceptance decision proceeds in two stages. In the rst stage, an estimate of the likelihood based on a random subsample determines if it is likely that the draw will be accepted and, if so, the second stage uses the full data likelihood to decide upon nal acceptance. Evaluating the full data likelihood is thus avoided for draws that are unlikely to be accepted. We propose a more precise likelihood estimator which incorporates auxiliary information about the full data likelihood while only operating on a sparse set of the data. It is proved that the resulting delayed acceptance MCMC is asymptotically more ecient compared to that of Payne and Mallick (2014). Furthermore, we adapt the method to handle data sets that are too large to t in Random-Access Memory (RAM). This adaptation results in an algorithm that samples from an approximate posterior with well studied theoretical properties in the literature.

Keywords: Bayesian inference; Markov chain Monte Carlo; Delayed acceptance MCMC; Large data; Survey sampling

JEL-codes: C11; C13; C15; C55; C83

30 pages, August 1, 2015

Full text files

rap_wp307_150921.pdf PDF-file 

Download statistics

Questions (including download problems) about the papers in this series should be directed to Lena Löfgren ()
Report other problems with accessing this service to Sune Karlsson ().

RePEc:hhs:rbnkwp:0307This page generated on 2024-09-13 22:16:57.