On the Beta Prime Prior for Scale Parameters in High-Dimensional Bayesian Regression Models
share
We study high-dimensional Bayesian linear regression with a general beta prime distribution for the scale parameter. To avoid misspecification of the hyperparameters and to enable our prior to adapt to both sparse and dense models, we propose a data-adaptive method for estimating the hyperparameters in the beta prime density. Our estimation of hyperparameters is based on maximization of marginal likelihood (MML), and we show how to incorporate our estimation procedure easily into our approximation of the posterior. Under our proposed empirical Bayes procedure, the MML estimates are never at risk of collapsing to zero. We also investigate the theoretical properties of our prior. We prove that careful selection of the hyperparameters leads to (near) minimax posterior contraction when p ≫ n. As an aside, we also derive conditions for minimax posterior contraction under our prior for the sparse normal means problem. Finally, we demonstrate our prior's self-adaptivity and excellent finite sample performance through simulations and analysis of a gene expression data set.
READ FULL TEXT