Robust model selection between population growth and multiple merger coalescents
We study the effect of biological confounders on the model selection problem between Kingman coalescents with population growth, and Xi-coalescents involving simultaneous multiple mergers. We use a low dimensional, computationally tractable summary statistic, dubbed the singleton-tail statistic, to carry out approximate likelihood ratio tests between these models. The singleton-tail statistic has been shown to distinguish between the two classes with high power in the simple setting of neutrally evolving, panmictic populations without recombination. We extend this work by showing that cryptic recombination and selection do not diminish the power of the test, but that misspecifying population structure does. Furthermore, we demonstrate that the singleton-tail statistic can also solve the more challenging model selection problem between multiple mergers due to selective sweeps, and multiple mergers due to high fecundity with moderate power of up to 60
READ FULL TEXT