Rejection Sampling with Vertical Weighted Strips

article
Published

January 19, 2024

Rejection sampling is a classical algorithm (Neumann 1951) to generate variates from a target distribution where a constructive sampling method—e.g., by composing other random variables—may not be apparent. A benefit of rejection sampling is that accepted draws follow the target distribution exactly. However, coming up with a good proposal for rejection sampling can take some creativity. A poor choice can result in extremely low acceptance rates where practically no draws are accepted from a very large number of candidates.

Raim, Livsey, and Irimata (2024+) explore an approach to construct proposals by regarding the target as a weighted density and majorizing the weight function. This yields another weighted density whose unnormalized form can be used as an envelope in the acceptance ratio. If designed consciously, the normalized form can also be used to draw candidate variates to complete the rejection sampler. An improved proposal can be obtained by partitioning the support and majorizing within each region. Here the proposal is a finite mixture. The method is referred to as “vertical weighted strips” because it can be regarded as an extension of the vertical strips method (Devroye 1986, chap. VIII; Martino, Luengo, and Míguez 2018, sec. 3.6), with the weighted form introducing an additional degree of flexibility for algorithm development.

References

Devroye, Luc. 1986. Non-Uniform Random Variate Generation. Springer.
Martino, Luca, David Luengo, and Joaquín Míguez. 2018. Independent Random Sampling Methods. Springer. https://doi.org/https://dx.doi.org/10.1007/978-3-319-72634-2.
Neumann, John von. 1951. “Various Techniques in Connection with Random Digits.” In Monte Carlo Methods, edited by A. S. Householder, G. E. Forsythe, and H. H. Germond, 36–38. National Bureau of Standards Applied Mathematics Series. U.S. Government Printing Office, Washington, DC.
Raim, Andrew M., James A. Livsey, and Kyle M. Irimata. 2024+. “Rejection Sampling with Vertical Weighted Strips.” https://arxiv.org/abs/2401.09696.