Inverse transform sampling
ID: inverse-transform-sampling
If has a uniform distribution on and is the quantile function of a cumulative distribution function , then has the desired probability distribution. Indeed, right continuity givesso . This short argument works for both jumps and smooth cumulative distribution functions. MIT's continuous-probability notes introduce the inverse-transformation construction. [ref]
https://ocw.mit.edu/courses/9-07-statistics-for-brain-and-cognitive-science-fall-2016/6dcc172f428fbfbded912ca8862ea340_MIT9_07F16_lec3.pdf. MIT 9.07, inverse transformation method
.For the three-value example, send to , to , and to . These intervals have exactly the desired widths , , . For the density example, output : for , . Independent uniform draws give independent random variables after this deterministic transformation. This direction of construction works even when has jumps; applying the probability integral transform in the other direction requires its own continuity hypotheses.
New to topics? Read the docs here!