FlowΒΆ
In one minute
A flow model transforms a simple distribution into a complex one through a chain of coordinate transformations, tracking the density with the Jacobian. It runs in a generative direction (sample, then transform) or a normalizing direction (simplify the data distribution).

For a probability density \(p(x)\) and a transformation of coordinate \(x=g(z)\) or \(z=f(x)\), the density can be expressed using the coordinate transformations, i.e.,
where the Jacobian is
The operation \(g_{*}\circ \tilde p(z)\) is the push forward of \(\tilde p(z)\). The operation \(g_{*}\) will pushforward simple distribution \(\tilde p(z)\) to a more complex distribution \(p(x)\).
- The generative direction: sample \(z\) from distribution \(\tilde p(z)\), apply transformation \(g(z)\);
- The normalizing direction: "simplify" \(p(x)\) to some simple distribution \(\tilde p(z)\).
The key to the flow model is the chaining of the transformations
where
Related: Forecasting with Flow
-
Liu X, Zhang F, Hou Z, Wang Z, Mian L, Zhang J, et al. Self-supervised Learning: Generative or Contrastive. arXiv [cs.LG]. 2020. Available: http://arxiv.org/abs/2006.08218 ↩