Skip to content

Commit 5b9cb58

Browse files
committed
added intro to gen. cond. flow matching
1 parent 0fad3d6 commit 5b9cb58

File tree

1 file changed

+9
-2
lines changed

1 file changed

+9
-2
lines changed

Diff for: _posts/2024-05-07-elaborating-on-the-value-of-flow-matching-for-density-estimation.md

+9-2
Original file line numberDiff line numberDiff line change
@@ -68,10 +68,13 @@ by chaining several differentiable and invertible transformations. However,
6868
these diffeomorphic transformations limit the flows in their complexity as such
6969
have to be simple. Furthermore, this leads to trade-off sampling speed and
7070
evaluation performance <d-cite key="papamakarios_normalizing_2019"></d-cite>.
71+
Their continuous couterpart, Continuous Normalizing Flows (CNFs) have been held
72+
back by limitations in their simulation-based maximum likelihood training
73+
<d-cite key="tong_improving_2023"></d-cite>.
7174

7275
# Continuous Normalizing Flows
7376

74-
Continuous normalizing flows (CNFs) are among the first applications of neural
77+
Continuous normalizing flows are among the first applications of neural
7578
ordinary differential equations (ODEs) <d-cite key="chen_neural_2018"></d-cite>.
7679
Instead of the traditional layers of neural networks, the flow is defined by a
7780
vector field that is integrated over time.
@@ -236,7 +239,11 @@ convergence and better results.
236239

237240
## Generalized Flow-Based Models
238241

239-
todo. ...
242+
Flow matching, as it is described above, is limited to the Gaussian source
243+
distributions. In order to allow for arbitrary base distributions <d-cite
244+
key="tong_improving_2023"></d-cite> extended the approach to a generalized
245+
conditional flow matching technique which are a family of simulation-free
246+
training objectives for CNFs.
240247

241248
# Empirical results
242249

0 commit comments

Comments
 (0)