chainer implementation of IWAE. This code is inspired code1 and code2.
By utilizing k sampling, IWAE reduces the ELBO. If k is 1, it corresponds to the standard VAE.
python iwae.py --sampling_number=k
I check the value of ELBO after training.
k=1 | k=5 | k=10 |
---|---|---|
100.14 | 98.88 | 98.34 |
By increasing the value of k, you can reduce ELBO.
The detail is described in iwae_analysis.ipynb.