Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Elementwise negative loglikelihood of VAE

See original GitHub issue

In some situation, we need negative loglikelihood values for each output of the decoder of VAE. We already have F.gaussian_nll or F.bernoulli_nll, but they are loss functions, that is, they sum up these values and return the sum as a loss. We want a Functions that return each summand.

Issue Analytics

State:
Created 7 years ago
Reactions:2
Comments:5 (5 by maintainers)

Top GitHub Comments

1reaction

delta2323commented, Apr 1, 2016

One of the implementation choice is to add option (like aggregate, sum, reduce etc…) that switch to enable/disable summation.

0reactions

beam2dcommented, Oct 2, 2017

We now have reduce option for these functions.

Top Results From Across the Web

How do Variational Autoencoders use Negative Log ...

I see that it's just calculated as the Negative Log Likelihood/Cross Entropy, or MSE. In the real case, pθ(x|z) is typically N(μ,σ2I) where...

A Tutorial on VAEs: From Bayes' Rule to Lossless Compression

We display the negative log-likelihood of a Typical VAE trained on each dataset in Table 1a. The second column indicates the entropy H...

The Variational Autoencoder - Daniel Daza

In this notebook we are interested in the problem of inference in a probabilistic model that contains both observed and latent variables, ...

Deep Generative Models Part 2: Variational Autoencoders ...

Srihari. Loss Function. • The loss function of the VAE is the negative log-likelihood with a regularizer. • Since no global representations are...

Cross-Entropy, Negative Log-Likelihood, and All That Jazz

Negative log -likelihood minimization is a proxy problem to the problem of maximum likelihood estimation. Cross-entropy and negative log-likelihood are closely ...