the input of the hallucinator?

Dear author

I am a little bit confused on hallucinator.

In paper (Figure 2.), it says “We also train a hallucinator h that takes a single image feature phi_t and learns to hallucinate its temporal representation”. However, in the source code, the input is the whole sequence image features. is it contradict? Thanks in advance.

` def fc2_res(phi, name=‘fc2_res’): “”" Converts pretrained (fixed) resnet features phi into movie strip.

This applies 2 fc then add it to the orig as residuals.

Args:
    phi (B x T x 2048): Image feature.
    name (str): Scope.

Returns:
    Phi (B x T x 2048): Hallucinated movie strip.
"""

`

[jasonyzhang]

That is correct. My pleasure.

[seamanj]

So basically, for a specific frame t, {Phi}_t will be 1x1x2048 as well? I mean, {Phi}_t and \tilde{\Phi} should be in the same dimension in order to calculate the loss function in formula (3).

Thanks for your help!