Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

General questions.

See original GitHub issue

I was wondering if this uses teacher forcing during training? And what terms did you use as the SOS and EOS tokens? 😃

I have been trying to the get the transformer to work on time series for over a month now, and it seems almost nearly impossible using the nn.Transformer model provided by Pytorch. Did you by any chance get the decoder in the original transformer to work aswell?

Issue Analytics

State:
Created 3 years ago
Comments:5 (3 by maintainers)

Top GitHub Comments

1reaction

oliverguhrcommented, Aug 31, 2020

No, I used the default implementaion (as described in the paper) and it worked fine for me.

0reactions

rodgdutracommented, May 26, 2021

I was reading and debugging the multi-step implementation to understand it better. I’ve come across an interesting thing, seams like the features and labels in the training and evaluation are the same. This behavior is correct ? I thought that in a multi step prediction problem the input features is delayed in relation to the wanted labels, this way we have a window of past behavior of the data and we are aiming to predict the future behavior of the data.