How to train a video model?

Thank you for the great work!

I have some questions

I want to use DeOldify to train a video model like pix2pix. Which notebook should I use? I found that it did not convert color images to black and white image as training data in ColorizeTrainingVideo.ipynb, but in ColorizeTrainingArtistic.ipynb and ColorizeTrainingStable.ipynb

Should I train ColorizeTrainingArtistic.ipynb or ColorizeTrainingStable.ipynb first, and then train the ColorizeTrainingVideo.ipynb?

[jantic]

You have a few options. If you want to start completely from scratch, then you should train ColorizeTrainingStable.ipynb. This is stated at the top of ColorizeTrainingVideo.ipynb:

It’s assumed that there’s a pretrained generator from the ColorizeTrainingStable notebook available at the specified path.

But this isn’t the only way to get a pretrained generator. You can also download its weights from the readme, in the section that looks like this:

Pretrain Only Generator Weights artistic stable video

Pretrain Only Critic Weights artistic stable video

Download the stable ones if you want to start the ColorizeTrainingVideo.ipynb exactly like you would training ColorizeTrainingStable.ipynb on your own first. Or you download the video weights to get straight to GAN training and bypass pre-training on noise augmentation.

[jantic]

I’ve already said no dude. I’m not sure what you think changed between now and then…