question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

VMZ. Pytorch models

See original GitHub issue

Hi followed the install instructions to get vmz locally.

I wanted to try out some of the pretrained models like

$ from vmz.models import r2plus1d_34 $ r2plus1d_34(pretraining=‘sports1m_32frms’)

posted below is the tail output of the model: (avgpool): AdaptiveAvgPool3d(output_size=(1, 1, 1)) (fc): Linear(in_features=512, out_features=400, bias=True) this seems like its the finetuned weights on kinetics 400 using pretrained weights, as the fc output should have been 487 from Sports1m instead of 400. I figure this is a bug in matching args to urls in . utils.py

similarly, you have key mismatch running $ r2plus1d_34(pretraining=‘ig65m_32frms’)

looking up the model_urls at line 7 of utils.py it works when i run with

$ r2plus1d_34(pretraining=‘65m_32frms’) ) ) (avgpool): AdaptiveAvgPool3d(output_size=(1, 1, 1)) (fc): Linear(in_features=512, out_features=400, bias=True) ) I might be off since I am new to video CNN’s, just wanted to point this out. I am interested in using pretrained weights from sport1m and IG65m on my own video datasets using newer CNN’s like r2plus1d_34

Issue Analytics

  • State:open
  • Created 3 years ago
  • Comments:8 (1 by maintainers)

github_iconTop GitHub Comments

1reaction
dutrancommented, Nov 13, 2020

we have R(2+1)D-34 preatrained on Sports-1M but on 32x112x112 not 224x224 which may have worse performance, you can find them here. https://github.com/facebookresearch/VMZ/blob/master/c2/tutorials/models.md

1reaction
bjuncekcommented, Jul 27, 2020

Ah, yes - I believe that was one of the internal ones.

@dutran do you perhaps have the R(2+1)D-34 pretrained on sports1m only lying around somewhere? The one you’ve later finetuned for the 2017/8 CVPR paper in models.md.

Read more comments on GitHub >

github_iconTop Results From Across the Web

VMZ: Model Zoo for Video Modeling - GitHub
VMZ is a Caffe2 and Pytorch codebase for video modeling developed by the Computer Vision team at Facebook AI. The aim of this...
Read more >
Models and pre-trained weights — Torchvision main ... - PyTorch
The torchvision.models subpackage contains definitions of models for addressing different tasks, including: image classification, pixelwise semantic ...
Read more >
A Closer Look at Spatiotemporal Convolutions for Action ...
A Closer Look at Spatiotemporal Convolutions for Action Recognition. Manohar Paluri, Yann LeCun, Jamie Ray, Lorenzo Torresani, Heng Wang, Du Tran - 2017....
Read more >
IG65M-PyTorch: video models pre-trained on over 65M ...
We hope the PyTorch models and weights are useful for folks out there and are easier to use and work with compared to...
Read more >
Action Classification | Papers With Code
Trend, Dataset, Best Model, Paper, Code, Compare ... Use these libraries to find Action Classification models and ... rwightman/pytorch-image-models.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found