Tensors must have same number of dimensions : got 5 and 3

Hello @lucidrains @stevenwalton I have been trying to implement the standard ViT in 3d space and I have worked on some part of code ViT changed the Rearrange in patch embedding to as follows Rearrange('b e (h p1) (w p2) (d p3) -> b (e p1 p2 p3) h w d',p1=patch_size,p2=patch_size,p3=patch_size) and this patch embbeddings are passed to map with cls_tokens cls_tokens = repeat(self.cls_token, '() n e -> b n e', b=b) which throws an error due to dimensionality mismatch so how can i change the shape of cls_tokens to match the dimensionality of the patch_embeddings.

can you help me for getting solution to this problem Thanks & Regards Satwik Sunnam

[satwiksunnam19]

@satwiksunnam19 let me know if this helps https://github.com/lucidrains/vit-pytorch#3d-vit

@stevenwalton would be happy to offer a 3D CCT version, if you haven’t completed it already Satwik

@lucidrains I have completed the vit-3d model and it’s working good and i can add my vit-3d project to your GitHub , if you’re willing me to do so.

[satwiksunnam19]

Thanks @lucidrains @stevenwalton