Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

XLM-RoBERTa is not supported

See original GitHub issue

Hi Thanks a lot for your hard work. Can you add support XLM-RoBERTa too? Thanks

Issue Analytics

State:
Created 4 years ago
Comments:12 (7 by maintainers)

Top GitHub Comments

1reaction

ThilinaRajapaksecommented, Jan 13, 2020

Added in 0.17.0. Let me know if you run into any issues! 😉

0reactions

freeIsacommented, Jul 14, 2020

Is there a reason why xml-roberta is not supported for language modeling fine-tuning?

Top Results From Across the Web

XLM-RoBERTa - Hugging Face

XLM -RoBERTa is a multilingual model trained on 100 different languages. Unlike some XLM multilingual models, it does not require lang tensors to...

XLM-RoBERTa model for QA seems not properly work #7774

The problem arises when using: the official example scripts: run_squad.py; my own modified scripts: (give details below). The tasks I am working ......

nlp - What is the difference between XLM-roberta-base and ...

I heard xlm-roberta-large works better in a few shot setting, have no idea why or if that's true. Is xlm-roberta-base zero-shot?

XLM-RoBERTa | Lecture 56 (Part 2) - YouTube

Unsupervised Cross-lingual Representation Learning at ScaleCourse Materials: https://github.com/maziarraissi/Applied-Deep-Learning.

Zero Shot Multilingual Learning with XLM-Roberta ... - YouTube

Also Checkout my 2nd Channel ( on Trading, Crypto & Investments ) - https://www.youtube.com/channel/UChMwVQBFtaOga5Mh0uE1Icg I am a Banker ...