Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

XLM-R XL/XXL

See original GitHub issue

🌟 New model addition

Model description

The larger version of XLMR.

Source

Model	Description	#params	vocab size	Download
`xlmr.xl`	XLM-R (`layers=36, model_dim=2560`)	3.5B	250k	xlm.xl.tar.gz
`xlmr.xxl`	XLM-R (`layers=48, model_dim=4096`)	10.7B	250k	xlm.xxl.tar.gz

Open source status

the model implementation is available: (give details) -> Already available in huggingface
the model weights are available: (give details) -> link + source provided.
who are the authors: (mention them, if possible by @gh-username)

Issue Analytics

State:
Created 2 years ago
Reactions:1
Comments:12 (8 by maintainers)

Top GitHub Comments

4reactions

LysandreJikcommented, Jun 9, 2021

I believe @stefan-it is on it 😎

1reaction

ricardoreicommented, Nov 11, 2021

is there any news about this?

Top Results From Across the Web

Xlxxl - Etsy

Check out our xlxxl selection for the very best in unique or custom, handmade pieces from our costumes shops.

Download Patch File - OpenDev

... z;8Wm9IR;p3S4{Xk8F!7Jc0`wc%o|Wb&{jCF5Ah1#OO(Xlmr|}R+{Lr>QhI~IxbqJJ zG38P|I5V? ... zl$jBcCDlc>xlXx(J%=D;V3ZG=P}qeLR`%R*ROKj5V=}AW;w#%;o_OSK(p*VBf*7IP ...

안녕하세요 지난 21년 7월 소개된 fairseq XLM-Roberta-XL ...

안녕하세요 지난 21년 7월 소개된 fairseq XLM-Roberta-XL, XXL 모델을 제가 ... May be an image of text that says 'Pre-trained models Model xlmr...

mozilla-central: changeset 71205 ... - Mercurial

G_MaY|XLxx#8)x_PQONQX~XDn`orSWkBTrj8wrJ8-TOzxGiYhvsui z8?g5z_XGm4?veP!`@}okZAs`6#iTrt@X<d|w?- ... zpEpp3^O@GVTll++XlmR>yKVNDTlAZ_0&B+Ev!>a9h$w`OXUY|-Ag(PO?

dokuritu.xgyd - Kapdavilla: Keeping India's Tradition

... dokuritu.xlmodokuritu.xlmpdokuritu.xlmqdokuritu.xlmrdokuritu.xlmsdokuritu. ... dokuritu.xlxudokuritu.xlxvdokuritu.xlxwdokuritu.xlxxdokuritu.xlxydokuritu ...