Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Doubt about distiluse-base-multilingual-cased

See original GitHub issue

HI @nreimers,

first congratulations for the library and the papers about sentence embeddings.

I have a doubt about distiluse-base-multilingual-cased. Why the output tensor dimension for one sentence is 512 instead typical 768? Is not it trained with DistiBERT?

Regards.

Issue Analytics

State:
Created 3 years ago
Comments:14 (7 by maintainers)

Top GitHub Comments

5reactions

nreimerscommented, May 29, 2020

Hi @Guillermogsjc I am working on it to add the models to the huggingface models collection. I should be able to add them within the next 2 weeks.

Best Nils

2reactions

nreimerscommented, Jun 14, 2020

Hi @bernardocaldas Sorry to be behind schedule. Yes, models will be added to the models collections. Hope I can do that soon.

Best Nils

Top Results From Across the Web

sentence-transformers/distiluse-base-multilingual-cased-v1

We're on a journey to advance and democratize artificial intelligence through open source and open science.

Pretrained Models — Sentence-Transformers documentation

These models find semantically similar sentences within one language or across languages: distiluse-base-multilingual-cased-v1: Multilingual knowledge distilled ...

how to fine-tune "distiluse-base-multilingual-cased" model for ...

how to fine-tune "distiluse-base-multilingual-cased" model for text similarity customisation · Ask Question. Asked 1 year, 3 months ago.

Hugging Face on Twitter: "11 state-of-the-art sentence ...

Not comprehensive enough to answer your original question, ... model = SentenceTransformer('distiluse-base-multilingual-cased') embedding ...

Top 41 resources for multilingual - NLP Hub - Metatext

I trained on a bert-base-multilingual-cased model from Huggingface and finetuned it on SAIL 2017 dataset ... MultiLingual Question Answering (MLQA) Dataset.