Incorrect architecture specified for ANCE DPR context encoder model
See original GitHub issueIn the config for your ANCE DPR context encoder in HuggingFace model hub, the architecture is listed as DPRQuestionEncoder
but it should be DPRContextEncoder
. This causes a failure when using “reflection” to check the correct model class type to use.
See: https://huggingface.co/castorini/ance-dpr-context-multi/blob/main/config.json Related: https://github.com/huggingface/transformers/issues/13670
Issue Analytics
- State:
- Created 2 years ago
- Comments:7 (5 by maintainers)
Top Results From Across the Web
DPR AutoModel loading incorrect architecture for ... - GitHub
Loading a DPR context encoder DPRContextEncoder using AutoModel.from_pretrained is actually loading DPRQuestionEncoder instead, and later fails. Steps to ...
Read more >DPR - Hugging Face
It is used to instantiate the components of the DPR model according to the specified arguments, defining the model component architectures.
Read more >PyTerrier Documentation
PyTerrier uses some of the functionality of the Java-based Terrier IR platform for indexing and retrieval functionality.
Read more >arXiv:2212.09114v1 [cs.CL] 18 Dec 2022
In this paper, we propose a curriculum learning approach to bridge the gap between training and inference for passage retrieval using dual-cross ...
Read more >Passage Retrieval | Papers With Code
Open-domain question answering relies on efficient passage retrieval to select candidate contexts, where traditional sparse vector space models, such as TF-IDF ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
It shouldn’t affect results, but I’ll rerun to make sure it works.
Yes, @lintool @joshdevins, thank you for catching the issue, I’ll update the model on hugging face.