Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

RAGSequenceForGeneration support

See original GitHub issue

currently haystack.generator supports only RAGTokenForGeneration, what about RAGSequenceForGeneration!

yes, I want to implement it 😉

Issue Analytics

State:
Created 3 years ago
Comments:6 (5 by maintainers)

Top GitHub Comments

1reaction

tholorcommented, Dec 10, 2020

Hey @sadakmed,

would be great to have RAGSequenceForGeneration, too! If I remember it correctly, @lalitpagaria faced a problem with it when doing the initial implementation of RAG. I think the challenge was related to passing our “external” retriever to the implementation of HuggingFace’s RAGSequenceForGeneration. However, it’s definitely doable and we will soon upgrade to transformers 4.0 which might also simplify things. We would really appreciate it if you can investigate this and raise a PR!

0reactions

stale[bot]commented, Aug 20, 2021

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 21 days if no further activity occurs.

Top Results From Across the Web

RAG - Hugging Face

RAG. Overview. Retrieval-augmented generation (“RAG”) models combine the powers of pretrained dense retrieval (DPR) and sequence-to-sequence models.

Question Answering with RAG on a Custom Dataset - YouTube

Bill Nye Answers Science Questions From Twitter | Tech Support | WIRED. WIRED. WIRED. •. •. 9.3M views 5 years ago ...

Not able to use NERModel due to import issue from ...

After successfully installing the package SimpleTransformers in kernel , i'm trying to import NERModel and NERArgs packages from ...

huggingface/transformers v3.3.0 on GitHub - NewReleases.io

... tasks using RagTokenForGeneration or RagSequenceForGeneration as proposed in ... [s2s] add supported architecures to MD #7252 (@sshleifer) ...

python/huggingface/transformers/tests/rag/test_modeling_rag.py

... RagModel, RagRetriever, RagSequenceForGeneration, RagTokenForGeneration, ... "which mode is used for short wave broadcast service", "who is the owner of ...