question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

examples/rag: test coverage, tiny model

See original GitHub issue

Disclaimer: I don’t know this code very well, this may be much harder than it seems. Blocking PR: #7713

[examples/rag/finetune.py, examples/rag/finetune.sh, eval_rag.py] do not seem to be tested at all. It would be good to have a test_finetune.py like examples/seq2seq that tested these.

cc @stas00 if interested, rag is a cool new retrieval model https://arxiv.org/pdf/2005.11401.pdf

Issue Analytics

  • State:open
  • Created 3 years ago
  • Comments:5 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
stas00commented, Oct 11, 2020

sign me up, Sam

0reactions
stas00commented, Mar 6, 2021

As the required to implement this info was never provided and I since then moved to work on other things I removed self-assignment to this ticket…

Read more comments on GitHub >

github_iconTop Results From Across the Web

TestCoverage - Martin Fowler
Test coverage is a useful tool for finding untested parts of a codebase. Test coverage is of little use as a numeric statement...
Read more >
(PDF) The Interplay between Model Coverage and Code ...
Best model coverage reached by Reactis Tester; coverage measured ... The determination of structural coverage in order to control the test.
Read more >
Increase Test Coverage for a Model - MATLAB & Simulink
Workflow · Paths and Example Files · Run the Initial Test and Review Coverage · Generate Tests to Increase Model Coverage · Run...
Read more >
Lowes Wood Stains
In our lab tests, Wood stains models like the Maximum Semi-Transparent are rated ... Using a rag or cheese cloth, gently rub the...
Read more >
Code Coverage Tutorial: Branch, Statement, Function Coverage
You would get to know how it differs from Test Coverage. ... This was just a small example to clarify the meaning of...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found