question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Testing new data using fairseq-generate with trained models

See original GitHub issue

What is the exact command to translate a new test data using the fairseq trained models ?
I have kept a test data set for translation inside /home/ola/NMT/corpus/test-en-hi folder. The command I have given is, fairseq-generate /home/ola/NMT/corpus/test-en-hi --path checkpoints/fconv/checkpoint_best.pt --batch-size 128 --beam 5 --skip-invalid-size-inputs-valid-test --source-lang en --target-lang hi >trans-en-hi.out But, it is showing an error FileNotFoundError: [Errno 2] No such file or directory: ‘/home/ola/NMT/corpus/test-en-hi/dict.en.txt’ It is asking for a dict.en.txt file… Why it is so ? Actually, after preprocessing (before training) there is a data-bin/IITB.en-hi folder created with all binarized fies in that dict.en.txt also present. Now what is the requirement for a dict.en.txt to translate a new dataset…?

Could you please help me to get the exact command to translate a test data using fairseq trained models.

What have you tried?

fairseq-generate /home/ola/NMT/corpus/test-en-hi --path checkpoints/fconv/checkpoint_best.pt --batch-size 128 --beam 5 --skip-invalid-size-inputs-valid-test --source-lang en --target-lang hi >trans-en-hi.out

What’s your environment?

  • fairseq Version :0.10.1
  • PyTorch Version : 1.7.1.post2
  • OS : Ubuntu 18.04
  • How you installed fairseq (pip, source):conda install -c conda-forge pytorch cudatoolkit=10.1 nvidia-apex fairseq==0.10.1
  • Build command you used (if compiling from source):
  • Python version: Python 3.6.12 :: Anaconda, Inc.
  • CUDA/cuDNN version:10.1
  • GPU models and configuration: NVIDIA-SMI 418.40.04 Driver Version: 418.40.04 CUDA Version: 10.1 Tesla K80
  • Any other relevant information:

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Reactions:1
  • Comments:7 (1 by maintainers)

github_iconTop GitHub Comments

2reactions
sascamcommented, Jun 21, 2021

bump

This issue is still there.

On Sun, 20 Jun 2021 at 18:57, stale[bot] @.***> wrote:

This issue has been automatically marked as stale. If this issue is still affecting you, please leave any comment (for example, “bump”), and we’ll keep it open. We are sorry that we haven’t been able to prioritize it yet. If you have any new additional information, please include it with your comment!

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/pytorch/fairseq/issues/3222#issuecomment-864555089, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASZATOYQI6SSUZ6LMYQK2OTTTXUDBANCNFSM4XKKGTVQ .

0reactions
stale[bot]commented, Apr 30, 2022

Closing this issue after a prolonged period of inactivity. If this issue is still present in the latest release, please create a new issue with up-to-date information. Thank you!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Testing new data using fairseq-generate with trained models
What is the exact command to translate a new test data using the fairseq trained models ? I have kept a test data...
Read more >
Evaluating Pre-trained Models — fairseq 0.12.2 documentation
Once your model is trained, you can generate translations using fairseq-generate (for binarized data) or fairseq-interactive (for raw text):.
Read more >
NMT training using fairseq - Google Groups
I have gone through the fairseq documentation for training a new model. ... How to give a test data for translating using fairseq-generate?...
Read more >
fairseq/examples/translation/README.md - Hugging Face
This README contains instructions for using pretrained translation models as well as training new models. Pre-trained models. Model, Description ...
Read more >
fairseq Users | Hi, is there a way to modify the decoding ...
I am trying to use Fairseq for the first time (I'm very new on the field) and have ... a way to train...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found