question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

WMT German to English news translation - Missing Metrics and Module 'apply_bpe' not found

See original GitHub issue

I have two problems related with the WMT German to English news translation tutorial.

  1. After training the WMT Model from the Tutorial 2 https://awslabs.github.io/sockeye/tutorials/wmt.html I noticed, that the ‘metrics’ folder was not generated inside the wmt_model folder. Is the metrics folder only generated when I set --optimized-metric bleu as parameter or is an error happened while training?

  2. If I want to do the Translation as described with the code

    echo "er ist so ein toller Kerl und ein Familienvater ." | \
            python -m apply_bpe -c bpe.codes --vocabulary bpe.vocab.en \
            --vocabulary-threshold 50 | \
            python -m sockeye.translate -m wmt_model 2>/dev/null | \
            sed -r 's/@@( |$)//g'  
    

    I get the error message ModuleNotFoundError: No module named 'apply_bpe'. After installing subwort-nmt via pip, it was working, but I don’t receive nothing. What could be the source of the error?

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:10 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
fhiebercommented, Dec 8, 2021

Add --use-cpu to the Sockeye command. I’ll update the tutorial to conform to the assumption made at the beginning of the tutorial regarding commands on CPU/GPU.

0reactions
RamoramaInteractivecommented, Dec 8, 2021

I think I found a solution for my problem. If I rewrite the Sockeye code like in the tutorial https://awslabs.github.io/sockeye/tutorials/wmt_large.html then it starts to train as if by magic.

Thank you for you help and I think this issue can be closed.

Read more comments on GitHub >

github_iconTop Results From Across the Web

WMT German to English news translation - Sockeye
In this tutorial we will train a German to English Sockeye model on a dataset from the Conference on Machine Translation (WMT) 2017....
Read more >
WMT 2019 Fourth Conference on Machine Translation ...
Microsoft Translator at WMT 2019: Towards Large-Scale Document-Level ... (German→Czech) and a language pair not involv- ... ther apply BPE splitting.
Read more >
Workshop on Statistical Machine Translation (2020)
Workshop on Statistical Machine Translation (2020). Volumes. Proceedings of the Fifth Conference on Machine Translation 142 papers. Show all abstractsHide ...
Read more >
Naver Labs Europe's Systems for the Document-Level Generation ...
The goal of the Document-Level Generation and Translation (DGT) task is to generate summaries of basketball games, in two languages (English and German), ......
Read more >
MeMAD Deliverable
is available from GitHub.1 Here, we will not repeat research and results ... English–German news translation task at WMT 2019 and the English–German...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found