WMT German to English news translation - Missing Metrics and Module 'apply_bpe' not found
See original GitHub issueI have two problems related with the WMT German to English news translation tutorial.
-
After training the WMT Model from the Tutorial 2 https://awslabs.github.io/sockeye/tutorials/wmt.html I noticed, that the ‘metrics’ folder was not generated inside the wmt_model folder. Is the metrics folder only generated when I set
--optimized-metric bleuas parameter or is an error happened while training? -
If I want to do the Translation as described with the code
echo "er ist so ein toller Kerl und ein Familienvater ." | \ python -m apply_bpe -c bpe.codes --vocabulary bpe.vocab.en \ --vocabulary-threshold 50 | \ python -m sockeye.translate -m wmt_model 2>/dev/null | \ sed -r 's/@@( |$)//g'I get the error message
ModuleNotFoundError: No module named 'apply_bpe'. After installing subwort-nmt via pip, it was working, but I don’t receive nothing. What could be the source of the error?
Issue Analytics
- State:
- Created 2 years ago
- Comments:10 (4 by maintainers)
Top Results From Across the Web
WMT German to English news translation - Sockeye
In this tutorial we will train a German to English Sockeye model on a dataset from the Conference on Machine Translation (WMT) 2017....
Read more >WMT 2019 Fourth Conference on Machine Translation ...
Microsoft Translator at WMT 2019: Towards Large-Scale Document-Level ... (German→Czech) and a language pair not involv- ... ther apply BPE splitting.
Read more >Workshop on Statistical Machine Translation (2020)
Workshop on Statistical Machine Translation (2020). Volumes. Proceedings of the Fifth Conference on Machine Translation 142 papers. Show all abstractsHide ...
Read more >Naver Labs Europe's Systems for the Document-Level Generation ...
The goal of the Document-Level Generation and Translation (DGT) task is to generate summaries of basketball games, in two languages (English and German), ......
Read more >MeMAD Deliverable
is available from GitHub.1 Here, we will not repeat research and results ... English–German news translation task at WMT 2019 and the English–German...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found

Add
--use-cputo the Sockeye command. I’ll update the tutorial to conform to the assumption made at the beginning of the tutorial regarding commands on CPU/GPU.I think I found a solution for my problem. If I rewrite the Sockeye code like in the tutorial https://awslabs.github.io/sockeye/tutorials/wmt_large.html then it starts to train as if by magic.
Thank you for you help and I think this issue can be closed.