question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[s2s] 1 GPU test for run_distributed_eval

See original GitHub issue

Add test coverage for run_distributed_eval.py that can run on 1 GPU. The command:

python -m torch.distributed.launch --nproc_per_node=1 run_distributed_eval.py --model_name Helsinki-NLP/opus-mt-en-ro --save_dir opus_wmt_en_ro_gens --data_dir wmt_en_ro

works on 1 GPU.

After adding test coverage, we could try to improve API consistency between run_distributed_eval.py and run_eval.py .

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
stas00commented, Nov 4, 2020

Bottom line - run with as many GPUs as available.

Thank you for clarifying.

0reactions
sshleifercommented, Nov 4, 2020

I thought 1 GPU test coverage would be runnable in current CI/by more users. But if much easier to test 2 gpu/easy to add test for 2 GPU that is great!

Read more comments on GitHub >

github_iconTop Results From Across the Web

Fear of Mining? This is How to Test Used a GPU. - YouTube
How do you test a Graphics Card? Especially with a focus on cards that have been used for GPU mining. Ethereum mining has...
Read more >
How to Test Your Graphics Card - Tom's Hardware
Here are the best current graphics card tests, along with details on how we test graphics cards and many other benchmarks you can...
Read more >
NVIDIA Validation Suite User Guide :: GPU Deployment and ...
Produce output in a colon-separated, more script-friendly and parseable format. --specifiedtest, Run a specific test in a configless mode.
Read more >
What is a GPU stress test, and which ones are best? - WePC
One of the most popular GPU stress tests is the Heaven & Valley Benchmarks. It is great for both overclocking and general stability...
Read more >
Basemark GPU
Basemark GPU is a professional evaluation tool to evaluate and compare graphics performance across mobile and desktop platforms. Uniquely, it supports all ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found