question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Improve visibility of GPU training in Tabular

See original GitHub issue

Currently users can get various models such as LightGBM, CatBoost, XGBoost and tabular neural networks to train with GPU, however it is not well documented.

The current process to enable GPU for tabular models:

predictor.fit(..., ag_args_fit={'num_gpus': 1})

Note that LightGBM may need a special installation to use GPU.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:6

github_iconTop GitHub Comments

1reaction
Innixmacommented, Dec 3, 2021

So it should be like “ ‘num_gpus’: 8 ”if I have eight gpus right?

Yes, but currently we have not tested multi-gpu and it may only use 1 GPU depending on the model.

1reaction
Innixmacommented, Dec 3, 2021

but i got :Training LightGBM with GPU, note that this may negatively impact model quality compared to CPU training. So should i do not add ‘ag_args_fit’?

This message is because model quality is not identical between CPU and GPU, and GPU may have worse results. This is something you would need to verify yourself if GPU model is attaining good results for your needs.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Improve visibility of GPU training in Tabular #1291 - GitHub
Currently users can get various models such as LightGBM, CatBoost, XGBoost and tabular neural networks to train with GPU, however it is not...
Read more >
Multi GPU Model Training: Monitoring and Optimizing
In this article, we will discuss multi GPU training with Pytorch ... Each GPU gets visibility into a subset of the overall dataset....
Read more >
Multi GPU training with Pytorch - AIME Servers
The following article explains how to train a model with the PyTorch framework using multiple GPUs. The first part deals with an easy...
Read more >
PICASSO: Unleashing the Potential of GPU-centric Training ...
Abstract—The development of personalized recommendation has significantly improved the accuracy of information matching.
Read more >
Chapter 15. Managing Visibility for Per-Pixel Lighting
Visibility can be used effectively to improve performance not only on the CPU, but also on the GPU. When we perform per-pixel lighting...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found