Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Enhancement: Clean up zero_to_fp32.py

See original GitHub issue

Current zero_to_fp32.py script is in need of optimization; currently the existing implementation requires 2X RAM for the parameters themselves.

Additionally, add documentation for when this script is necessary, how to plug into HuggingFace.

I’m happy to take this one, but cc’ing @stas00.

Issue Analytics

State:
Created 2 years ago
Reactions:1
Comments:30 (18 by maintainers)

Top GitHub Comments

1reaction

siddkcommented, May 11, 2021

Ok that’s fair; alright well I have my work cut out for me - will start by writing some tests and going from there.

0reactions

stas00commented, Jun 23, 2021

@piegu, I have tried to address your needs here: https://github.com/microsoft/DeepSpeed/pull/1181

Please try it and let me know what you think of it.

Thank you.

Top Results From Across the Web

Python code cleanup for beginners. 12 steps to readable and ...

Python code cleanup for beginners. 12 steps to readable and maintainable code. · Step 1. Declutter the repo · Step 2. No passwords...

Clean Code in Python | TestDriven.io

This article looks at how to write clean code in Python.

Neighborhood Cleanups - Escambia County

The neighborhood cleanup initiative involves an aggressive clean-up effort, targeting different neighborhoods throughout the county. The county's neighborhood ...

Cleanup guide | Atlassian Support

This is when you identify the entities to clean up and run the cleanup activities. In this stage you'll decide what exactly you...

10 must-know patterns for writing clean code with Python

1. Clean code is focused. Each function, class, or module should do one thing and do it well. · 2. Clean code is...