question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Ability to version with training script to model repository

See original GitHub issue

I was chatting with folks and got this idea that it would be good to version model with its’ own training script for better reproducibility. This can simply be done if training script includes push to hub and if we could give user ability to add the file indicated in __file__ to the repository everything’s saved in and is about to be pushed to remote. AFAIK this is not done. WDYT? @osanseviero @nateraw @Wauplin

Issue Analytics

  • State:closed
  • Created 10 months ago
  • Comments:8 (8 by maintainers)

github_iconTop GitHub Comments

2reactions
Wauplincommented, Nov 29, 2022

Worth mentioning that to build something outside of huggingface_hub, one can still use the save_pretrained_keras and reimplement a more flexible push_to_hub_keras based on it.

2reactions
osansevierocommented, Nov 28, 2022

This seems like a very niche case, and I think we generally don’t want people to push too much for their training scripts on the Hub. Not sure if it’s worth adding this to the Keras callback as the usage is relatively low.

cc @julien-c @gary149

Read more comments on GitHub >

github_iconTop Results From Across the Web

Bring your own model with Amazon SageMaker script mode
The first level of script mode is the ability to define your own training job, model, and inference process without any dependencies. This...
Read more >
Data Version Control: a self-contained in-depth tutorial - Medium
In this step, we tracked the data used to train the model. ... Being able to pull down just the outputs of the...
Read more >
Track, manage, discover and reuse AI models better using ...
Model registry is a centralised repository to store our models. ... a daily training schedule will build and deploy more versions of a...
Read more >
Configure a training job - Azure Machine Learning
Configure and submit training jobs · In this article · Prerequisites · What's a script run configuration? · Train your model · Create...
Read more >
Model Repository - triton-inference-server/server · GitHub
The --model-repository option can be specified multiple times to included models from multiple repositories. The directories and files that compose a model ......
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found