Ability to version with training script to model repository
See original GitHub issueI was chatting with folks and got this idea that it would be good to version model with its’ own training script for better reproducibility. This can simply be done if training script includes push to hub and if we could give user ability to add the file indicated in __file__
to the repository everything’s saved in and is about to be pushed to remote. AFAIK this is not done. WDYT? @osanseviero @nateraw @Wauplin
Issue Analytics
- State:
- Created 10 months ago
- Comments:8 (8 by maintainers)
Top Results From Across the Web
Bring your own model with Amazon SageMaker script mode
The first level of script mode is the ability to define your own training job, model, and inference process without any dependencies. This...
Read more >Data Version Control: a self-contained in-depth tutorial - Medium
In this step, we tracked the data used to train the model. ... Being able to pull down just the outputs of the...
Read more >Track, manage, discover and reuse AI models better using ...
Model registry is a centralised repository to store our models. ... a daily training schedule will build and deploy more versions of a...
Read more >Configure a training job - Azure Machine Learning
Configure and submit training jobs · In this article · Prerequisites · What's a script run configuration? · Train your model · Create...
Read more >Model Repository - triton-inference-server/server · GitHub
The --model-repository option can be specified multiple times to included models from multiple repositories. The directories and files that compose a model ......
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Worth mentioning that to build something outside of
huggingface_hub
, one can still use thesave_pretrained_keras
and reimplement a more flexiblepush_to_hub_keras
based on it.This seems like a very niche case, and I think we generally don’t want people to push too much for their training scripts on the Hub. Not sure if it’s worth adding this to the Keras callback as the usage is relatively low.
cc @julien-c @gary149