How to correctly upload 160 RL models?

Hi! For people who upload a lot of models on the Hub, I’m working on the upload of about 160 RL models (rl-trained-agents) 🔥 so I will not do it by hand 😅

The github repository containing all the models is like this:

rl-trained-agents
   /a2c/Acrobot-v1_1
   /a2c/CartPole-v1_1
   ...
   /ppo/CartPOle-v1_1

Each model is like this (for instance /ppo/SpaceInvadersNoFrameskip-v4:

├── SpaceInvadersNoFrameskip-v4_1/
│   ├── SpaceInvadersNoFrameskip-v4.zip
│   ├── monitor.csv
│   ├── evaluations.npz        
│   ├── SpaceInvadersNoFrameskip-v4/
│     ├── args.yml
│     ├── config.yml
│     ├── vecnormalize.pkl

The process I’m defining is this way (pseudocode) for each {algo}/{env_id}:

# Step 1: Create Repo on the Hub using Repository
sb3/{algo}-{env_id}: for instance `sb3/ppo-CartPole-v1`

# Step 2: Clone the Repo to a folder

# Step 3: Move the corresponding rl-trained-agents/algo/env to Repo

# Step 4: Go to the Repo and generate the model card

# Step 5: Generate the video (using a script)

# Step 6: Push to Hub the repo

Do you think it’s a good process or you have some better solutions? Thanks for your feedback

[julien-c]

i agree that you should store the uncompressed files whenever possible (to get git history etc)

[osanseviero]

This is super cool, really looking forward to this!