No dataset found for examples

Hey Maruan, when I call gp_lstm_actuator.py from the examples directory, I get:

"Cannot find DATA_PATH variable in the environment. "
Exception: Cannot find DATA_PATH variable in the environment. DATA_PATH should be the folder that contains `sysid/` directory with the data. Please export DATA_PATH before loading the data.

which I take to mean either 1. I didn’t download the actuator data and need to, or 2. The setup script downloaded the data but didn’t set the DATA_PATH

In any case, can you comment on where this data might reside, and what the folder structure should look like to run the examples?

Thanks!

[alshedivat]

Dan, Alexis, thanks for bringing this up. Sorry for the DATA_PATH-related issue – on my machines, I usually keep all the data in a dedicated folder to which DATA_PATH is pointing. I agree that for the examples such a set up is an overkill and shouldn’t be a requirement.

Dan, thanks for the code snippets. Similarly to what you suggested, I will update the data utils to allow automatic data retrieving in case it is not found. It’s a little bit trickier when you want to support both Python 2 and 3, since pickle formats differ. I will push the updates during the coming week.

You are more than welcome to open a PR with the setup instructions for mac.

[alshedivat]

@XYLee01, examples that use sysid data should run (they automatically retrieve and preprocess the data). If you want to run examples on kin40k, the data loader assumes that you already have that dataset (and DATA_PATH should correctly point to it). You can download kin40k data from Andrew Wilson’s page (also, follow the instructions there on how to preprocess the dataset).

Of course, it would be nice to have an automatic data loader for kin40k that takes care of all preprocessing. I very much welcome contributions!