[KED-2131] Incomplete documentation about the Spaceflights tutorial

Description

The docs regarding the Spaceflights tutorial are incomplete, which makes it harder to successfully finish it.

This has been partially discussed in https://github.com/quantumblacklabs/kedro-examples/issues/58 (including the issue reproducibility). Therefore, I will discuss it in a complementary way.

Context

There is apparently an ongoing internal issue about improving the organization and sync between the repos kedro-examples, kedro-training, and kedro-starter-spaceflights (https://github.com/quantumblacklabs/kedro-training/pull/1).

As I understood, spaceflight full-repo is moving from kedro-examples/kedro-tutorial to kedro-training/kedro/exercises/spaceflight.

I’m not sure about what is being tracked internally, so I will list what I’ve found related to Spaceflights’ requirements.txt:

• Spaceflights tutorial requires kedro[pandas.CSVDataSet,pandas.ExcelDataSet] in requirements. Still, it is not specified in the docs tutorial. This results in the missing requirement pandas and xlrd when trying to load the datasets in Set up the data.
• kedro-examples/kedro-tutorial is also missing this requirement in its src/requirements.txt, which yielded https://github.com/quantumblacklabs/kedro-examples/issues/58.
• Both kedro-training and kedro-starter-spaceflights already have this requirement in their src/requirements.txt.

Actionable

1. kedro-examples/kedro-tutorial’s requirements.txt should be updated to contain kedro[pandas.CSVDataSet,pandas.ExcelDataSet].
2. Docs should be improved to show that kedro[pandas.CSVDataSet,pandas.ExcelDataSet] is required. Set up the spaceflights project#Install project dependencies is probably the right place.
3. This also applies to kedro-training docs at Create a new project#kedro install.
4. Latest and stable Kedro docs points to kedro-examples as the full source to the spaceflights project. I’m not sure, but I guess that this will/should be eventually changed to kedro-training/kedro-exercises/spaceflight.

I could work on 1., 2., and 3. if it makes sense (note that they are at 3 different repos).

PS: Sorry for the cross-repos references everywhere. I considered that here was the best place to report it.

[falcaopetri]

Thanks for addressing it, @921kiyo.

If there is still time, I’d like to add three more notes regarding the docs and kedro-training:

• Doc’s Data science pipeline#Update dependencies adds the scikit-learn dependency to src/requirements.txt and then runs kedro install. Shouldn’t it be src/requirements.in + kedro build-deps && kedro install instead?
• kedro-training also uses scikit-learn, and specifies it in the full project requirements.txt, but there is no instruction stating that sklearn should be installed when following kedro-training docs.
• Interact with Data Engineering Convention has the wrong data type connector kedro_tutorial.io.xls_local.ExcelLocalDataSet (well, it is actually defined if you follow kedro-training):

shuttles:
  type: kedro_tutorial.io.xls_local.ExcelLocalDataSet
  filepath: data/01_raw/shuttles.xlsx
  layer: raw

[lorenabalan]

Closing this as resolved through linked PRs/issues, as well as https://github.com/quantumblacklabs/kedro/commit/589d6a7a329f453ac91662814ec044dc41d1063c and https://github.com/quantumblacklabs/kedro/commit/0fd6b623bdaa2f69623ad4fdacb022a5862fb590 . Please feel free to open a new issue if there are other observations!