Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[KED-862] Implement dataset versioning on CSVBlobDataSet

See original GitHub issue

Description

CSVBlobDataSet class in kedro.contrib.io.azure.CSVBlobDataSet does not have versioning implemented and it would be great if we could also enable it in this dataset.

Context

N/A

Possible Implementation

The documentation for how to enable versioning can be found in here
You could also find actual examples of versioning implementations in the datasets in kedro.io

Issue Analytics

State:
Created 4 years ago
Comments:13 (6 by maintainers)

Top GitHub Comments

1reaction

mzjp2commented, Sep 27, 2019

It looks like this hasn’t been updated in a while, so I’m happy to make a PR (I have a copy in my fork https://github.com/mzjp2/kedro/commit/8db124b1a7c2301e09965c652e2aae8c42cf7873) but equally, also happy to defer to Evan if he’s back. 😃

1reaction

921kiyocommented, Aug 28, 2019

@evanmiller29 We have a documentation about how to feed credentials to a dataset in https://kedro.readthedocs.io/en/latest/04_user_guide/04_data_catalog.html#feeding-in-credentials 😃

Top Results From Across the Web

[KED-862] Implement dataset versioning on CSVBlobDataSet

Description CSVBlobDataSet class in kedro.contrib.io.azure.CSVBlobDataSet does not have versioning implemented and it would be great if we ...

Writing Data Piplines With Kedro 6 - YouTube

Introduction to Versioning Datasets and Dataset Injection - Writing ... In this series, we will be covering Kedro and how to use it...

Tutorial: Data and Model Versioning - DVC

Get hands-on experience with data versioning in a basic machine learning version control scenario: managing multiple datasets and ML models using DVC.

The Data Catalog — Kedro 0.17.6 documentation

The are two ways of defining a Data Catalog through the use of YAML configuration, or programmatically using an API. Both methods allow...

Dataset Versioning - Documentation - Weights & Biases

W&B Artifacts help you save and organize machine learning datasets throughout a project's lifecycle. Common use cases.