question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add a TFDS user CLI

See original GitHub issue

It would be nice to have a user CLI which is installed at the same time as TFDS to pre-generate dataset:

tfds new my_dataset  # Generate the base template & cie
cd my_dataset/
tfds build  # Generate my_dataset

tfds new would create the following folder structure:

my_dataset/
    fake_data/
    __init__.py
    dataset.py
    dataset_test.py
    make_fake_data.py
    checksum.txt

Some technical details:

  • Script would be implemented in python using argparse
  • Is added through the entry_points={'command'} section in setup.py

This first require to implement the one folder==one dataset model.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:12 (12 by maintainers)

github_iconTop GitHub Comments

1reaction
acharles7commented, Jul 10, 2020

Thanks for letting me know, Let me know if you need any help:)

0reactions
vijayphoenixcommented, Oct 1, 2020
Read more comments on GitHub >

github_iconTop Results From Across the Web

TFDS CLI - Datasets - TensorFlow
TFDS CLI is a command-line tool that provides various commands to easily work with ... If you would like to use Nvidia GPU...
Read more >
Add TFVC command - Azure Repos | Microsoft Learn
See how to use the Add command in Visual Studio to add files to a TFVC repository.
Read more >
TensorFlow Tutorial 12 - TensorFlow Datasets - YouTube
In this video we look at the datasets that are available to us through TensorFlow Datasets ( tfds ) and how we load...
Read more >
TFDS Guide - Kaggle
Dataset pipelines. When prepared with TFDS, it is easy to use the dataset with TensorFlow models on Cloud TPUs. Preparing a Dataset for...
Read more >
How to load custom data into tfds for keras cyclegan example?
Install the TFDS CLI: pip install -q tfds-nightly · Navigate into the directory of your dataset: cd path/to/my/project/datasets/ · Create a new ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found