question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[BUG] dataset_meta.json isn't updated after create_tensor

See original GitHub issue

🐛🐛 Bug Report

After loading an existing dataset with hub.dataset, create_tensor doesn’t update the “tensors” attribute in dataset_meta.json.

⚗️ Current Behavior

For example, a dataset called “hub_dataset” with tensor “images” already exists. Loading it with hub.dataset then appending a new tensor, “test”:

ds = hub.dataset("hub_dataset")
ds.create_tensor('test')

The “tensors” attribute in dataset_meta.json won’t contain the “test” tensor.

{"version": "2.0.8", "tensors": ["images"]}

⚙️ Environment

  • Python version(s): [3.7.11]
  • OS: Ubuntu 18.04

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:5 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
dhiganthraocommented, Oct 4, 2021

Hey @divikshrivastava, welcome to Hub, and thank you for your willingness to contribute! Since this issue is not high priority, would you mind taking a look at the open issues for Hacktoberfest? Here’s the link: https://github.com/activeloopai/Hub/projects/11.

1reaction
istraniccommented, Sep 5, 2021

@mccrearyd I’m also experiencing this issue. Will create a ticket internally.

Thanks for pointing this out @rahulbshrestha!

Read more comments on GitHub >

github_iconTop Results From Across the Web

After data augmentation - can't use from_tensor_slices
I got the following error while working on ~ 200MB of data : ValueError: Cannot create a tensor proto whose content is larger...
Read more >
meta.json is not generated after network issues, still ... - GitHub
I'm using premium azure files as my prometheus storage, the problem happens when there is a network jitter a week ago, since then,...
Read more >
Writing custom datasets - TensorFlow
Follow this guide to create a new dataset (either in TFDS or in your own repository). Check our list of datasets to see...
Read more >
Tensor returned : - Hugging Face
Create a new dataset sorted according to a column. Currently sorting according to a column name uses pandas sorting algorithm under the hood....
Read more >
Building Efficient Custom Datasets in PyTorch
creating a brand new Dataset using basic Python I/O and some static ... Notice that we do not need to prepare the tensors...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found