Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Unable to rename columns in streaming dataset

See original GitHub issue

Describe the bug

Trying to rename column in a streaming datasets, destroys the features object.

Steps to reproduce the bug

The following code illustrates the error:

from datasets import load_dataset
dataset = load_dataset('mc4', 'en', streaming=True, split='train')
dataset.info.features
# {'text': Value(dtype='string', id=None), 'timestamp': Value(dtype='string', id=None), 'url': Value(dtype='string', id=None)}
dataset = dataset.rename_column("text", "content")
dataset.info.features
# This returned object is now None!

Expected behavior

This should just alter the renamed column.

Environment info

datasets 2.6.1

Issue Analytics

State:
Created 10 months ago
Comments:7 (5 by maintainers)

Top GitHub Comments

1reaction

lhoestqcommented, Nov 16, 2022

If we know the features before renaming, then we know the features after renaming, so we can pass the new features to the returned dataset in rename_column indeed ! If anyone is interested in contributing, feel free to open a PR and I’d be happy to help / give some pointers 😃

0reactions

alvarobarttcommented, Nov 23, 2022

#self-assign