Dataset Viewer issue for indonesian-nlp/librivox-indonesia

Link

https://huggingface.co/datasets/indonesian-nlp/librivox-indonesia

Description

I created a new speech dataset https://huggingface.co/datasets/indonesian-nlp/librivox-indonesia, but the dataset preview doesn’t work with following error message:

Server error
Status code:   400
Exception:     TypeError
Message:       unsupported operand type(s) for +: 'NoneType' and 'str'

Please help, I am not sure what the problem here is. Thanks a lot.

Owner

Yes

[cahya-wirawan]

Hi @albertvillanova , I just add the streaming functionality and it works in the first try 😃 Thanks a lot!

[albertvillanova]

Yes, the issue arises when streaming (that is used by the viewer): your script does not support streaming and to support it in this case there are some subtleties that we are explaining better in our docs in a work-in progress pull request:

• #4872

Just note that when streaming, local_extracted_archive is None, and this code line generates the error:

filepath = local_extracted_archive + "/librivox-indonesia/audio_transcription.csv"

For a proper implementation, you could have a look at: https://huggingface.co/datasets/common_voice/blob/main/common_voice.py

You can test your script locally by passing streaming=True to load_dataset:

ds = load_dataset("indonesian-nlp/librivox-indonesia", split="train", streaming=True); item = next(iter(ds)); item