Reading the dataset without tensorflow

Hi,

I have searched for quite a long time now and I’m looking for a fast and efficient way of reading your dataset without tensorflow. I could indeed use a minimum of tensorflow code, but what I’ve seen is that we are forced to run the DataReader.read method inside a tensorflow session.

I’ve looked into solutions like using this code https://github.com/pgmmpk/tfrecord, but it’s handled a different way and the data wrongly decoded.

Do you have recommendations on how to use the dataset without or with minimal tensorflow code?

Thanks in advance.

[jenspetersen]

@l3robot nice work with the converter, all PyTorch implementations I saw use it 😃 Still, I can imagine it’s pretty annoying if everyone needs to convert the data before they can use it with anything other than Tensorflow. So my question to the DeepMind guys is: Would you be willing to host numpy versions of the datasets? I could provide those, but I’m having a hard time finding a good place to host the data…

[l3robot]

Oh! thanks a lot for this more than complete answer. This will help a lot! Yes that was exactly what I was referring to, makes lot of sense.