Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

SDFLoader doesn't handle zipped/gzipped files

See original GitHub issue

~The dc.utils.save.load_sdf_files operates entirely in memory. This means that loading a large .sdf file with SDFLoader operates entirely in memory and isn’t scalable to very large SDF files.~ SDFLoader also doesn’t have a good way to handle zipped/gzipped files

Issue Analytics

State:
Created 3 years ago
Comments:5 (3 by maintainers)

Top GitHub Comments

1reaction

rbharathcommented, Oct 26, 2020

@BusinessFawn Thanks for volunteering here 😃. I’m thinking just a gzipped/zipped .sdf file would be the desired input to support. One of the sample SDF test files used by SDFLoader but just gzipped/zipped should be a good test case

0reactions

NinadBhatcommented, Mar 22, 2021

Hi, @rbharath. I have submitted a PR. Kindly have a look if you have time for it.

Top Results From Across the Web

Reading csv zipped files in python - Stack Overflow

I used the zipfile module to import the ZIP directly to pandas dataframe. Let's say the file name is "intfile" and it's in...

Zip and unzip files - Microsoft Support

Zipped (compressed) files take up less storage space and can be transferred to other computers more quickly than uncompressed files. In Windows, you...

Data — deepchem 2.6.2.dev documentation

DeepChem dc.data provides APIs for handling your data. If your data is stored by the file like CSV and SDF, you can use...

To zip or not to zip · Issue #2107 · IQSS/dataverse - GitHub

This is the question - some datasets would benefit for keeping zip file (or a similar packaged or compressed file) for all the...

SFTP Site with .Zip files (with more than just data in the .zip file)

I understand that DSS is able to open .zip files and get at the content. However, I'm not clear if I can control...