ZeroDivisionError in the end of zip file

Thanks for the lib. Got ZeroDivisionError: integer division or modulo by zero during processing zip file’s last chunk from example code snippet:

Traceback (most recent call last):
  File "***\tmp.py", line 9, in <module>
    for file_name, file_size, unzipped_chunks in stream_unzip(zipped_chunks()):
  File "***\venv_win32_39py\lib\site-packages\stream_unzip.py", line 180, in stream_unzip
    for _ in yield_all():
  File "***\venv_win32_39py\lib\site-packages\stream_unzip.py", line 35, in _yield_all
    offset = (offset + to_yield) % len(chunk)
ZeroDivisionError: integer division or modulo by zero

Code snippet:

import httpx
from stream_unzip import stream_unzip


def zipped_chunks():
    # Any iterable that yields a zip file
    with httpx.stream('GET', 'https://www.gyan.dev/ffmpeg/builds/packages/ffmpeg-4.4-essentials_build.zip') as r:
        yield from r.iter_bytes()


for file_name, file_size, unzipped_chunks in stream_unzip(zipped_chunks()):
    for chunk in unzipped_chunks:
        # print(chunk)
        print(file_name, file_size)

Python 3.9.5 (Windows 10) stream-unzip 0.0.23

[michalc]

I’ve opted to not change the code, and instead change the README to have an example that works, and explicitly state that zero length chunks are not supported.

It’s a tricky call to make, but all things being equal, I’m happier with the error since it indicates something is unexpected earlier in the processing.

[If users do want to not fail with zero-length chunks, then they can filter them out as in the example above]

[michalc]

Ah found a more robust workaround: specifying chunk_size in the call to iter_bytes makes it avoid the zero length chunk that stream-unzip doesn’t handle:

import httpx
from stream_unzip import stream_unzip

def zipped_chunks():
    with httpx.stream('GET', 'https://www.gyan.dev/ffmpeg/builds/packages/ffmpeg-4.4-essentials_build.zip') as r:
        yield from r.iter_bytes(chunk_size=65536)

for file_name, file_size, unzipped_chunks in stream_unzip(zipped_chunks()):
    for chunk in unzipped_chunks:
        print(file_name, file_size)