Question: How to make it work with asyncio?

I have a CLI tool fetching an unknown number of items over an unknown number of pages from an API. The tools uses asyncio (python 3.7) to fetch the data and process it.

I would like to use this progress bar, but when I do, I am facing 2 issues:

1. I have to use sort of a workaround to count the number of items processed asynchronously (see example below).
2. The bar looks super sluggish which does not provide a great user experience.

Here is a piece of code to simulate my problem with the same symptoms:

import asyncio
import random

from alive_progress import alive_bar


async def fetch_and_process_page(page_number):
    await asyncio.sleep(random.randrange(3))
    return 1


async def main():
    page = 1
    res = []
    with alive_bar(0, spinner="waves") as bar:
        while True:
            tasks = [
                fetch_and_process_page(page)
                for _ in range(random.randrange(5))
            ]
            res += await asyncio.gather(*tasks)

            # Workaround to get the progress bar working.
            for _ in range(len(tasks)):
                bar()

            if random.randrange(12) > 10:
                break
            page += 1
    print(f"{len(res)} items collected.")


asyncio.run(main())

Am I using the progress bar correctly? I could not find information regarding its usage with asyncio.

[rsalmei]

It’s alive @rgreinho ! Please install the latest version and let me know! 😅

[rsalmei]

Ah, also read the new corresponding readme section: https://github.com/rsalmei/alive-progress#calibration--new