Empty bar loops

Great work.

I am facing some issue on nested loops.

with alive_bar(title="Fetching existing Github issues: ") as bar:
        while another_page:
            response = SESSION.get(url, params={'per_page': 100})
            if response.status_code == 200:
                for issue in response.json():
                    bar()
            if 'next' in response.links:
                url = response.links['next']['url']
            else:
                another_page = False

In this sample piece of code, bar updates after 100 items. If I have 250 items, it will update 100 > 200 > 250

[rsalmei]

In this problem of yours, you could create a deque, and let one thread fetching the issues, while the main thread receives and processes them. Only here in the main thread you would instantiate alive_bar, and would not have those “skips”.

You could even use a ThreadPool and fetch all pages in parallel, and receive the issues via the same deque, it would be much better.

[appi147]

Yep. In actual code, there were lines, but I was amazed, how fast all 100 were processed.

On Thu, 14 Jan 2021, 22:16 Rogério Sampaio de Almeida, < [e-mail]> wrote:

No problem man. A closed loop like that, with only bar() inside it, runs so wildly fast (in a few microseconds) that the bar doesn’t have any time to update itself. And this is a great feature of alive-progress!! It is not “directly connected”, there’s a calibration curve that enables you to update MILLIONS of times per second, and the bar updates itself in a fraction of that, at most 60 frames per second. More than that the human eye do not perceive any difference, and is just wasted CPU cycles. In your case you should have some work being done before calling bar() 👍

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/rsalmei/alive-progress/issues/74#issuecomment-760318831, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHYBERUUV2PBYTXAG3NLO2TSZ4NWVANCNFSM4V7MOQ4A .