HTTPSConnectionPool ERROR - Can we modify the $top value in query?

I get the following error when pulling emails from an inbox.

HTTPSConnectionPool(host='graph.microsoft.com', port=443): Max retries exceeded with url: /v1.0/users/[e-mail]/mailFolders/Inbox/messages?%24top=999&%24expand=attachments%28%24select%3Dname%29 (Caused by ResponseError('too many 504 error responses'))

If i use the following code to limit the number of emails to process, it seems to work: messages = inbox.get_messages(limit=20, batch=20, query=q) But when I change to this, it will idle for a bit then spit out the error above: messages = inbox.get_messages(limit=None, batch=200, query=q)

Any way around this? Am i just hitting some MS Graph throttling limit?

[pythonista092920]

I’ll try running it today with request_retries=None and requests_delay=500 and see what happens. Thank you @janscas

[pythonista092920]

@arkadas19

I actually still would have issues periodically. What I ended up doing was wrapping the calendar.get_events() method in a try except block and setting a 10 retry limit. Everything has ran perfect since making these changes. Maybe this code will help give you an idea.

`

  try:
        schedule = graph_account.schedule(resource=email)
        calendar = schedule.get_default_calendar()

        calender_events_not_retrieved = True

        loop_attempt = 0
        retry_attempt = 0
        while calender_events_not_retrieved:
            loop_attempt += 1

            if loop_attempt > 10:
                print("The loop has ran 10 times, quitting the program.")
                quit()

            if retry_attempt < 9:
                try:
                    graph_events = calendar.get_events(include_recurring=False, limit=None)
                    calender_events_not_retrieved = False

                except Exception as calender_not_retrieved_exc:
                    retry_attempt += 1
                    print(f"Hit calender_not_retrieved_exc: {calender_not_retrieved_exc}")
                    print(f"Could not pull calendar data from MS Graph, trying again. "
                          f"Starting reattempt {retry_attempt}")
                    time.sleep(60)

            else:
                print("Too many retry attempts, quitting the program. MS Graph servers appear to be not "
                      "accepting the requests.")
                quit()

    except Exception as get_calendar_data_exception:
        print(f"Hit the following exception: {get_calendar_data_exception}")

    print("Successfully pulled the calendar data")      

`