[EventHub] ErrorCodes.UnknownError: Connection in an unexpected error state.

We are running live Tests against other clouds like US Gov and Azure China Cloud. The goal is to check whether new azure sdk package work with other clouds or not.

Error Description: When running the test test_send.py::test_send_with_partition_key and its async test in windows2019_36 on China cloud, it runs failed and the error message is shown as following, for more details please check here:

Expected Behavior: Test test_send.py::test_send_with_partition_key passed in windows2019_36 on China cloud. In the local test, the probability of passing is 50%.

@benbp , @jameszliao-msft , @lmazuel , @lilyjma , @ramya-rao-a and @annatisch for notification.

[swathipil]

@v-xuto Thanks for testing this out! I was actually able to reproduce this error locally when testing against an EH namespace where the location is set far away and has a long round trip (specifically, Australia). I’m currently debugging right now to see if we’re retrying incorrectly or whether there’s a problem elsewhere. Will have more updates to you in the next week.

[swathipil]

Hey @v-xuto! Just wanted to give you an update: I believe that the issue had to do with our retry logic in our test. I have a PR out to fix this and am working through a few comments on the PR. Hoping to have this merged by next week. Thanks @mikeharder for your suggestions on retry and reproducing with location set to Australia!

More details: We were using the underlying uamqp ReceiveClient to receive in the test (which doesn’t have the retry logic), rather than the EH Consumer Client (which has the retry logic). So, this should only be an issue in our test and not an issue with our SDK. Once I added the retry logic to the test, I was no longer getting this error.