Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
AmqpException during streaming
See original GitHub issueI am consuming IoThub data using spark.readStream. I keep getting these below errors
2018-08-01 07:17:37 WARN TaskSetManager:66 - Lost task 1.1 in stage 9.0 (TID 1425, 172.31.14.123, executor 1): com.microsoft.azure.eventhubs.EventHubException: com.microsoft.azure.eventhubs.impl.AmqpException: The service was unable to process the request; please retry the operation. For more information on exception types and proper exception handling, please refer to http://go.microsoft.com/fwlink/?LinkId=761101 Reference:892b4926-d06f-4cc5-8ba8-9eb2f77a5b20, TrackingId:4bbd1e9d0002017000100a4f5b615e91_G1_B3, SystemTracker:ihsuprodmares019dednamespace:eventhub:iothub-ehub-sensinerve-355077-6a40c0307a~32766|analytics, Timestamp:8/1/2018 7:17:37 AM, errorContext[NS: ihsuprodmares019dednamespace.servicebus.windows.net, PATH: iothub-ehub-sensinerve-355077-6a40c0307a/ConsumerGroups/analytics/Partitions/1, REFERENCE_ID: 1b5455_94d2_G1_1533107847267, PREFETCH_COUNT: 2000, LINK_CREDIT: 2000, PREFETCH_Q_LEN: 0]
at com.microsoft.azure.eventhubs.impl.ExceptionUtil.toException(ExceptionUtil.java:39)
at com.microsoft.azure.eventhubs.impl.MessageReceiver.onClose(MessageReceiver.java:620)
at com.microsoft.azure.eventhubs.impl.BaseLinkHandler.processOnClose(BaseLinkHandler.java:50)
at com.microsoft.azure.eventhubs.impl.BaseLinkHandler.handleRemoteLinkClosed(BaseLinkHandler.java:70)
at com.microsoft.azure.eventhubs.impl.BaseLinkHandler.onLinkRemoteClose(BaseLinkHandler.java:36)
at org.apache.qpid.proton.engine.BaseHandler.handle(BaseHandler.java:176)
at org.apache.qpid.proton.engine.impl.EventImpl.dispatch(EventImpl.java:108)
at org.apache.qpid.proton.reactor.impl.ReactorImpl.dispatch(ReactorImpl.java:324)
at org.apache.qpid.proton.reactor.impl.ReactorImpl.process(ReactorImpl.java:291)
at com.microsoft.azure.eventhubs.impl.MessagingFactory$RunReactor.run(MessagingFactory.java:483)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: com.microsoft.azure.eventhubs.impl.AmqpException: The service was unable to process the request; please retry the operation. For more information on exception types and proper exception handling, please refer to http://go.microsoft.com/fwlink/?LinkId=761101 Reference:892b4926-d06f-4cc5-8ba8-9eb2f77a5b20, TrackingId:4bbd1e9d0002017000100a4f5b615e91_G1_B3, SystemTracker:ihsuprodmares019dednamespace:eventhub:iothub-ehub-sensinerve-355077-6a40c0307a~32766|analytics, Timestamp:8/1/2018 7:17:37 AM
... 13 more
Is this sequence of code causing this problem.
val agg1= stream
.groupByKey(m => Stage1(m.customer))
.mapGroupsWithState(GroupStateTimeout.ProcessingTimeTimeout())(stage1MappingFunction)
agg1.collect()
agg1
.writeStream
.outputMode(OutputMode.Update())
.format("console")
.start()
.awaitTermination()
Issue Analytics
- State:
- Created 5 years ago
- Comments:8 (5 by maintainers)
Top Results From Across the Web
com.azure.core.amqp.exception Package - Microsoft Learn
This exception is thrown when the underlying AMQP layer encounters an abnormal link abort or the connection is disconnected in an unexpected fashion....
Read more >spring - Which AmqpEvent or AmqpException to handle when ...
I have two instances of the same application, running in different virtual machines. I want to grant exclusive access to a queue for...
Read more >Uses of Class org.springframework.amqp.AmqpException
Used to complete the future exceptionally when sending fails. Methods in org.springframework.rabbit.stream.producer that throw AmqpException. Modifier and Type.
Read more >UnnamedSessionManager.java - NET
import com.azure.core.amqp.exception. ... Gets a stream of messages from different sessions. ... Error occurred while getting unnamed session.",
Read more >Error Handling with Spring AMQP - Baeldung
On the other hand, dealing with errors in such environments can be a ... are converted into an AmqpException or one of its...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
I just got this error today, note I have not sent or received any messages when this happened, I am using Azure.Messaging.ServiceBus 7.4.0 it was running for 2 months with no problem, just happened suddenly.
| StackTrace | " at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in //src/libraries/System.Private.CoreLib/src/System/Runtime/ExceptionServices/ExceptionDispatchInfo.cs:line 56\r\n at Microsoft.Azure.Amqp.ExceptionDispatcher.Throw(Exception exception)\r\n at Microsoft.Azure.Amqp.AsyncResult.End[TAsyncResult](IAsyncResult result)\r\n at Microsoft.Azure.Amqp.AmqpObject.OpenAsyncResult.End(IAsyncResult result)\r\n at Microsoft.Azure.Amqp.AmqpObject.EndOpen(IAsyncResult result)\r\n at Microsoft.Azure.Amqp.AmqpObject.<>c.<OpenAsync>b__51_1(IAsyncResult r)\r\n at System.Threading.Tasks.TaskFactory
1.FromAsyncCoreLogic(IAsyncResult iar, Func2 endFunction, Action1 endAction, Task1 promise, Boolean requiresSynchronization) in //src/libraries/System.Private.CoreLib/src/System/Threading/Tasks/FutureFactory.cs:line 512\r\n— End of stack trace from previous location —\r\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in //src/libraries/System.Private.CoreLib/src/System/Runtime/ExceptionServices/ExceptionDispatchInfo.cs:line 56\r\n at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in //src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 173\r\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in //src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 150\r\n at System.Runtime.CompilerServices.ConfiguredTaskAwaitable.ConfiguredTaskAwaiter.GetResult() in //src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 465\r\n at Azure.Messaging.ServiceBus.Amqp.AmqpConnectionScope.<OpenAmqpObjectAsync>d__84.MoveNext() in //sdk/servicebus/Azure.Messaging.ServiceBus/src/Amqp/AmqpConnectionScope.cs:line 1122\r\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in //src/libraries/System.Private.CoreLib/src/System/Runtime/ExceptionServices/ExceptionDispatchInfo.cs:line 56\r\n at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in //src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 173\r\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in //src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 150\r\n at System.Runtime.CompilerServices.ConfiguredTaskAwaitable.ConfiguredTaskAwaiter.GetResult() in //src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 465\r\n at Azure.Messaging.ServiceBus.Amqp.AmqpConnectionScope.<OpenReceiverLinkAsync>d__69.MoveNext() in //sdk/servicebus/Azure.Messaging.ServiceBus/src/Amqp/AmqpConnectionScope.cs:line 365\r\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in //src/libraries/System.Private.CoreLib/src/System/Runtime/ExceptionServices/ExceptionDispatchInfo.cs:line 56\r\n at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in //src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 173\r\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in //src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 150\r\n at System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult() in /_/src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 551\r\n at Azure.Messaging.ServiceBus.Amqp.AmqpReceiver.<OpenReceiverLinkAsync>d__35.MoveNext() in /_/sdk/servicebus/Azure.Messaging.ServiceBus/src/Amqp/AmqpReceiver.cs:line 200\r\n at System.Runtime.ExceptionServices.ExceptionDispatchInfo.Throw() in /_/src/libraries/System.Private.CoreLib/src/System/Runtime/ExceptionServices/ExceptionDispatchInfo.cs:line 56\r\n at System.Runtime.CompilerServices.TaskAwaiter.ThrowForNonSuccess(Task task) in /_/src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 173\r\n at System.Runtime.CompilerServices.TaskAwaiter.HandleNonSuccessAndDebuggerNotification(Task task) in /_/src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 150\r\n at System.Runtime.CompilerServices.ConfiguredTaskAwaitable1.ConfiguredTaskAwaiter.GetResult() in //src/libraries/System.Private.CoreLib/src/System/Runtime/CompilerServices/TaskAwaiter.cs:line 551\r\n at Microsoft.Azure.Amqp.FaultTolerantAmqpObject`1.<OnCreateAsync>d__6.MoveNext()" | stringHey guys, this was fixed in #377 - please consume the new versions (2.2.3 or 2.3.3)! All stress runs complete run for days without running into this issue.