Lightrun
question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

translate fails when EventPosition.fromEnqueuedTime filter is used.

See original GitHub issue

Environment:

Databricks Runtime 4.0 (Apache Spark 2.3.0 , Scala 2.11) azure-eventhubs-spark_2.11-2.3.1

Hi,

I’ve two jobs. One which runs continuously and another one which fixes some errors in a specific time window. The continuous job is running fine and receiving new events normally. However, when I’m using the enqueued time filter and starting a job using below snippet, I am not receiving any events at all. (Note: The time window provided is fairly close to end of stream, so assume that there are lot of events present in Eventhub in that window)

val customEventhubParameters = EventHubsConf(connectionString)
        .setStartingPosition(EventPosition.fromEnqueuedTime(startTime))
        .setEndingPosition(EventPosition.fromEnqueuedTime(endTime))
val incomingStream = spark.readStream
      .format("eventhubs")
      .options(customEventhubParameters.toMap)
      .load()

I’m getting -

EventHubsClient: translate: failed to receive event.

which has been recently modified in #330

Logs:

18/06/25 15:44:08 INFO SparkContext: Starting job: foreach at DBUtilsCore.scala:387
18/06/25 15:44:08 INFO DAGScheduler: Got job 4 (foreach at DBUtilsCore.scala:387) with 44 output partitions
18/06/25 15:44:08 INFO DAGScheduler: Final stage: ResultStage 4 (foreach at DBUtilsCore.scala:387)
18/06/25 15:44:08 INFO DAGScheduler: Parents of final stage: List()
18/06/25 15:44:08 INFO DAGScheduler: Missing parents: List()
18/06/25 15:44:08 INFO DAGScheduler: Submitting ResultStage 4 (ParallelCollectionRDD[13] at parallelize at DBUtilsCore.scala:387), which has no missing parents
18/06/25 15:44:08 INFO MemoryStore: Block broadcast_4 stored as values in memory (estimated size 1496.0 B, free 3.3 GB)
18/06/25 15:44:08 INFO MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 1063.0 B, free 3.3 GB)
18/06/25 15:44:08 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on <IP> (size: 1063.0 B, free: 3.3 GB)
18/06/25 15:44:08 INFO SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:1152
18/06/25 15:44:08 INFO DAGScheduler: Submitting 44 missing tasks from ResultStage 4 (ParallelCollectionRDD[13] at parallelize at DBUtilsCore.scala:387) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
18/06/25 15:44:08 INFO TaskSchedulerImpl: Adding task set 4.0 with 44 tasks
18/06/25 15:44:08 WARN FairSchedulableBuilder: A job was submitted with scheduler pool 4970588240906633332, which has not been configured. This can happen when the file that pools are read from isn't set, or when that file doesn't contain 4970588240906633332. Created 4970588240906633332 with default configuration (schedulingMode: FIFO, minShare: 0, weight: 1)
18/06/25 15:44:08 INFO FairSchedulableBuilder: Added task set TaskSet_4.0 tasks to pool 4970588240906633332
18/06/25 15:44:08 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 118, 10.139.64.28, executor 3, partition 0, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 1.0 in stage 4.0 (TID 119, 10.139.64.23, executor 0, partition 1, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 2.0 in stage 4.0 (TID 120, 10.139.64.9, executor 10, partition 2, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 3.0 in stage 4.0 (TID 121, 10.139.64.5, executor 2, partition 3, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 4.0 in stage 4.0 (TID 122, 10.139.64.16, executor 6, partition 4, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 5.0 in stage 4.0 (TID 123, 10.139.64.11, executor 11, partition 5, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 6.0 in stage 4.0 (TID 124, 10.139.64.15, executor 7, partition 6, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 7.0 in stage 4.0 (TID 125, 10.139.64.24, executor 5, partition 7, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 8.0 in stage 4.0 (TID 126, 10.139.64.27, executor 1, partition 8, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 9.0 in stage 4.0 (TID 127, 10.139.64.6, executor 4, partition 9, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 10.0 in stage 4.0 (TID 128, 10.139.64.14, executor 8, partition 10, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 11.0 in stage 4.0 (TID 129, 10.139.64.28, executor 3, partition 11, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 12.0 in stage 4.0 (TID 130, 10.139.64.23, executor 0, partition 12, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 13.0 in stage 4.0 (TID 131, 10.139.64.9, executor 10, partition 13, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 14.0 in stage 4.0 (TID 132, 10.139.64.5, executor 2, partition 14, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 15.0 in stage 4.0 (TID 133, 10.139.64.16, executor 6, partition 15, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 16.0 in stage 4.0 (TID 134, 10.139.64.11, executor 11, partition 16, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 17.0 in stage 4.0 (TID 135, 10.139.64.15, executor 7, partition 17, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 18.0 in stage 4.0 (TID 136, 10.139.64.24, executor 5, partition 18, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 19.0 in stage 4.0 (TID 137, 10.139.64.27, executor 1, partition 19, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 20.0 in stage 4.0 (TID 138, 10.139.64.6, executor 4, partition 20, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 21.0 in stage 4.0 (TID 139, 10.139.64.14, executor 8, partition 21, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 22.0 in stage 4.0 (TID 140, 10.139.64.28, executor 3, partition 22, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 23.0 in stage 4.0 (TID 141, 10.139.64.23, executor 0, partition 23, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 24.0 in stage 4.0 (TID 142, 10.139.64.9, executor 10, partition 24, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 25.0 in stage 4.0 (TID 143, 10.139.64.5, executor 2, partition 25, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 26.0 in stage 4.0 (TID 144, 10.139.64.16, executor 6, partition 26, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 27.0 in stage 4.0 (TID 145, 10.139.64.11, executor 11, partition 27, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 28.0 in stage 4.0 (TID 146, 10.139.64.15, executor 7, partition 28, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 29.0 in stage 4.0 (TID 147, 10.139.64.24, executor 5, partition 29, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 30.0 in stage 4.0 (TID 148, 10.139.64.27, executor 1, partition 30, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 31.0 in stage 4.0 (TID 149, 10.139.64.6, executor 4, partition 31, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 32.0 in stage 4.0 (TID 150, 10.139.64.14, executor 8, partition 32, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 33.0 in stage 4.0 (TID 151, 10.139.64.28, executor 3, partition 33, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 34.0 in stage 4.0 (TID 152, 10.139.64.23, executor 0, partition 34, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 35.0 in stage 4.0 (TID 153, 10.139.64.9, executor 10, partition 35, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 36.0 in stage 4.0 (TID 154, 10.139.64.5, executor 2, partition 36, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 37.0 in stage 4.0 (TID 155, 10.139.64.16, executor 6, partition 37, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 38.0 in stage 4.0 (TID 156, 10.139.64.11, executor 11, partition 38, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 39.0 in stage 4.0 (TID 157, 10.139.64.15, executor 7, partition 39, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 40.0 in stage 4.0 (TID 158, 10.139.64.24, executor 5, partition 40, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 41.0 in stage 4.0 (TID 159, 10.139.64.27, executor 1, partition 41, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 42.0 in stage 4.0 (TID 160, 10.139.64.6, executor 4, partition 42, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO TaskSetManager: Starting task 43.0 in stage 4.0 (TID 161, 10.139.64.14, executor 8, partition 43, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:08 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.28:46459 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:08 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.23:38565 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:08 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.27:44133 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:08 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.5:38301 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:08 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.6:46573 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:08 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.24:38457 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:09 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.16:43793 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:09 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.11:39261 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:09 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.15:39595 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:09 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.14:34565 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:09 INFO BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.139.64.9:40775 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 11.0 in stage 4.0 (TID 129) in 10153 ms on 10.139.64.28 (executor 3) (1/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 118) in 10158 ms on 10.139.64.28 (executor 3) (2/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 33.0 in stage 4.0 (TID 151) in 10157 ms on 10.139.64.28 (executor 3) (3/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 22.0 in stage 4.0 (TID 140) in 10160 ms on 10.139.64.28 (executor 3) (4/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 7.0 in stage 4.0 (TID 125) in 10172 ms on 10.139.64.24 (executor 5) (5/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 40.0 in stage 4.0 (TID 158) in 10177 ms on 10.139.64.24 (executor 5) (6/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 18.0 in stage 4.0 (TID 136) in 10194 ms on 10.139.64.24 (executor 5) (7/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 29.0 in stage 4.0 (TID 147) in 10194 ms on 10.139.64.24 (executor 5) (8/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 3.0 in stage 4.0 (TID 121) in 10206 ms on 10.139.64.5 (executor 2) (9/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 14.0 in stage 4.0 (TID 132) in 10216 ms on 10.139.64.5 (executor 2) (10/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 36.0 in stage 4.0 (TID 154) in 10215 ms on 10.139.64.5 (executor 2) (11/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 25.0 in stage 4.0 (TID 143) in 10216 ms on 10.139.64.5 (executor 2) (12/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 23.0 in stage 4.0 (TID 141) in 10234 ms on 10.139.64.23 (executor 0) (13/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 12.0 in stage 4.0 (TID 130) in 10241 ms on 10.139.64.23 (executor 0) (14/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 1.0 in stage 4.0 (TID 119) in 10242 ms on 10.139.64.23 (executor 0) (15/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 34.0 in stage 4.0 (TID 152) in 10244 ms on 10.139.64.23 (executor 0) (16/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 31.0 in stage 4.0 (TID 149) in 10249 ms on 10.139.64.6 (executor 4) (17/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 20.0 in stage 4.0 (TID 138) in 10252 ms on 10.139.64.6 (executor 4) (18/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 9.0 in stage 4.0 (TID 127) in 10257 ms on 10.139.64.6 (executor 4) (19/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 42.0 in stage 4.0 (TID 160) in 10253 ms on 10.139.64.6 (executor 4) (20/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 30.0 in stage 4.0 (TID 148) in 10257 ms on 10.139.64.27 (executor 1) (21/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 41.0 in stage 4.0 (TID 159) in 10263 ms on 10.139.64.27 (executor 1) (22/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 19.0 in stage 4.0 (TID 137) in 10266 ms on 10.139.64.27 (executor 1) (23/44)
18/06/25 15:44:18 INFO TaskSetManager: Finished task 8.0 in stage 4.0 (TID 126) in 10279 ms on 10.139.64.27 (executor 1) (24/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 4.0 in stage 4.0 (TID 122) in 12127 ms on 10.139.64.16 (executor 6) (25/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 26.0 in stage 4.0 (TID 144) in 12124 ms on 10.139.64.16 (executor 6) (26/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 37.0 in stage 4.0 (TID 155) in 12122 ms on 10.139.64.16 (executor 6) (27/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 15.0 in stage 4.0 (TID 133) in 12125 ms on 10.139.64.16 (executor 6) (28/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 5.0 in stage 4.0 (TID 123) in 12308 ms on 10.139.64.11 (executor 11) (29/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 38.0 in stage 4.0 (TID 156) in 12319 ms on 10.139.64.11 (executor 11) (30/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 27.0 in stage 4.0 (TID 145) in 12331 ms on 10.139.64.11 (executor 11) (31/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 16.0 in stage 4.0 (TID 134) in 12332 ms on 10.139.64.11 (executor 11) (32/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 10.0 in stage 4.0 (TID 128) in 12341 ms on 10.139.64.14 (executor 8) (33/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 32.0 in stage 4.0 (TID 150) in 12338 ms on 10.139.64.14 (executor 8) (34/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 43.0 in stage 4.0 (TID 161) in 12337 ms on 10.139.64.14 (executor 8) (35/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 21.0 in stage 4.0 (TID 139) in 12350 ms on 10.139.64.14 (executor 8) (36/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 17.0 in stage 4.0 (TID 135) in 12635 ms on 10.139.64.15 (executor 7) (37/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 28.0 in stage 4.0 (TID 146) in 12635 ms on 10.139.64.15 (executor 7) (38/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 39.0 in stage 4.0 (TID 157) in 12638 ms on 10.139.64.15 (executor 7) (39/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 6.0 in stage 4.0 (TID 124) in 12645 ms on 10.139.64.15 (executor 7) (40/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 35.0 in stage 4.0 (TID 153) in 12661 ms on 10.139.64.9 (executor 10) (41/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 13.0 in stage 4.0 (TID 131) in 12674 ms on 10.139.64.9 (executor 10) (42/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 24.0 in stage 4.0 (TID 142) in 12675 ms on 10.139.64.9 (executor 10) (43/44)
18/06/25 15:44:20 INFO TaskSetManager: Finished task 2.0 in stage 4.0 (TID 120) in 12681 ms on 10.139.64.9 (executor 10) (44/44)
18/06/25 15:44:20 INFO TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool 4970588240906633332
18/06/25 15:44:20 INFO DAGScheduler: ResultStage 4 (foreach at DBUtilsCore.scala:387) finished in 12.686 s
18/06/25 15:44:20 INFO DAGScheduler: Job 4 finished: foreach at DBUtilsCore.scala:387, took 12.687760 s
18/06/25 15:44:20 INFO DatabricksFileSystemV2Factory: Creating wasbs file system for wasbs://<credential>
18/06/25 15:44:31 INFO SparkContext: Starting job: foreach at DBUtilsCore.scala:387
18/06/25 15:44:31 INFO DAGScheduler: Got job 5 (foreach at DBUtilsCore.scala:387) with 44 output partitions
18/06/25 15:44:31 INFO DAGScheduler: Final stage: ResultStage 5 (foreach at DBUtilsCore.scala:387)
18/06/25 15:44:31 INFO DAGScheduler: Parents of final stage: List()
18/06/25 15:44:31 INFO DAGScheduler: Missing parents: List()
18/06/25 15:44:31 INFO DAGScheduler: Submitting ResultStage 5 (ParallelCollectionRDD[15] at parallelize at DBUtilsCore.scala:387), which has no missing parents
18/06/25 15:44:31 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 1496.0 B, free 3.3 GB)
18/06/25 15:44:31 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 1063.0 B, free 3.3 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.12:39957 (size: 1063.0 B, free: 3.3 GB)
18/06/25 15:44:31 INFO SparkContext: Created broadcast 5 from broadcast at DAGScheduler.scala:1152
18/06/25 15:44:31 INFO DAGScheduler: Submitting 44 missing tasks from ResultStage 5 (ParallelCollectionRDD[15] at parallelize at DBUtilsCore.scala:387) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
18/06/25 15:44:31 INFO TaskSchedulerImpl: Adding task set 5.0 with 44 tasks
18/06/25 15:44:31 WARN FairSchedulableBuilder: A job was submitted with scheduler pool 4970588240906633332, which has not been configured. This can happen when the file that pools are read from isn't set, or when that file doesn't contain 4970588240906633332. Created 4970588240906633332 with default configuration (schedulingMode: FIFO, minShare: 0, weight: 1)
18/06/25 15:44:31 INFO FairSchedulableBuilder: Added task set TaskSet_5.0 tasks to pool 4970588240906633332
18/06/25 15:44:31 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 162, 10.139.64.6, executor 4, partition 0, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 163, 10.139.64.9, executor 10, partition 1, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 2.0 in stage 5.0 (TID 164, 10.139.64.5, executor 2, partition 2, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 3.0 in stage 5.0 (TID 165, 10.139.64.14, executor 8, partition 3, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 4.0 in stage 5.0 (TID 166, 10.139.64.16, executor 6, partition 4, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 5.0 in stage 5.0 (TID 167, 10.139.64.24, executor 5, partition 5, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 6.0 in stage 5.0 (TID 168, 10.139.64.28, executor 3, partition 6, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 7.0 in stage 5.0 (TID 169, 10.139.64.23, executor 0, partition 7, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 8.0 in stage 5.0 (TID 170, 10.139.64.27, executor 1, partition 8, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 9.0 in stage 5.0 (TID 171, 10.139.64.11, executor 11, partition 9, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 10.0 in stage 5.0 (TID 172, 10.139.64.15, executor 7, partition 10, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 11.0 in stage 5.0 (TID 173, 10.139.64.6, executor 4, partition 11, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 12.0 in stage 5.0 (TID 174, 10.139.64.9, executor 10, partition 12, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 13.0 in stage 5.0 (TID 175, 10.139.64.5, executor 2, partition 13, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 14.0 in stage 5.0 (TID 176, 10.139.64.14, executor 8, partition 14, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 15.0 in stage 5.0 (TID 177, 10.139.64.16, executor 6, partition 15, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 16.0 in stage 5.0 (TID 178, 10.139.64.24, executor 5, partition 16, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 17.0 in stage 5.0 (TID 179, 10.139.64.28, executor 3, partition 17, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 18.0 in stage 5.0 (TID 180, 10.139.64.23, executor 0, partition 18, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 19.0 in stage 5.0 (TID 181, 10.139.64.27, executor 1, partition 19, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 20.0 in stage 5.0 (TID 182, 10.139.64.11, executor 11, partition 20, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 21.0 in stage 5.0 (TID 183, 10.139.64.15, executor 7, partition 21, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 22.0 in stage 5.0 (TID 184, 10.139.64.6, executor 4, partition 22, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 23.0 in stage 5.0 (TID 185, 10.139.64.9, executor 10, partition 23, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 24.0 in stage 5.0 (TID 186, 10.139.64.5, executor 2, partition 24, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 25.0 in stage 5.0 (TID 187, 10.139.64.14, executor 8, partition 25, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 26.0 in stage 5.0 (TID 188, 10.139.64.16, executor 6, partition 26, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 27.0 in stage 5.0 (TID 189, 10.139.64.24, executor 5, partition 27, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 28.0 in stage 5.0 (TID 190, 10.139.64.28, executor 3, partition 28, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 29.0 in stage 5.0 (TID 191, 10.139.64.23, executor 0, partition 29, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 30.0 in stage 5.0 (TID 192, 10.139.64.27, executor 1, partition 30, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 31.0 in stage 5.0 (TID 193, 10.139.64.11, executor 11, partition 31, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 32.0 in stage 5.0 (TID 194, 10.139.64.15, executor 7, partition 32, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 33.0 in stage 5.0 (TID 195, 10.139.64.6, executor 4, partition 33, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 34.0 in stage 5.0 (TID 196, 10.139.64.9, executor 10, partition 34, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 35.0 in stage 5.0 (TID 197, 10.139.64.5, executor 2, partition 35, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 36.0 in stage 5.0 (TID 198, 10.139.64.14, executor 8, partition 36, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 37.0 in stage 5.0 (TID 199, 10.139.64.16, executor 6, partition 37, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 38.0 in stage 5.0 (TID 200, 10.139.64.24, executor 5, partition 38, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 39.0 in stage 5.0 (TID 201, 10.139.64.28, executor 3, partition 39, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 40.0 in stage 5.0 (TID 202, 10.139.64.23, executor 0, partition 40, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 41.0 in stage 5.0 (TID 203, 10.139.64.27, executor 1, partition 41, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 42.0 in stage 5.0 (TID 204, 10.139.64.11, executor 11, partition 42, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO TaskSetManager: Starting task 43.0 in stage 5.0 (TID 205, 10.139.64.15, executor 7, partition 43, PROCESS_LOCAL, 5417 bytes)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.24:38457 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.28:46459 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.23:38565 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.5:38301 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.27:44133 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.6:46573 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.11:39261 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.14:34565 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.9:40775 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.16:43793 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:31 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on 10.139.64.15:39595 (size: 1063.0 B, free: 3.6 GB)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 41.0 in stage 5.0 (TID 203) in 10061 ms on 10.139.64.27 (executor 1) (1/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 27.0 in stage 5.0 (TID 189) in 10068 ms on 10.139.64.24 (executor 5) (2/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 162) in 10075 ms on 10.139.64.6 (executor 4) (3/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 28.0 in stage 5.0 (TID 190) in 10074 ms on 10.139.64.28 (executor 3) (4/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 35.0 in stage 5.0 (TID 197) in 10074 ms on 10.139.64.5 (executor 2) (5/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 9.0 in stage 5.0 (TID 171) in 10081 ms on 10.139.64.11 (executor 11) (6/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 33.0 in stage 5.0 (TID 195) in 10080 ms on 10.139.64.6 (executor 4) (7/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 38.0 in stage 5.0 (TID 200) in 10079 ms on 10.139.64.24 (executor 5) (8/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 2.0 in stage 5.0 (TID 164) in 10086 ms on 10.139.64.5 (executor 2) (9/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 6.0 in stage 5.0 (TID 168) in 10086 ms on 10.139.64.28 (executor 3) (10/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 24.0 in stage 5.0 (TID 186) in 10086 ms on 10.139.64.5 (executor 2) (11/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 11.0 in stage 5.0 (TID 173) in 10088 ms on 10.139.64.6 (executor 4) (12/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 39.0 in stage 5.0 (TID 201) in 10086 ms on 10.139.64.28 (executor 3) (13/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 5.0 in stage 5.0 (TID 167) in 10092 ms on 10.139.64.24 (executor 5) (14/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 17.0 in stage 5.0 (TID 179) in 10092 ms on 10.139.64.28 (executor 3) (15/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 16.0 in stage 5.0 (TID 178) in 10093 ms on 10.139.64.24 (executor 5) (16/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 13.0 in stage 5.0 (TID 175) in 10096 ms on 10.139.64.5 (executor 2) (17/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 20.0 in stage 5.0 (TID 182) in 10097 ms on 10.139.64.11 (executor 11) (18/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 23.0 in stage 5.0 (TID 185) in 10096 ms on 10.139.64.9 (executor 10) (19/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 31.0 in stage 5.0 (TID 193) in 10099 ms on 10.139.64.11 (executor 11) (20/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 42.0 in stage 5.0 (TID 204) in 10100 ms on 10.139.64.11 (executor 11) (21/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 29.0 in stage 5.0 (TID 191) in 10105 ms on 10.139.64.23 (executor 0) (22/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 18.0 in stage 5.0 (TID 180) in 10106 ms on 10.139.64.23 (executor 0) (23/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 19.0 in stage 5.0 (TID 181) in 10107 ms on 10.139.64.27 (executor 1) (24/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 22.0 in stage 5.0 (TID 184) in 10115 ms on 10.139.64.6 (executor 4) (25/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 34.0 in stage 5.0 (TID 196) in 10114 ms on 10.139.64.9 (executor 10) (26/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 3.0 in stage 5.0 (TID 165) in 10117 ms on 10.139.64.14 (executor 8) (27/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 25.0 in stage 5.0 (TID 187) in 10116 ms on 10.139.64.14 (executor 8) (28/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 30.0 in stage 5.0 (TID 192) in 10116 ms on 10.139.64.27 (executor 1) (29/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 14.0 in stage 5.0 (TID 176) in 10119 ms on 10.139.64.14 (executor 8) (30/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 8.0 in stage 5.0 (TID 170) in 10121 ms on 10.139.64.27 (executor 1) (31/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 163) in 10121 ms on 10.139.64.9 (executor 10) (32/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 7.0 in stage 5.0 (TID 169) in 10126 ms on 10.139.64.23 (executor 0) (33/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 40.0 in stage 5.0 (TID 202) in 10122 ms on 10.139.64.23 (executor 0) (34/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 36.0 in stage 5.0 (TID 198) in 10125 ms on 10.139.64.14 (executor 8) (35/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 12.0 in stage 5.0 (TID 174) in 10134 ms on 10.139.64.9 (executor 10) (36/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 26.0 in stage 5.0 (TID 188) in 10139 ms on 10.139.64.16 (executor 6) (37/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 37.0 in stage 5.0 (TID 199) in 10137 ms on 10.139.64.16 (executor 6) (38/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 4.0 in stage 5.0 (TID 166) in 10146 ms on 10.139.64.16 (executor 6) (39/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 32.0 in stage 5.0 (TID 194) in 10146 ms on 10.139.64.15 (executor 7) (40/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 43.0 in stage 5.0 (TID 205) in 10147 ms on 10.139.64.15 (executor 7) (41/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 15.0 in stage 5.0 (TID 177) in 10156 ms on 10.139.64.16 (executor 6) (42/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 21.0 in stage 5.0 (TID 183) in 10165 ms on 10.139.64.15 (executor 7) (43/44)
18/06/25 15:44:41 INFO TaskSetManager: Finished task 10.0 in stage 5.0 (TID 172) in 10171 ms on 10.139.64.15 (executor 7) (44/44)
18/06/25 15:44:41 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool 4970588240906633332
18/06/25 15:44:41 INFO DAGScheduler: ResultStage 5 (foreach at DBUtilsCore.scala:387) finished in 10.176 s
18/06/25 15:44:41 INFO DAGScheduler: Job 5 finished: foreach at DBUtilsCore.scala:387, took 10.177711 s
18/06/25 15:44:41 INFO DatabricksFileSystemV2Factory: Creating generic file system for adl://<IP>
18/06/25 15:44:42 INFO MicroBatchExecution: Starting [id = 3f8c7718-c90f-476f-85c3-26926063ffb8, runId = 34a38e60-56df-4d39-8958-a4d2f150b4ef]. Use dbfs:/mnt/mydata/eventhub/prod/mycheckpointfolder to store the query checkpoint.
18/06/25 15:44:42 INFO DatabricksStreamingQueryListener: Streaming query started: [id=3f8c7718-c90f-476f-85c3-26926063ffb8, runId=34a38e60-56df-4d39-8958-a4d2f150b4ef]
18/06/25 15:44:42 INFO TriggerProgressListener: Query started: 3f8c7718-c90f-476f-85c3-26926063ffb8
18/06/25 15:44:42 WARN EventHubsConf: eventhubs.connectionstring has already been set to Endpoint=sb://<IP>;EntityPath=<PATH>;SharedAccessKeyName=listener;SharedAccessKey=<KEY>=. Overwriting with Endpoint=sb://<IP>;EntityPath=<PATH>;SharedAccessKeyName=listener;SharedAccessKey=<KEY>=
18/06/25 15:44:42 INFO ClientConnectionPool: Borrowing client. EventHub name: <PATH>
18/06/25 15:44:42 INFO ClientConnectionPool: Available clients: {0}. Total clients: 1
18/06/25 15:44:42 INFO ProgressReporter$: Removed result fetcher for 4970588240906633332_8225354569939210617_job-10-run-8-action-32
18/06/25 15:44:42 INFO DatabricksStreamingQueryListener: Registering stream [id=3f8c7718-c90f-476f-85c3-26926063ffb8, runId=34a38e60-56df-4d39-8958-a4d2f150b4ef] for commandId Some(4970588240906633332_8225354569939210617_job-10-run-8-action-32)
18/06/25 15:44:42 INFO ReceiveLinkHandler: linkName[mgmt:receiver], localSource[Source{address='$management', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter=null, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:43 INFO ConnectionHandler: onConnectionRemoteOpen: hostname[IP]
18/06/25 15:44:43 INFO SessionHandler: entityName[mgmt-session], sessionIncCapacity[0], sessionOutgoingWindow[2147483647]
18/06/25 15:44:43 INFO SendLinkHandler: linkName[mgmt:sender], remoteTarget[Target{address='$management', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, capabilities=null}]
18/06/25 15:44:43 INFO ReceiveLinkHandler: linkName[mgmt:receiver], remoteSource[Source{address='$management', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter=null, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:43 INFO MicroBatchExecution: Starting new streaming query.
18/06/25 15:44:43 INFO EventHubsClient: translate: useStart is set to true.
18/06/25 15:44:43 INFO EventHubsClient: translate: PerPartitionPositions = ParMap()
18/06/25 15:44:43 INFO EventHubsClient: translate: Default position = EventPosition(null,-1,Mon Jun 25 12:00:00 UTC 2018,true)
18/06/25 15:44:43 INFO EventHubsClient: translate: needsTranslation = ArrayBuffer({"ehName":"PATH","partitionId":0}, {"ehName":"PATH","partitionId":1}, {"ehName":"PATH","partitionId":2}, {"ehName":"PATH","partitionId":16}, {"ehName":"PATH","partitionId":3}, {"ehName":"PATH","partitionId":17}, {"ehName":"PATH","partitionId":4}, {"ehName":"PATH","partitionId":18}, {"ehName":"PATH","partitionId":5}, {"ehName":"PATH","partitionId":19}, {"ehName":"PATH","partitionId":20}, {"ehName":"PATH","partitionId":21}, {"ehName":"PATH","partitionId":22}, {"ehName":"PATH","partitionId":23}, {"ehName":"PATH","partitionId":24}, {"ehName":"PATH","partitionId":25}, {"ehName":"PATH","partitionId":26}, {"ehName":"PATH","partitionId":27}, {"ehName":"PATH","partitionId":28}, {"ehName":"PATH","partitionId":29}, {"ehName":"PATH","partitionId":30}, {"ehName":"PATH","partitionId":31}, {"ehName":"PATH","partitionId":6}, {"ehName":"PATH","partitionId":12}, {"ehName":"PATH","partitionId":7}, {"ehName":"PATH","partitionId":13}, {"ehName":"PATH","partitionId":14}, {"ehName":"PATH","partitionId":15}, {"ehName":"PATH","partitionId":10}, {"ehName":"PATH","partitionId":11}, {"ehName":"PATH","partitionId":8}, {"ehName":"PATH","partitionId":9})
18/06/25 15:44:43 INFO EventHubsClient: translate: Starting threads to translate to sequence number.
18/06/25 15:44:43 INFO ReceiveLinkHandler: linkName[cbs:receiver], localSource[Source{address='$cbs', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter=null, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:44 INFO SessionHandler: entityName[cbs-session], sessionIncCapacity[0], sessionOutgoingWindow[2147483647]
18/06/25 15:44:44 INFO SendLinkHandler: linkName[cbs:sender], remoteTarget[Target{address='$cbs', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, capabilities=null}]
18/06/25 15:44:44 INFO ReceiveLinkHandler: linkName[cbs:receiver], remoteSource[Source{address='$cbs', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter=null, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:44 INFO SessionHandler: entityName[PATH/ConsumerGroups/$Default/Partitions/0], sessionIncCapacity[0], sessionOutgoingWindow[2147483647]
18/06/25 15:44:44 INFO PartitionReceiverImpl: receiverPath[RECEIVER IS NULL], action[createReceiveLink], offset[null], sequenceNumber[null], enqueuedTime[1529928000000], inclusiveFlag[null]
18/06/25 15:44:44 INFO ReceiveLinkHandler: linkName[5de723_fac_G26_1529941484967], localSource[Source{address='PATH/ConsumerGroups/$Default/Partitions/0', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter={apache.org:selector-filter:string=UnknownDescribedType{descriptor=apache.org:selector-filter:string, described=amqp.annotation.x-opt-enqueued-time > '1529928000000'}}, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:45 INFO SessionHandler: entityName[PATH/ConsumerGroups/$Default/Partitions/2], sessionIncCapacity[0], sessionOutgoingWindow[2147483647]
18/06/25 15:44:45 INFO PartitionReceiverImpl: receiverPath[RECEIVER IS NULL], action[createReceiveLink], offset[null], sequenceNumber[null], enqueuedTime[1529928000000], inclusiveFlag[null]
18/06/25 15:44:45 INFO SessionHandler: entityName[PATH/ConsumerGroups/$Default/Partitions/1], sessionIncCapacity[0], sessionOutgoingWindow[2147483647]
18/06/25 15:44:45 INFO PartitionReceiverImpl: receiverPath[RECEIVER IS NULL], action[createReceiveLink], offset[null], sequenceNumber[null], enqueuedTime[1529928000000], inclusiveFlag[null]
18/06/25 15:44:45 INFO SessionHandler: entityName[PATH/ConsumerGroups/$Default/Partitions/16], sessionIncCapacity[0], sessionOutgoingWindow[2147483647]
.
.
..FOR ALL PARTITIONS
.
.

18/06/25 15:44:45 INFO PartitionReceiverImpl: receiverPath[RECEIVER IS NULL], action[createReceiveLink], offset[null], sequenceNumber[null], enqueuedTime[1529928000000], inclusiveFlag[null]
18/06/25 15:44:45 INFO SessionHandler: entityName[PATH/ConsumerGroups/$Default/Partitions/9], sessionIncCapacity[0], sessionOutgoingWindow[2147483647]
18/06/25 15:44:45 INFO PartitionReceiverImpl: receiverPath[RECEIVER IS NULL], action[createReceiveLink], offset[null], sequenceNumber[null], enqueuedTime[1529928000000], inclusiveFlag[null]

18/06/25 15:44:45 INFO ReceiveLinkHandler: linkName[2abf1e_fac_G26_1529941485121], localSource[Source{address='PATH/ConsumerGroups/$Default/Partitions/2', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter={apache.org:selector-filter:string=UnknownDescribedType{descriptor=apache.org:selector-filter:string, described=amqp.annotation.x-opt-enqueued-time > '1529928000000'}}, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:45 INFO ReceiveLinkHandler: linkName[6e3056_fac_G26_1529941485121], localSource[Source{address='PATH/ConsumerGroups/$Default/Partitions/1', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter={apache.org:selector-filter:string=UnknownDescribedType{descriptor=apache.org:selector-filter:string, described=amqp.annotation.x-opt-enqueued-time > '1529928000000'}}, defaultOutcome=null, outcomes=null, capabilities=null}]
.
.
..FOR ALL PARTITIONS
.
.
18/06/25 15:44:45 INFO ReceiveLinkHandler: linkName[0290aa_fac_G26_1529941485123], localSource[Source{address='PATH/ConsumerGroups/$Default/Partitions/9', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter={apache.org:selector-filter:string=UnknownDescribedType{descriptor=apache.org:selector-filter:string, described=amqp.annotation.x-opt-enqueued-time > '1529928000000'}}, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:45 INFO ReceiveLinkHandler: linkName[5de723_fac_G26_1529941484967], remoteSource[Source{address='PATH/ConsumerGroups/$Default/Partitions/0', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter={apache.org:selector-filter:string=org.apache.qpid.proton.codec.DecoderImpl$UnknownDescribedType@7bd8cc03}, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:45 INFO MessageReceiver: receiverPath[PATH/ConsumerGroups/$Default/Partitions/0], linkname[5de723_fac_G26_1529941484967], updated-link-credit[999], sentCredits[999]
18/06/25 15:44:45 INFO ReceiveLinkHandler: linkName[6e3056_fac_G26_1529941485121], remoteSource[Source{address='PATH/ConsumerGroups/$Default/Partitions/1', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter={apache.org:selector-filter:string=org.apache.qpid.proton.codec.DecoderImpl$UnknownDescribedType@44b2785b}, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:45 INFO MessageReceiver: receiverPath[PATH/ConsumerGroups/$Default/Partitions/1], linkname[6e3056_fac_G26_1529941485121], updated-link-credit[999], sentCredits[999]
.
.
..FOR ALL PARTITIONS
.
.
18/06/25 15:44:45 INFO ReceiveLinkHandler: linkName[0290aa_fac_G26_1529941485123], remoteSource[Source{address='PATH/ConsumerGroups/$Default/Partitions/9', durable=NONE, expiryPolicy=SESSION_END, timeout=0, dynamic=false, dynamicNodeProperties=null, distributionMode=null, filter={apache.org:selector-filter:string=org.apache.qpid.proton.codec.DecoderImpl$UnknownDescribedType@7e7f762e}, defaultOutcome=null, outcomes=null, capabilities=null}]
18/06/25 15:44:45 INFO MessageReceiver: receiverPath[PATH/ConsumerGroups/$Default/Partitions/9], linkname[0290aa_fac_G26_1529941485123], updated-link-credit[999], sentCredits[999]
18/06/25 15:44:46 INFO ClientEntity: close: clientId[null]
18/06/25 15:44:46 INFO ClientEntity: close: clientId[702e81]
18/06/25 15:44:46 INFO BaseHandler: linkName[6d0926_fac_G26_1529941485122]
18/06/25 15:44:46 INFO SessionHandler: entityName[PATH/ConsumerGroups/$Default/Partitions/23], condition[Error{condition=null, description='null', info=null}]
18/06/25 15:44:47 INFO ClientEntity: close: clientId[null]
18/06/25 15:44:47 INFO ClientEntity: close: clientId[010d4f]
18/06/25 15:44:47 INFO BaseHandler: linkName[5364a2_fac_G26_1529941485121]
18/06/25 15:44:47 INFO SessionHandler: entityName[PATH/ConsumerGroups/$Default/Partitions/4], condition[Error{condition=null, description='null', info=null}]
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:50 WARN EventHubsClient: translate: failed to receive event.
18/06/25 15:44:55 INFO HiveMetaStore: 1: get_database: default
18/06/25 15:44:55 INFO audit: ugi=root	ip=unknown-ip-addr	cmd=get_database: default	
18/06/25 15:44:55 INFO DatabricksFileSystemV2Factory: Creating wasbs file system for wasbs://<credential>
18/06/25 15:44:55 INFO DriverCorral: Metastore health check ok
18/06/25 15:44:55 INFO DriverCorral: DBFS health check ok

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:20 (10 by maintainers)

github_iconTop GitHub Comments

1reaction
sabeegrewalcommented, Jul 3, 2018

Yea, I just released 1.0.2 - I’m gearing up to release 2.3.2 soon. I’m not seeing any issues with enqueued time filtering in testing so far.

Everything in your build.sbt is correct too, so not sure why it’s having trouble. The way I do it is run mvn clean package, upload the JAR to Databricks, and attach it to my cluster. Then I’ll import 1.0.2 from Maven in Databricks and attach that. It works that way!

0reactions
sabeegrewalcommented, Jul 26, 2018

@profiterol81 it depends on a lot of stuff! If you tell me more about your scenario in the gitter chat, I’d be happy to help out. This issue isn’t the place for those sort of discussions 👍

Read more comments on GitHub >

github_iconTop Results From Across the Web

azure-event-hubs-spark/Lobby - Gitter
suddenly we cannot start our jobs with 2.3.2 we are having this error. Our config is pretty straightforward setStartingPosition(EventPosition.
Read more >
Google Translate
Google's service, offered free of charge, instantly translates words, phrases, and web pages between English and over 100 other languages.
Read more >
Translate - Azure Cognitive Services - Microsoft Learn
Understand the parameters, headers, and body messages for the Translate method of Azure Cognitive Services Translator to translate text.
Read more >
Google Translate's Website Translator - available for non ...
Finally, it's very important to note that while we continuously look for ways to improve the quality of our translations, they may not...
Read more >
azure - 使用MQTT从Azure IOT Hub接收消息- 堆栈内存溢出
An IoT hub can filter on these properties without access to the message body. msg. ... EventPosition; import com.microsoft.azure.eventhubs.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found
Previous page

AmqpException during streaming

Next page

Assertion failed: received sequence number doesn't match request sequence number