Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Graceful stop of task error, scheduled files are not cleared and therefore block listing file system

See original GitHub issue

Hi, I have built and installed this connect plugin as of the latest master via confluent-hub install. However, it stops working and I notice an idle task is created in first place now. However, it fails to be restarted/stopped gracefully with logs as below.

2021-09-20 03:47:11,018] INFO Creating new tasks configurations (maxTasks=1) (io.streamthoughts.kafka.connect.filepulse.source.FilePulseSourceConnector)
2021-09-20 03:47:11,018] INFO Preparing next scheduling using the object files found during last iteration (attempt=1/3). (io.streamthoughts.kafka.connect.filepulse.fs.DefaultFileSystemMonitor)
2021-09-20 03:47:11,464] INFO Created config for task_id=0 with '1' object files (task_config_gen=1). (io.streamthoughts.kafka.connect.filepulse.source.FilePulseSourceConnector)
2021-09-20 03:47:11,472] INFO [Worker clientId=connect-1, groupId=kafka-connect] Tasks [azure-blob-poc-0] configs updated (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
2021-09-20 03:47:11,472] INFO [Worker clientId=connect-1, groupId=kafka-connect] Handling task config update by restarting tasks [azure-blob-poc-0] (org.apache.kafka.connect.runtime.distributed.DistributedHerder)
2021-09-20 03:47:11,472] INFO Stopping task azure-blob-poc-0 (org.apache.kafka.connect.runtime.Worker)
2021-09-20 03:47:16,472] ERROR Graceful stop of task azure-blob-poc-0 failed. (org.apache.kafka.connect.runtime.Worker)

However, the listing does continue to work once. By once, I mean it ended with a uncleaned state and stuck catching up other files in the file system, even it’s completed

2021-09-20 03:48:16,496] INFO Committed offset for file: [uri=https://<redacted>.blob.core.windows.net/file-pulse-poc/Equities_oneliner.csv, name='Equities_oneliner.csv', contentLength=163, lastModified=1632109624000, contentDigest=null, userDefinedMetadata={azure.blob.storage.contentType=text/csv, azure.blob.storage.creationTime=1632109624000, azure.blob.storage.blobUrl=https://<redacted>.blob.core.windows.net/file-pulse-poc/Equities_oneliner.csv, azure.blob.storage.account=<redacted>}] (io.streamthoughts.kafka.connect.filepulse.source.FilePulseSourceTask)
2021-09-20 03:48:20,897] INFO Scheduled files still being processed: 1. Skip filesystem listing while waiting for tasks completion (io.streamthoughts.kafka.connect.filepulse.fs.DefaultFileSystemMonitor)
2021-09-20 03:48:20,897] INFO Completed filesystem monitoring iteration in 0 ms (io.streamthoughts.kafka.connect.filepulse.source.FileSystemMonitorThread)
2021-09-20 03:48:30,897] INFO Scheduled files still being processed: 1. Skip filesystem listing while waiting for tasks completion (io.streamthoughts.kafka.connect.filepulse.fs.DefaultFileSystemMonitor)
2021-09-20 03:48:30,897] INFO Completed filesystem monitoring iteration in 0 ms (io.streamthoughts.kafka.connect.filepulse.source.FileSystemMonitorThread)