question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Connect File Pulse plugin is not loading

See original GitHub issue

I am trying to install filepilse-2.4.1 but not getting the plugin loaded. I am using a Centos which is a unix OS. Also if it matters I am using a vanilla Kafka. Not a Confluent Platform and Not a Docker.

What I have done:

  1. I have downloaded the zip file from github for version 2.4.1.
  2. Unzipped the filepuse-2.4.1. and added the path to my connect.properties file like so: plugin.path=/opt/filepulse-path
  3. Restarted my Kafka connect.
  4. Checked to see if the Connect File Pulse plugin is correctly loaded: $ curl -sX GET http://localhost:8083/connector-plugins | grep FilePulseSourceConnector

Result: Nothing is showing up. I also tried to run this: $ curl -sX GET http://localhost:8083/connector-plugins and I am able to see some of the other connectors.

Am I missing something or doing something wrong? I would appreciate any input/suggestions.

Thank you!

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:6 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
dmarupovcommented, Dec 22, 2021

Just an update: after updating the Java version to 11 I am able to see the FilePulse plugin now. Thank you all for the help.

0reactions
slachiewiczcommented, Dec 22, 2021
  1. Please create dedicated directory for plugins (ie /usr/share/confluent-hub-components)
  2. create new subdirectory streamthoughts-kafka-connect-file-pulse
  3. unzip connector to the above directory
  4. Modify kafka-connect settings to include path to plugins to include parent path
plugin.path=/usr/share/java,/usr/share/confluent-hub-components
[root@264be6190212 streamthoughts-kafka-connect-file-pulse]# pwd
/usr/share/confluent-hub-components/streamthoughts-kafka-connect-file-pulse
[root@264be6190212 streamthoughts-kafka-connect-file-pulse]# ls
assets  doc  etc  lib  manifest.json

Then start Connect and check logs - You should be able to see something like

[2021-12-22 17:09:02,537] INFO Loading plugin from: /usr/share/confluent-hub-components/streamthoughts-kafka-connect-file-pulse (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:246)
[2021-12-22 17:09:03,550] INFO Registered loader: PluginClassLoader{pluginLocation=file:/usr/share/confluent-hub-components/streamthoughts-kafka-connect-file-pulse/} (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:269)
[2021-12-22 17:09:03,550] INFO Added plugin 'io.streamthoughts.kafka.connect.filepulse.source.FilePulseSourceConnector' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:198)
[2021-12-22 17:09:03,550] INFO Added plugin 'io.streamthoughts.kafka.connect.transform.Grok$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:198)
[2021-12-22 17:09:03,551] INFO Added plugin 'io.streamthoughts.kafka.connect.transform.Grok$Key' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:198)
Read more comments on GitHub >

github_iconTop Results From Across the Web

File Pulse Connector is installed but getting error that class not ...
yes , I did restart the connect-worker after installing the plugin and its running in stand alone mode . The worker is configured...
Read more >
kafka-connect file-pulse connector standalone could not start ...
I found the plugin. path property for the 'file-pulse' connector has to be the parent folder of the jar files. so below worked....
Read more >
Installation | Kafka Connect File Pulse - GitHub Pages
How to install Connect File Pulse. Connect FilePulse can be installed either from GitHub Releases Page or from Confluent Hub.
Read more >
Pulse secure dose not load the connection windows....
When launching Pulse secure the software opens with no connection windows and dose not allow you to click on file to add connections....
Read more >
FilePulse Source Connector | Confluent Hub
The Kafka Connect FilePulse Connector is a powerful source connector that makes it easy to parse, transform, and load data from the local...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found