Running EventHubsStructuredStreamingExample in cluster: cannot find data source "eventhubs"
See original GitHub issueWhen submitting a simple job with just the sample code included, I seem to always get the following error on runtime when val inputStream = sparkSession.readStream.format("eventhubs").options(eventhubParameters).load()
executes:
java.lang.ClassNotFoundException: Failed to find data source: eventhubs. Please find packages at http://spark.apache.org/third-party-projects.html
Any ideas on how to get the sample code EventHubsStructuredStreamingExample
working?
Issue Analytics
- State:
- Created 6 years ago
- Comments:5 (2 by maintainers)
Top Results From Across the Web
Spark job with eventhubs in Databricks ends: Failed to find ...
Bug Report: When running the following spark job in Databricks: val df ... ClassNotFoundException: Failed to find data source: eventhubs.
Read more >Troubleshoot connectivity issues - Azure Event Hubs
This article provides information on troubleshooting connectivity issues with Azure Event Hubs.
Read more >Could not instantiate EventHubSourceProvider for Azure ...
Install com.microsoft.azure:azure-eventhubs-spark_2.11:2.3.15 library version from Maven Central; Restart cluster; Validate by re-running code ...
Read more >Azure Event Hubs data source discovery
When running a discovery against an Azure Event Hub namespace defined within your Data source configuration, you can specify query parameters to ...
Read more >Azure Event Hubs | Databricks on AWS
Learn how to use Azure Event Hubs as a source and sink for streaming data in Databricks.
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
@sabeegrewal that was absolutely it, works now. thanks very much for your help. 👍
It needs to be like this:
So, instead of
spark-streaming-eventhubs_connector_2.11
, you wanna dospark-streaming-eventhubs_2.11
. Let me know if that works!