Receiving org.apache.storm.utils.NimbusLeaderNotFoundException as executed CrawlTopology
See original GitHub issueI created new StormCrawler-based project by following steps described in I. Without modifying crawler-confer.yaml, I executed CrawlTopology.java which comes with the project and then I received error as below:
org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [localhost]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?
at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:90)
at org.apache.storm.StormSubmitter.topologyNameExists(StormSubmitter.java:371)
at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:233)
at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:311)
at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:157)
at com.digitalpebble.stormcrawler.ConfigurableTopology.submit(ConfigurableTopology.java:85)
at com.mycompany.crawler.CrawlTopology.run(CrawlTopology.java:68)
at com.digitalpebble.stormcrawler.ConfigurableTopology.start(ConfigurableTopology.java:50)
at com.mycompany.crawler.CrawlTopology.main(CrawlTopology.java:38)
I searched Google what the problem causes, it seems related Zookeper. But I am using Tomcat server. What should I do for preventing this error?
Issue Analytics
- State:
- Created 7 years ago
- Comments:5 (3 by maintainers)
Top Results From Across the Web
Solved: Storm Nimbus is not running in HDF cluster
i am getting error message as " org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [hostname]. Did you specify a ...
Read more >[StormCrawler] Crawl and get websites content in WARC ...
org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [localhost]. Did you specify a valid list of nimbus hosts ...
Read more >Storm Starter 1.2.2 example does not run ... - Stack Overflow
Looking at the code, it seems that any parameters passed into the program will try to startup in a clustered and not stand...
Read more >Tutorial - Apache Storm
In this tutorial, you'll learn how to create Storm topologies and deploy them to a Storm cluster. ... This runs the class org.apache.storm....
Read more >Processing real-time data with Storm, Kafka and ElasticSearch
Apache Storm is a distributed, real-time computational framework donated ... Execution is performed in a Storm cluster (it is superficially ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Add
-local and conf crawler-conf.yaml
as argument to the topology class. You don’t have to run it with Storm, it works with Eclipse. If local is not specified, it tries to connect to a Storm cluster and since you haven’t installed one you are getting this error@sebastian-nagel that wiki page needs fixing. Running with mvn-exec does not work, see #324
The README file generated by the archetype contains the correct instructions i.e run it with Storm installed (but it also works with Eclipse and is a good way of debugging)