question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Receiving org.apache.storm.utils.NimbusLeaderNotFoundException as executed CrawlTopology

See original GitHub issue

I created new StormCrawler-based project by following steps described in I. Without modifying crawler-confer.yaml, I executed CrawlTopology.java which comes with the project and then I received error as below:

org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [localhost]. Did you specify a valid list of nimbus hosts for config nimbus.seeds?
	at org.apache.storm.utils.NimbusClient.getConfiguredClientAs(NimbusClient.java:90)
	at org.apache.storm.StormSubmitter.topologyNameExists(StormSubmitter.java:371)
	at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:233)
	at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:311)
	at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:157)
	at com.digitalpebble.stormcrawler.ConfigurableTopology.submit(ConfigurableTopology.java:85)
        at com.mycompany.crawler.CrawlTopology.run(CrawlTopology.java:68)
	at com.digitalpebble.stormcrawler.ConfigurableTopology.start(ConfigurableTopology.java:50)
	at com.mycompany.crawler.CrawlTopology.main(CrawlTopology.java:38)

I searched Google what the problem causes, it seems related Zookeper. But I am using Tomcat server. What should I do for preventing this error?

Issue Analytics

  • State:closed
  • Created 7 years ago
  • Comments:5 (3 by maintainers)

github_iconTop GitHub Comments

3reactions
jniochecommented, Feb 2, 2017

Add -local and conf crawler-conf.yaml as argument to the topology class. You don’t have to run it with Storm, it works with Eclipse. If local is not specified, it tries to connect to a Storm cluster and since you haven’t installed one you are getting this error

1reaction
jniochecommented, Feb 2, 2017

@sebastian-nagel that wiki page needs fixing. Running with mvn-exec does not work, see #324

The README file generated by the archetype contains the correct instructions i.e run it with Storm installed (but it also works with Eclipse and is a good way of debugging)

Read more comments on GitHub >

github_iconTop Results From Across the Web

Solved: Storm Nimbus is not running in HDF cluster
i am getting error message as " org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [hostname]. Did you specify a ...
Read more >
[StormCrawler] Crawl and get websites content in WARC ...
org.apache.storm.utils.NimbusLeaderNotFoundException: Could not find leader nimbus from seed hosts [localhost]. Did you specify a valid list of nimbus hosts ...
Read more >
Storm Starter 1.2.2 example does not run ... - Stack Overflow
Looking at the code, it seems that any parameters passed into the program will try to startup in a clustered and not stand...
Read more >
Tutorial - Apache Storm
In this tutorial, you'll learn how to create Storm topologies and deploy them to a Storm cluster. ... This runs the class org.apache.storm....
Read more >
Processing real-time data with Storm, Kafka and ElasticSearch
Apache Storm is a distributed, real-time computational framework donated ... Execution is performed in a Storm cluster (it is superficially ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found