question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

ERROR Error registering metrics! (com.uber.stream.kafka.mirrormaker.controller.validation.ValidationManager:266) java.lang.NullPointerException

See original GitHub issue

When running the controller, after a few minute I see this:

ERROR Error registering metrics! (com.uber.stream.kafka.mirrormaker.controller.validation.ValidationManager:266)
java.lang.NullPointerException
	at com.uber.stream.kafka.mirrormaker.controller.validation.ValidationManager.updatePerWorkerISMetrics(ValidationManager.java:263)
	at com.uber.stream.kafka.mirrormaker.controller.validation.ValidationManager.validateExternalView(ValidationManager.java:205)
	at com.uber.stream.kafka.mirrormaker.controller.validation.ValidationManager$1.run(ValidationManager.java:82)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)

Configuration is as follows:

[2019-01-06 10:13:29,732] INFO Trying to init ControllerStarter with config:
{
	kafka.source.clusters :
	kafka.destination.clusters :
	federated.enabled : false
	federated.deployment.name :
	controller.helix.cluster.name : ureplicator
	controller.zk.str : zookeeper.ureplicator.svc.cluster.local:2181
	controller.port : 9000
	controller.mode : auto
	controller.instance.id : ureplicator-controller-6977f88fb8-95jhl
	controller.environment : dev
	controller.graphite.host : prometheus-graphite-exporter.monitoring.svc.cluster.local
	controller.graphite.port : 9109
	controller.metrics.prefix : kafka-mirror-maker-controller
	controller.c3.host : localhost
	controller.c3.port : 0
	controller.enable.auto.whitelist : true
	controller.enable.auto.topic.expansion : true
	controller.pattern.exclude.topics : __consumer_offsets
	controller.srckafka.zkStr : 18.209.172.99:2181
	controller.destkafka.zkStr : zookeeper.kafka-destination.svc.cluster.local:2181
	controller.max.working.instances : 0
	controller.auto.rebalance.delay.in.seconds : 120
	controller.refresh.time.in.seconds : 20
	controller.init.wait.time.in.seconds : 10
	controller.auto.rebalance.period.in.seconds : 0
	controller.auto.rebalance.min.interval.in.seconds : 600
	controller.auto.rebalance.min.lag.in.seconds : 900
	controller.auto.rebalance.min.lag.offset : 100000
	controller.auto.rebalance.max.offset.valid.in.seconds : 1800
	controller.workload.refresh.period.in.seconds : 600
	controller.auto.rebalance.workload.ratio.threshold : 1.2
	controller.auto.rebalance.max.dedicated.ratio : 0.5
	controller.auto.rebalance.max.stuck.partition.movements : 3
	controller.auto.rebalance.move.stuck.partition.after.minutes : 20
	controller.num.offset.thread : 10
	controller.blocking.queue.size : 30000
	controller.offset.refresh.interval.in.sec : 300
	controller.backup.to.git : false
	controller.local.backup.file.path : /tmp/uReplicator-controller
	config.file :
}
 (com.uber.stream.kafka.mirrormaker.controller.ControllerStarter:63)

I hope this information is enough.

The version is built form master, using my own built docker image rantav/ureplicator:4790496

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Comments:6 (2 by maintainers)

github_iconTop GitHub Comments

1reaction
xhl1988commented, Jan 6, 2019

It’s not a bug but we required that information/format as the prefix of the metrics. We will make it not a hard requirement or make it more clear.

0reactions
yangy0000commented, Feb 1, 2019

Fixed #200

Read more comments on GitHub >

github_iconTop Results From Across the Web

com.uber.stream.kafka.mirrormaker.controller.validation ... - Tabnine
getRegistry().register( getIdealStatePerWorkMetricName(worker), workCounter); } catch (Exception e) { LOGGER.error("Error registering metrics!
Read more >
Kafka Metrics NullPointerException in Kafka Streams App
It seems that the org.apache.kafka.streams.KafkaStreams.metrics(KafkaStreams.java:545) call fails which seems to be a Kafka client issue not ...
Read more >
Kafka MirrorMaker error - Cloudera Community - 203601
Solved: Hi All,I'm trying to transfer data between kafka clusters using Kafka MirrorMaker & running into - 203601.
Read more >
Release Notes
Release Notes - Kafka - Version 0.9.0.0. Sub-task. [KAFKA-1316] - Refactor Sender; [KAFKA-1328] - Add new consumer APIs; [KAFKA-1329] - Add metadata fetch ......
Read more >
uReplicator: Uber Engineering's Robust Apache Kafka ...
MirrorMaker (as part of Kafka 0.8.2) itself is quite simple. It uses a high-level Kafka consumer to fetch the data from the source...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found