Preserving Partition in the Destination Cluster

Hi All, This is great work guys in addressing all the short comings of mirror maker . We are trying to see if we can replace this our current setup of mirror with uMirrorMaker before we go live . We have a strict requirement to preserve ordering of messages in destination cluster to be same as the source cluster . I was going through the code and looks like there is a message handler support . Is this the only change we need to do to get it going?

 private object defaultMirrorMakerMessageHandler extends MirrorMakerMessageHandler {
    override def handle(record: MessageAndMetadata[Array[Byte], Array[Byte]]): util.List[ProducerRecord[Array[Byte], Array[Byte]]] = {
      // rewrite topic between consuming side and producing side
      val topic = topicMappings.get(record.topic).getOrElse(record.topic)
//Changed to include source partition information
      Collections.singletonList(new ProducerRecord[Array[Byte], Array[Byte]](topic, record.partition(),record.key(), record.message()))
    }
  }

Also do you guys have any plans on enabling this as a run time parameter so that we can override it.

[xhl1988]

If #partition in src is bigger than #partition in dst temporarily, worker will hash the partition into dst. After you expand in dst, it will go back to 1:1 mapping again.

[xhl1988]

@daluu No. We have merged federated ureplicator into master and current master supports both modes.