Question: Is there a plan for transactions for the producer?

Is there a plan for a transactions for the producer?

Something like the following:

producer.beginTransaction();
  for (ConsumerRecord record : records)
    producer.send(producerRecord(“outputTopic”, record));
  producer.sendOffsetsToTransaction(currentOffsets(consumer), group);  
  producer.commitTransaction();

Referenced from: https://www.confluent.io/blog/transactions-apache-kafka/

We are in need of this, and we are seeing if we should do a quick workaround or if we should wait. Unless someone can guide us on what that could look like, we might be able to contribute.

[edenhill]

@noahdav The implementation is pretty much complete and we have full transactional functionality. We’re currently working on writing tests, there’s a lot of intricate error cases that needs proper handling.

We really do appreciate your help; I believe the most valuable thing right now is testing, in particular to cover real world use-cases. So my suggestion would be for you to start using the new transactional API in your applications and report back any issues you may find.

The txns branch is not yet ready for wider use but it will be cleaned up this week and should be ready to go by next monday.

[noahdav]

@edenhill please let us know when we can start testing with this branch.