Issue when using Kafka File Load Generator Config

Hi all, I use the plugin to send Avro-Kafka records. With the schema registry it works fine, great plugin.

Unfortunately loading Avro-schemes via file does not work for me. I use the Example-Test-Plan.jmx and replaced the Kafka Load Generator Config with a Kafka File Load Generator Config element.

This leads to the following error messages:

Error 1:

2020-06-08 14:17:26,190 ERROR n.c.k.l.i.AvroLoadGenerator: Please make sure that properties data type and expression function return type are compatible with each other
io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException: Subject not found.; error code: 40401
	at io.confluent.kafka.schemaregistry.client.rest.RestService.sendHttpRequest(RestService.java:230) ~[kloadgen-1.5.0.jar:?]
	at io.confluent.kafka.schemaregistry.client.rest.RestService.httpRequest(RestService.java:256) ~[kloadgen-1.5.0.jar:?]
	at io.confluent.kafka.schemaregistry.client.rest.RestService.getLatestVersion(RestService.java:515) ~[kloadgen-1.5.0.jar:?]
	at io.confluent.kafka.schemaregistry.client.rest.RestService.getLatestVersion(RestService.java:507) ~[kloadgen-1.5.0.jar:?]
	at io.confluent.kafka.schemaregistry.client.CachedSchemaRegistryClient.getLatestSchemaMetadata(CachedSchemaRegistryClient.java:275) ~[kloadgen-1.5.0.jar:?]
	at net.coru.kloadgen.input.AvroSchemaProcessor.getSchemaBySubject(AvroSchemaProcessor.java:266) ~[kloadgen-1.5.0.jar:?]
	at net.coru.kloadgen.input.AvroSchemaProcessor.<init>(AvroSchemaProcessor.java:86) ~[kloadgen-1.5.0.jar:?]
	at net.coru.kloadgen.loadgen.impl.AvroLoadGenerator.<init>(AvroLoadGenerator.java:18) [kloadgen-1.5.0.jar:?]
	at net.coru.kloadgen.config.fileserialized.FileSerializedConfigElement.iterationStart(FileSerializedConfigElement.java:39) [kloadgen-1.5.0.jar:?]
	at org.apache.jmeter.control.GenericController.fireIterationStart(GenericController.java:399) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.control.GenericController.fireIterEvents(GenericController.java:391) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.control.GenericController.next(GenericController.java:160) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.control.LoopController.next(LoopController.java:135) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.threads.AbstractThreadGroup.next(AbstractThreadGroup.java:92) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.threads.JMeterThread.run(JMeterThread.java:255) [ApacheJMeter_core.jar:5.2.1]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_252]

Error 2:

2020-06-08 14:17:26,191 ERROR n.c.k.c.f.FileSerializedConfigElement: Failed to create AvroLoadGenerator instance
net.coru.kloadgen.exception.KLoadGenException: io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException: Subject not found.; error code: 40401
	at net.coru.kloadgen.loadgen.impl.AvroLoadGenerator.<init>(AvroLoadGenerator.java:21) ~[kloadgen-1.5.0.jar:?]
	at net.coru.kloadgen.config.fileserialized.FileSerializedConfigElement.iterationStart(FileSerializedConfigElement.java:39) [kloadgen-1.5.0.jar:?]
	at org.apache.jmeter.control.GenericController.fireIterationStart(GenericController.java:399) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.control.GenericController.fireIterEvents(GenericController.java:391) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.control.GenericController.next(GenericController.java:160) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.control.LoopController.next(LoopController.java:135) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.threads.AbstractThreadGroup.next(AbstractThreadGroup.java:92) [ApacheJMeter_core.jar:5.2.1]
	at org.apache.jmeter.threads.JMeterThread.run(JMeterThread.java:255) [ApacheJMeter_core.jar:5.2.1]
	at java.lang.Thread.run(Thread.java:748) [?:1.8.0_252]
Caused by: io.confluent.kafka.schemaregistry.client.rest.exceptions.RestClientException: Subject not found.; error code: 40401
	at io.confluent.kafka.schemaregistry.client.rest.RestService.sendHttpRequest(RestService.java:230) ~[kloadgen-1.5.0.jar:?]
	at io.confluent.kafka.schemaregistry.client.rest.RestService.httpRequest(RestService.java:256) ~[kloadgen-1.5.0.jar:?]
	at io.confluent.kafka.schemaregistry.client.rest.RestService.getLatestVersion(RestService.java:515) ~[kloadgen-1.5.0.jar:?]
	at io.confluent.kafka.schemaregistry.client.rest.RestService.getLatestVersion(RestService.java:507) ~[kloadgen-1.5.0.jar:?]
	at io.confluent.kafka.schemaregistry.client.CachedSchemaRegistryClient.getLatestSchemaMetadata(CachedSchemaRegistryClient.java:275) ~[kloadgen-1.5.0.jar:?]
	at net.coru.kloadgen.input.AvroSchemaProcessor.getSchemaBySubject(AvroSchemaProcessor.java:266) ~[kloadgen-1.5.0.jar:?]
	at net.coru.kloadgen.input.AvroSchemaProcessor.<init>(AvroSchemaProcessor.java:86) ~[kloadgen-1.5.0.jar:?]
	at net.coru.kloadgen.loadgen.impl.AvroLoadGenerator.<init>(AvroLoadGenerator.java:18) ~[kloadgen-1.5.0.jar:?]

Error 3:

2020-06-08 14:17:26,202 ERROR n.c.k.s.ConfluentKafkaSampler: Failed to Generate message

I have tried different schemes. For example the Avro scheme as JSON file:

{
    "type" : "record",
    "namespace" : "test",
    "name" : "test",
    "fields" : [
       { "name" : "value1" , "type" : "string" },
       { "name" : "value2" , "type" : "int" }
    ]
 }

JMeter configuration (based on the Example-Test.json file):

Kafka File Load Generator Config:

Schema-Registry Config Element:

Kafka Producer Properties;

I suspect that this is a configuration problem. Does anyone see the problem?

[kszosze]

Hi Benedikt, that’s really odd. My apologizes. We will take a look into it. Thanks for your feedback

[benediktwetzel]

Okay. Maybe I’ll open a question issue, but probably I’ll just push the schema manually and use the Kafka Load Generator Config.

Thanks again for the support!