Response message containing "false" is considered a failure when parsed by ResultScanner

I have Java Sampler tests which set the SampleResult response message to a server’s text/xml response. This xml contains the string “false” within the body, and is subsequently included when the csv result file is generated, in the responseMessage column.

On parsing the file, it appears that ResultScanner is counting the appearance of “false” in the responseMessage as a test failure, while using failurePattern:'\bfalse\b'.

https://github.com/jmeter-maven-plugin/jmeter-maven-plugin/blob/b0c938d0b7c6767bf7b0d1531380e877b1dca4f0/src/main/java/com/lazerycode/jmeter/testrunner/ResultScanner.java#L74

If this is infact an issue, I’d like to submit a PR to resolve this. Would you guys have a preference on a solution? My immediate thought is to deserialize the csv rows to collection of Java objects, then count where success == false. Alternatively, the pattern could be extended to include \b,false,\b but there is still a possibility where some messageResponse may contain the substring ",false,".

Thanks.

[martymcflywa]

@pmouawad It will be my first time contributing here but i’d certainly like to try! I will go with your suggestion and looking through your example at the moment.

[pmouawad]

Hello, Thanks for proposal, I confirm issue, which only affects CSV format. I think the most stable way to do it is:

• detect position of success field based on user.properties
• get its value and count

This may help:

• https://github.com/apache/jmeter/blob/trunk/src/core/org/apache/jmeter/report/core/CsvSampleReader.java#L117