Groovy consumer test does not report the real reason behind failure

When running a consumer test and the closure passed into PactBuilder.run() throws an exception, the exception is caught and the test fails, but the real reason is not printed in the console.

The exception ends up in PactMismatch.userError, but PactMismatch.toString() does not print it out.

Example:

import au.com.dius.pact.consumer.PactVerified$
import au.com.dius.pact.consumer.VerificationResult
import au.com.dius.pact.consumer.groovy.PactBuilder
import org.junit.Test

class SwallowingUserErrorPactTest {

    @Test
    def void 'create a person'() {
        def myService = new PactBuilder()
        myService {
            serviceConsumer 'some consumer'
            hasPactWith 'some provider'
            uponReceiving 'a request to create a person'
            port 1234
            withAttributes(
                    method: 'post',
                    path: '/person',
            )
            willRespondWith(
                    status: 200
            )
        }
        VerificationResult result = myService.run() {
            throw new RuntimeException('this is not reported')
        }
        assert result == PactVerified$.MODULE$
    }
}

The output is

assert result == PactVerified$.MODULE$
       |      |                |
       |      false            Pact verified.
       Pact verification failed for the following reasons:

       The following requests were not received:
       Interaction: a request to create a person
...

but there is no mention of ‘this is not reported’

[lagershins]

@uglyog if the issue is that only a single exception can be thrown, wouldn’t it be possible to wrap all the root cause exceptions into a single exception and throw that? It could then print out the messages from all the root causes providing as much detail to the user as possible.

[uglyog]

For your test, the output is a little bit ugly, but it is all there:

Assertion failed: 

assert result == PactVerificationResult.Ok.INSTANCE
       |      |                            |
       |      false                        au.com.dius.pact.consumer.PactVerificationResult$Ok@2bf5dc88
       Error(error=java.lang.RuntimeException: this is not reported, mockServerState=ExpectedButNotReceived(expectedRequests=[	method: post
       	path: /person
       	query: [:]
       	headers: [:]
       	matchers: [:]
       	body: au.com.dius.pact.model.OptionalBody(MISSING, null)]))