Get JSON report via websocket API

Currently I can only know the status of a test result be connecting to /getCaseStatus?casetuple=$case, but I have no more information about what’s wrong.

Is there any way to fetch the actual JSON report via the web socket client as well? (or even HTTP?)

[joffrey-bion]

the testsuite has a builtin webserver: just add the webport option

Awesome, I didn’t know that, thanks!

the report files are generated, stored and served from within the docker container, so that should be good (independent of your test env)?

Yes definitely, if the container can serve those files via HTTP, this is just perfect. I was talking about the absence of such HTTP API, in which case I would have to read the files manually.

this is one of the HTTP endpoint that are indeed used to control the fuzzing server - but that is HTTP not WebSocket

Oh. It did look like a websocket API though here: https://github.com/crossbario/autobahn-testsuite/blob/master/autobahntestsuite/autobahntestsuite/fuzzing.py#L309

the problem with putting the control onto the same WebSocket connection that is being fuzzed is obvious. So the only sane way would be to run a 2nd WebSocket connection only for the control. Possible, sure. But that is not implemented right now …

Totally agreed, and I actually used additional websocket connections for those endpoints (which seemed to work fine on most client implementations I’m testing right now). So now I’m confused as to this HTTP vs websocket controls, it really did look like it worked as a websocket connection 😆 In any case, I will try with the HTTP server, thanks!

[oberstet]

I also tested the endpoints mentioned above (/getCaseStatus, /updateReports etc.),

yes, those the URLs used when opening the websocket connection, and since every websocket connection starts as HTTP, this is where the confusion comes from. those URLs cannot be used to continue with HTTP/GET after the initial HTTP open.

By contrast, with the HTTP server giving me the JSON files, I need to run updateReports after each test to then be able to fetch the JSON file for the test and read detailed results.

yes, unfort. that’s how it works (results are just collected in a server class and only updateReports will process that, and process all collected results).