Tests complete, but HTML report isn't updated

My tests run correctly, and new images are generated in the bitmaps_test directory, but the html_report isn’t being generated/updated.

So, the backstory: I’m doing a major rework of my CSS in a branch (converting from Less to PostCSS). I discovered Backstop, and thought I could use it to help me catch mistakes in the conversion. I went into my master branch, setup Backstop, and it seemed to work perfectly. I then merged those changes (including bitmaps_references) into the working branch. Now, when I run tests, most of them fail (expected, as I’m mid-process), but the HTML report isn’t being generated.

There are no errors logged, but there are a lot of test failures, as expected. Then output just stops. There is no “tests completed” or pass/fail count logged, and no browser report. The final lines of output:

compare | OK: Components igw_Components_1_kss-modifier__example__n1_0_medium.png
compare | ERROR { size: isDifferent, content: 0.00%, threshold: 0.1% }: Components igw_Components_5_kss-modifier__example__n5_0_medium.png
   See: /Users/kgrant/src/web/icegroupweb-styles/backstop_data/bitmaps_test/20161130-132948/failed_diff_igw_Components_5_kss-modifier__example__n5_0_medium.png
compare | ERROR { size: isDifferent, content: 0.00%, threshold: 0.1% }: Components igw_Components_4_kss-modifier__example__n4_0_medium.png
   See: /Users/kgrant/src/web/icegroupweb-styles/backstop_data/bitmaps_test/20161130-132948/failed_diff_igw_Components_4_kss-modifier__example__n4_0_medium.png
compare | ERROR { size: isDifferent, content: 0.00%, threshold: 0.1% }: Components igw_Components_3_kss-modifier__example__n3_0_medium.png
   See: /Users/kgrant/src/web/icegroupweb-styles/backstop_data/bitmaps_test/20161130-132948/failed_diff_igw_Components_3_kss-modifier__example__n3_0_medium.png
compare | ERROR { size: isDifferent, content: 0.00%, threshold: 0.1% }: Components igw_Components_2_kss-modifier__example__n2_0_medium.png
   See: /Users/kgrant/src/web/icegroupweb-styles/backstop_data/bitmaps_test/20161130-132948/failed_diff_igw_Components_2_kss-modifier__example__n2_0_medium.png
compare | ERROR { size: ok, content: 2.69%, threshold: 0.1% }: Components igw_Components_0_kss-modifier__example_0_medium.png
   See: /Users/kgrant/src/web/icegroupweb-styles/backstop_data/bitmaps_test/20161130-132948/failed_diff_igw_Components_0_kss-modifier__example_0_medium.png
compare | ERROR { size: isDifferent, content: 55.25%, threshold: 0.1% }: Components igw_Components_7_kss-modifier__example__n7_0_medium.png
   See: /Users/kgrant/src/web/icegroupweb-styles/backstop_data/bitmaps_test/20161130-132948/failed_diff_igw_Components_7_kss-modifier__example__n7_0_medium.png
compare | ERROR { size: isDifferent, content: 9.01%, threshold: 0.1% }: Components igw_Components_29_kss-modifier__example__n29_0_medium.png
   See: /Users/kgrant/src/web/icegroupweb-styles/backstop_data/bitmaps_test/20161130-132948/failed_diff_igw_Components_29_kss-modifier__example__n29_0_medium.png
$

It’s possible there are a different number of generated images now, though I‘m not certain. Could this be caused by an inability to match up reference images to test images 1:1?

[Bobrovskih]

I didn’t get the report either v4.4.2 or v5.0.7. I spent a lot of time searching and debugging. In the end, I changed the parameter asyncCompareLimit: 25 (before it was 50) and the problem solved.

[garris]

Here is a sanity test you can run to test if the docker implementation is working in your environment…

https://github.com/garris/BackstopJS/blob/master/README.md#sanity-test-does-backstop-work-in-my-environment

Does this work?