Division by zero error in training related to number of samples

Getting

Traceback (most recent call last):
  File "/usr/lib/python3.5/runpy.py", line 184, in _run_module_as_main
    "__main__", mod_spec)
  File "/usr/lib/python3.5/runpy.py", line 85, in _run_code
    exec(code, run_globals)
  File "/app/robosat/tools/__main__.py", line 60, in <module>
    args.func(args)
  File "/app/robosat/tools/train.py", line 147, in main
    val_hist = validate(val_loader, num_classes, device, net, criterion)
  File "/usr/lib/python3.5/contextlib.py", line 30, in inner
    return func(*args, **kwds)
  File "/app/robosat/tools/train.py", line 245, in validate
    "mcc": metrics.get_mcc(),
  File "/app/robosat/metrics.py", line 66, in get_mcc
    (self.tp + self.fp) * (self.tp + self.fn) * (self.tn + self.fp) * (self.tn + self.fn)
ZeroDivisionError: float division by zero

. . . following the completion of a single epoch (out of a total of 1) in this workflow. It’s unclear from the traceback where exactly the zero is being invoked, or how it could be fixed in either the config .tomls or the inputs. It seems related to this division, but it’s not clear how a situation where num_samples = 0 could get through the validity check just above it.

cc @jacquestardie

[ocourtin]

@daniel-j-h New related PR: https://github.com/mapbox/robosat/pull/127

@wboykinm Thanks for the test and report, and replyied on the ‘newer and bigger’ one…

[wboykinm]

@ocourtin That seems to have done the trick on the division by zero error! Thanks for adding the handler!

(Of course I’m on to newer and bigger failures, but that doesn’t appear related and I’ll try some debugging before I whine about that one.)