Model Testing

This tool calculates the error of a model according to different error measures.

The options -n and –merge should not be used together.

$ test.py --help
usage: test.py [-h] [-m FOLDER] [-s {test,train,valid}] [-n N] [--merge]

Get the error of a model. This tool supports multiple error measures.

optional arguments:
  -h, --help            show this help message and exit
  -m FOLDER, --model FOLDER
                        where is the model folder (with the info.yml)?
                        (default: current folder)
  -s {test,train,valid}, --set {test,train,valid}
                        which set should get analyzed? (default: test)
  -n N                  Top-N error (default: 3)
  --merge               merge problem classes that are easy to confuse
                        (default: False)