...
Clicking on Export creates and downloads a .xlms xlsm file with the same values as shown in the table.
...
Recalculating Matrix
If you want to see better see how a trained model detects or classifies the defects, you can go back into labeling and annotate more images and press “RECALC STATISTICS“ button. This will update the confusion matrix with the data from the new annotations withou without the need to retrain the model.
...
| Note |
|---|
...
The “RECALC MATRIX“ function isn’t available in the Surface Detection and OCR modules. |
Anomaly Detector confusion matrix
...
The classifier confusion matrix looks like this and works exactly as was described in module confusion matrix section.
...
Detector confusion matrix
The detector confusion matrix works much like the classifier confusion matrix but it has one extra misdetections - when the model detects defect when there is none in annotations. If the classification is turned off, the confusion matrix is like matrix with one unnamed class.
...
The detection is considered correct (it corresponds to one of the green cells in confusion matrix) if at least half of the detected rectangle is overlapping with annotated rectangle (and if you have classification turned on, the rectangles must also be of the same class as the annotation to be considered correct).
You can compare the annotated rectangles with the detected ones in the Inspection tab by having the Show Annotations button ticked on (or in the Labeling tab by switching the Active Annotations on).
...
For more details on how the confusion matrix works you can read the module confusion matrix section.
Surface Detector confusion matrix
Again, the Surface Detector confusion matrix can be accessed by clicking on the “CONFUSION MATRIX“ button:
...
It looks like this and works just like detector confusion matrix, except that surface detector doesn’t provide the “RECALC MATRIX” function in the Labeling tab:
...
OCR confusion matrix
OCR confusion matrix is very different from the rest of the modules. First, it’s accessed by clicking on the “MODEL STATISTICS” button:
...
Second, it is more of a table than a matrix, with each row being for one type of annotated text and it has three columns:
Detection column - shows the text that is supposed to be detected (annotated by user)
OK column - shows how many times was the text detected correctly
NG column - shows how many times the text wasn’t detected correctly
| Info |
|---|
By clicking on a number under either the OK or the NG column, the images with those annotation will be filtered in the image list on the right side of the screen |
| Note |
|---|
OCR modul doesn’t have the recalculate matrix functionality |
...