Skip to content

Commit 0d8e5d6

Browse files
author
Arthur Douillard
committed
[info] Update icarl results.
1 parent 2c18927 commit 0d8e5d6

File tree

1 file changed

+10
-3
lines changed

1 file changed

+10
-3
lines changed

README.md

Lines changed: 10 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -11,11 +11,18 @@ Every model must inherit `inclearn.models.base.IncrementalLearner`.
1111

1212
## iCaRL
1313

14-
I have not yet been able to reproduce the results of iCaRL as you can see on the
15-
following figure:
16-
1714
![icarl](figures/icarl.png)
1815

1916
My experiments are in green, with their means & standard deviations plotted.
2017
They were runned 40 times, with seed going from 1 to 40, each producing a
2118
different classes ordering.
19+
20+
The metric used is the `average incremental accuracy`:
21+
22+
> The result of the evaluation are curves of the classification accuracies after
23+
> each batch of classes. If a single number is preferable, we report the average of
24+
> these accuracies, called average incremental accuracy.
25+
26+
If I understood well, the accuracy at task i (computed on all seen tasks) is averaged
27+
with all previous accuracy. A bit weird, but doing so get me a curve very similar
28+
to what the papier displayed.

0 commit comments

Comments
 (0)