Search papers, labs, and topics across Lattice.
This study introduces Uniform Herding, a method that optimally allocates an active exemplar set across observed classes while refreshing exemplars based on changing feature representations. Evaluated on CIFAR-100 with a ResNet-18 backbone, Uniform Herding achieved a final average accuracy of 44.00% and a forgetting rate of 17.22%, outperforming the baseline method iCaRL. The findings indicate that the method's design significantly impacts both accuracy and retention of learned information, highlighting the importance of exemplar management in class-incremental learning scenarios.
Uniform Herding not only boosts accuracy but also reduces forgetting, outperforming traditional methods by effectively managing exemplar representation across tasks.
As the feature representation changes, replay must preserve the earlier classes. However, only a bounded active exemplar set can be replayed. We propose Uniform Herding, which allocates the current active set across observed classes and uses a bounded candidate pool to refresh their chosen exemplars in the current representation. On CIFAR-100 with ten class-incremental tasks, a ResNet-18 backbone, active budget $M=2{,}000$, retrieval budget $b=64$, and three seeds, Uniform Herding obtains $44.00\pm0.51\%$ final average accuracy and $17.22\pm0.43\%$ forgetting, compared with $42.33\pm1.20\%$ and $24.87\pm1.11\%$ for iCaRL. Within the Uniform Herding protocol, final accuracy decreased when NME or herding was replaced with the tested alternatives, while forgetting increased when distillation was removed. Changing the retrieval budget has a smaller effect across the tested range than changing the active budget. The comparison with iCaRL is end-to-end. It does not isolate the effect of refresh from the other protocol differences. These results are limited to the tested protocol.
