Glossary
What is Synaptic Intelligence? Definition and meaning
Accumulates how much each weight contributed to loss reduction during training and penalizes changes to important ones.
Definition
Synaptic Intelligence: Accumulates how much each weight contributed to loss reduction during training and penalizes changes to important ones.
In short: Online importance estimation for continual learning.
When it is used
Forgetting control without storing past data.
Learn more
The full guide to Synaptic Intelligence explains how it works, when to use it and how it compares with the alternatives, with examples. The glossary lists every term on the site from A to Z.
Previous term: Swin · Next term: Synthetic data