Skip to content

Attempts extension of Baby Dragon Hatchling (BDH) with continual learning using pseudo-metaplasticity.#6

Open
zer0condition wants to merge 19 commits intopathwaycom:mainfrom
cMiraka:main
Open

Attempts extension of Baby Dragon Hatchling (BDH) with continual learning using pseudo-metaplasticity.#6
zer0condition wants to merge 19 commits intopathwaycom:mainfrom
cMiraka:main

Conversation

@zer0condition
Copy link


Highlights of Changes and Improvements

Continual Learning Integration

  • Added Elastic Weight Consolidation (EWC) with Fisher information estimation to protect important weights from overwriting during new tasks.
  • Implemented adaptive synaptic gates that regulate plasticity at the neuron level, inspired by biological metaplasticity.
  • Integrated path integral online importance measures for efficient tracking of weight significance during training.
  • Supported multi-task sequential training enabling scalable lifelong learning.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants