Emergent Hierarchical Monosemantic Neurons from the Group-Contrastive Forward-Forward Algorithm
Researchers propose Group-Contrastive Forward-Forward (GCFF), a biologically plausible learning algorithm that yields monosemantic neurons organized into hierarchies of increasing abstraction without sparsity constraints…