Catastrophic interference (original) (raw)
Catastrophic interference, also known as catastrophic forgetting, is the tendency of an artificial neural network to abruptly and drastically forget previously learned information upon learning new information. Neural networks are an important part of the network approach and connectionist approach to cognitive science. With these networks, human capabilities such as memory and learning can be modeled using computer simulations.
| Property | Value |
|---|---|
| dbo:abstract | Catastrophic interference, also known as catastrophic forgetting, is the tendency of an artificial neural network to abruptly and drastically forget previously learned information upon learning new information. Neural networks are an important part of the network approach and connectionist approach to cognitive science. With these networks, human capabilities such as memory and learning can be modeled using computer simulations. Catastrophic interference is an important issue to consider when creating connectionist models of memory. It was originally brought to the attention of the scientific community by research from McCloskey and Cohen (1989), and Ratcliff (1990). It is a radical manifestation of the 'sensitivity-stability' dilemma or the 'stability-plasticity' dilemma. Specifically, these problems refer to the challenge of making an artificial neural network that is sensitive to, but not disrupted by, new information. Lookup tables and connectionist networks lie on the opposite sides of the stability plasticity spectrum. The former remains completely stable in the presence of new information but lacks the ability to generalize, i.e. infer general principles, from new inputs. On the other hand, connectionist networks like the standard backpropagation network can generalize to unseen inputs, but they are very sensitive to new information. Backpropagation models can be analogized to human memory insofar as they mirror the human ability to generalize but these networks often exhibit less stability than human memory. Notably, these backpropagation networks are susceptible to catastrophic interference. This is an issue when modelling human memory, because unlike these networks, humans typically do not show catastrophic forgetting. (en) |
| dbo:thumbnail | wiki-commons:Special:FilePath/Pseudorecurrentnetwork.jpg?width=300 |
| dbo:wikiPageID | 39182554 (xsd:integer) |
| dbo:wikiPageLength | 30233 (xsd:nonNegativeInteger) |
| dbo:wikiPageRevisionID | 1122770121 (xsd:integer) |
| dbo:wikiPageWikiLink | dbr:Neural_network dbc:Artificial_intelligence dbr:Neocortex dbr:Cognitive_science dbr:Generative_model dbr:Connectionism dbr:Orthogonality dbr:Machine_learning dbr:Feedforward_neural_network dbr:One-hot dbr:Backpropagation dbc:Machine_learning dbr:Transfer_learning dbr:Hippocampus dbr:Artificial_neural_network dbc:Artificial_neural_networks dbr:Lookup_table dbr:Human_memory dbr:Short_term_memory dbr:Long_term_memory dbr:File:Pseudorecurrentnetwork.jpg dbr:Latent_Learning |
| dbp:wikiPageUsesTemplate | dbt:According_to_whom dbt:Citation_needed dbt:Explain dbt:Reflist dbt:Machine_learning |
| dct:subject | dbc:Artificial_intelligence dbc:Machine_learning dbc:Artificial_neural_networks |
| gold:hypernym | dbr:Tendency |
| rdf:type | yago:WikicatArtificialNeuralNetworks yago:Abstraction100002137 yago:Communication100033020 yago:ComputerArchitecture106725249 yago:Description106724763 yago:Message106598915 yago:NeuralNetwork106725467 dbo:Organisation yago:Specification106725067 yago:Statement106722453 |
| rdfs:comment | Catastrophic interference, also known as catastrophic forgetting, is the tendency of an artificial neural network to abruptly and drastically forget previously learned information upon learning new information. Neural networks are an important part of the network approach and connectionist approach to cognitive science. With these networks, human capabilities such as memory and learning can be modeled using computer simulations. (en) |
| rdfs:label | Catastrophic interference (en) |
| owl:sameAs | freebase:Catastrophic interference yago-res:Catastrophic interference wikidata:Catastrophic interference https://global.dbpedia.org/id/bwZT |
| prov:wasDerivedFrom | wikipedia-en:Catastrophic_interference?oldid=1122770121&ns=0 |
| foaf:depiction | wiki-commons:Special:FilePath/Pseudorecurrentnetwork.jpg |
| foaf:isPrimaryTopicOf | wikipedia-en:Catastrophic_interference |
| is dbo:wikiPageRedirects of | dbr:Catastrophic_Forgetting dbr:Catastrophic_Interference dbr:Catastrophic_forgetting |
| is dbo:wikiPageWikiLink of | dbr:Online_machine_learning dbr:Varied_practice dbr:Connectionism dbr:Backpropagation dbr:Synaptic_pruning dbr:Artificial_neural_network dbr:Fisher_information dbr:Catastrophic_Forgetting dbr:Catastrophic_Interference dbr:Catastrophic_forgetting |
| is foaf:primaryTopic of | wikipedia-en:Catastrophic_interference |
