Soft-clustering and improved stability for adaptive resonance theory neural networks

Author(s): Massey, L. |

Year: 2008

Citation: SOFT COMPUTING Volume: 12 Issue: 7 Pages: 657-665

Abstract: Stability and plasticity in learning systems are both equally essential, but achieving stability and plasticity simultaneously is difficult. Adaptive resonance theory (ART) neural networks are known for their plastic and stable learning of categories, hence providing an answer to the so called stability-plasticity dilemma. However, it has been demonstrated recently that contrary to general belief, ART stability is not possible with infinite streaming data. In this paper, we present an improved stabilization strategy for ART neural networks that does not suffer from this problem and that produces a soft-clustering solution as a positive side effect. Experimental results in a task of text clustering demonstrate that the new stabilization strategy works well, but with a slight loss in clustering quality compared to the traditional approach. For real-life intelligent applications in which infinite streaming data is generated, the stable and soft-clustering solution obtained with our approach more than outweighs the small loss in quality.

Topics: Machine Learning, Applications: Other, Models: ART 1, ART 2 / Fuzzy ART, ART 2-A, ARTMAP, Fuzzy ARTMAP,

PDF download

Cross References

  1. ARTMAP-FTR: A neural network for fusion target recognition, with application to sonar classification
    ART (Adaptive Resonance Theory) neural networks for fast, stable learning and prediction have been applied in a variety of areas. Applications include automatic mapping from satellite remote sensing data, machine tool ... Article Details

  2. Adaptive pattern classification and universal recoding: I Parallel development and coding of neural feature detectors
    This paper analyses a model for the parallel development and adult coding of neural feature detectors. The model was introduced in Grossberg (1976). We show how experience can retune feature detectors to respond to a ... Article Details

  3. A Modified Fuzzy ART for Soft Document Clustering
    Document clustering is a very useful application in recent days especially with the advent of the World Wide Web. Most of the existing document clustering algorithms either produce clusters of poor quality or are highly ... Article Details