ARTSCENE: A Neural System for Natural Scene Classification

Author(s): Grossberg, S. | Huang, T.R. |

Year: 2009

Citation: Journal of Vision, 9(4):6, 1-19, http://journalofvision.org/9/4/6/, doi:10.1167/9.4.6.

Abstract: How do humans rapidly recognize a scene? How can neural models capture this biological competence to achieve state-of-the-art scene classification? The ARTSCENE neural system classifies natural scene photographs by using multiple spatial scales to efficiently accumulate evidence for gist and texture. ARTSCENE embodies a coarse-to-fine Texture Size Ranking Principle whereby spatial attention processes multiple scales of scenic information, from global gist to local textures, to learn and recognize scenic properties. The model can incrementally learn and rapidly predict scene identity by gist information alone, and then accumulate learned evidence from scenic textures to refine this hypothesis. The model shows how texture-fitting allocations of spatial attention, called attentional shrouds, can facilitate scene recognition, particularly when they include a border of adjacent textures. Using grid gist plus three shroud textures on a benchmark photograph dataset, ARTSCENE discriminates 4 landscape scene categories (coast, forest, mountain and countryside) with up to 91.85% correct on a test set, outperforms alternative models in the literature which use biologically implausible computations, and outperforms component systems that use either gist or texture information alone.

Topics: Image Analysis, Machine Learning, Models: Fuzzy ARTMAP, Modified ART,

PDF download



Cross References


  1. Spatial Envelope Dataset
    This dataset contains 8 outdoor scene categories: coast, mountain, forest, open country, street, inside city, tall buildings and highways. There are 2600 color images, 256x256 pixels. All the objects and regions in this ... Data Details

  2. Default ARTMAP 2
    Default ARTMAP combines winner-take-all category node activation during training, distributed activation during testing, and a set of default parameter values that define a ready-to-use, general-purpose neural network system ... Article Details

  3. Texture segregation by visual cortex: Perceptual grouping, attention, and learning
    A neural model called dARTEX is proposed of how laminar interactions in the visual cortex may learn and recognize object texture and form boundaries. The model unifies five interacting processes: region-based texture ... Article Details

  4. A laminar cortical model of stereopsis and 3D surface perception: Closure and da Vinci stereopsis
    A laminar cortical model of stereopsis and 3D surface perception is developed and simulated. The model describes how monocular and binocular oriented filtering interact with later stages of 3D boundary formation and surface ... Article Details

  5. Distributed ARTMAP: a neural network for fast distributed supervised learning
    Distributed coding at the hidden layer of a multi-layer perceptron (MLP) endows the network with memory compression and noise tolerance capabilities. However, an MLP typically requires slow off-line learning to avoid ... Article Details

  6. A neural model of surface perception: Lightness, anchoring, and filling-in
    A neural model is proposed of how the visual system processes natural images under variable illumination conditions to generate surface lightness percepts. Previous models clarify how the brain can compute relative contrast. ... Article Details


Back to Articles