Learned Categorical Perception in Neural Nets: Implications for Symbol Grounding

Abstract

After people learn to sort objects into categories they see them differently. Members of the same category look more alike and members of different categories look more different. This phenomenon of within-category compression and between-category separation in similarity space is called categorical perception (CP). It is exhibited by human subjects, animals and neural net models. In backpropagation nets trained first to auto-associate 12 stimuli varying along a onedimensional continuum and then to sort them into 3 categories, CP arises as a natural side-effect because of four factors: (1) Maximal interstimulus separation in hidden-unit space during autoassociation learning, (2) movement toward linear separability during categorization learning, (3) inverse-distance repulsive force exerted by the between-category boundary, and (4) the modulating effects of input iconicity, especially in interpolating CP to untrained regions of the continuum. Once similarity space has been "warped" in this way, the compressed and separated "chunks" have symbolic labels which could then be combined into symbol strings that constitute propositions about objects. The meanings of such symbolic representations would be "grounded" in the system's capacity to pick out from their sensory projections the object categories that the propositions were about.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 92,574

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

  • Only published works are available at libraries.

Similar books and articles

Connecting object to symbol in modeling cognition.Stevan Harnad - 1992 - In A. Clark & Ronald Lutz (eds.), Connectionism in Context. Springer Verlag. pp. 75--90.
The symbol grounding problem.Stevan Harnad - 1990 - Physica D 42:335-346.
Categorical perception.Stevan Harnad - 2003 - In L. Nadel (ed.), Encyclopedia of Cognitive Science. Nature Publishing Group. pp. 67--4.
Categorical Perception of Color: Assessing the Role of Language.Yasmina Jraissati - 2012 - Croatian Journal of Philosophy 12 (3):439-462.
Symbolic Versus Associative Learning.John E. Hummel - 2010 - Cognitive Science 34 (6):958-965.

Analytics

Added to PP
2010-12-22

Downloads
58 (#278,959)

6 months
4 (#799,256)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Stevan Harnad
McGill University

References found in this work

No references found.

Add more references