Browse Prior Art Database

WINNER-TAKE-ALL NETWORKS OF O(N) COMPLEXITY

IP.com Disclosure Number: IPCOM000147876D
Original Publication Date: 1988-Dec-31
Included in the Prior Art Database: 2007-Mar-28
Document File: 28 page(s) / 1M

Publishing Venue

Software Patent Institute

Related People

Lazzaro, J.: AUTHOR [+5]

Abstract

WINNER-TAKEALL NETWORKS OF O(N) COMPLEXITY BY J. LAZZARO S. RYCKEBUSCH

This text was extracted from a PDF file.
At least one non-text object (such as an image or picture) has been suppressed.
This is the abbreviated version, containing approximately 11% of the total text.

Page 1 of 28

WINNER-TAKEALL NETWORKS OF O(N) COMPLEXITY

BY
J. LAZZARO
S. RYCKEBUSCH

M.A. MAHOWALD
AND
C.
A. MEAD

   COMPUTER SCIENCE DEPARTMENT TECHNICAL REPORT CALTECH-CS-TR-21-88

CALIFORNIA INSTITUTE OF TECHNOLOGY PASADENA, CALIFORNIA 91125

THIS WORK SUPPORTED BY

   
THE OFFICE OF NAVAL RESEARCH AND
THE SYSTEM DEVELOPMENT FOUNDATION

[This page contains 1 picture or other non-text object]

Page 2 of 28

[This page contains 1 picture or other non-text object]

Page 3 of 28

ACKNOWLEDGMENTS

  John Platt, John Wyatt, David Feinstein, Mark Bell, and Dave Gillespie pro- vided mathmatical insights in the analysis of the circuit. Lyn Dupr6 proofread the document. We thank Hewlett-Packard for computing support, and DARPA and MOSIS for chip fabrication. This work was sponsored by the Office of Naval Research and the System Development Foundation.

[This page contains 1 picture or other non-text object]

Page 4 of 28

[This page contains 1 picture or other non-text object]

Page 5 of 28

TABLE OF CONTENTS

Introduction .......................................... 1

The Winner-Take-All Circuit ............................ 1

Time Response of the Winner-Take-All Circuit ............... 7

The Local Nonlinear Inhibition Circuit ..................... 9

Conclusions .......................................... 11

Appendix A: Static Response of the W inner-Take-All 12

Appendix B: Dynamic Response of the Winner-TakeAll 17

Appendix C: Representing Multiple Intensity Scales 19

References ........................................... 21

..........

........

...........

[This page contains 1 picture or other non-text object]

Page 6 of 28

[This page contains 1 picture or other non-text object]

Page 7 of 28

[This page contains 1 picture or other non-text object]

Page 8 of 28

INTRODUCTION

  Two general types of inhibition mediate activity in neural systems: .subtractive inhibition, which sets a zero level for the computation, and multiplicative (nonlin- ear) inhibition, which regulates the gain of the computation. We report a physical realization of general nonlinear inhibition in its extreme form, known as winner-

take-all.

  We have designed and fabricated a series of compact, completely functional CMOS integrated circuits that realize the winner-take-all function, using the full analog nature of the medium. This circuit has been used successfully as a component in several VLSI sensory systems, that perform auditory localization (Lazzaro and Mead, in press) and visual stereopsis (Mahowald and Delbmck, 1988). Winner- takeall circuits with over 170 inputs function correctly in tRese sensory systems.

  We have also modified this global winner-take-all circuit, realizing a circuit that computes local nonlinear inhibition. The circuit allows multiple winners in the network, and is well suited for use in systems that represent a feature space topographically and that process several fe...