Dismiss
InnovationQ will be updated on Sunday, Oct. 22, from 10am ET - noon. You may experience brief service interruptions during that time.
Browse Prior Art Database

WINNER-TAKE-ALL NETWORKS OF O(N) COMPLEXITY

IP.com Disclosure Number: IPCOM000147876D
Original Publication Date: 1988-Dec-31
Included in the Prior Art Database: 2007-Mar-28
Document File: 28 page(s) / 1M

Publishing Venue

Software Patent Institute

Related People

Lazzaro, J.: AUTHOR [+5]

Abstract

WINNER-TAKEALL NETWORKS OF O(N) COMPLEXITY BY J. LAZZARO S. RYCKEBUSCH M.A. MAHOWALD AND C. A. MEAD COMPUTER SCIENCE DEPARTMENT TECHNICAL REPORT CALTECH-CS-TR-21-88 CALIFORNIA INSTITUTE OF TECHNOLOGY PASADENA, CALIFORNIA 91125 THIS WORK SUPPORTED BY THE OFFICE OF NAVAL RESEARCH ANDTHE SYSTEM DEVELOPMENT FOUNDATION ACKNOWLEDGMENTS John Platt, John Wyatt, David Feinstein, Mark Bell, and Dave Gillespie pro- vided mathmatical insights in the analysis of the circuit. Lyn Dupr6 proofread the document. We thank Hewlett-Packard for computing support, and DARPA and MOSIS for chip fabrication. This work was sponsored by the Office of Naval Research and the System Development Foundation. TABLE OF CONTENTS Introduction .......................................... 1 The Winner-Take-All Circuit ............................ 1 Time Response of the Winner-Take-All Circuit ............... 7 The Local Nonlinear Inhibition Circuit ..................... 9 Conclusions .......................................... 11

This text was extracted from a PDF file.
At least one non-text object (such as an image or picture) has been suppressed.
This is the abbreviated version, containing approximately 11% of the total text.

Page 1 of 28

WINNER-TAKEALL NETWORKS OF O(N) COMPLEXITY

BY
J. LAZZARO
S. RYCKEBUSCH

M.A. MAHOWALD
AND
C.
A. MEAD

   COMPUTER SCIENCE DEPARTMENT TECHNICAL REPORT CALTECH-CS-TR-21-88

CALIFORNIA INSTITUTE OF TECHNOLOGY PASADENA, CALIFORNIA 91125

THIS WORK SUPPORTED BY

   
THE OFFICE OF NAVAL RESEARCH AND
THE SYSTEM DEVELOPMENT FOUNDATION

[This page contains 1 picture or other non-text object]

Page 2 of 28

[This page contains 1 picture or other non-text object]

Page 3 of 28

ACKNOWLEDGMENTS

  John Platt, John Wyatt, David Feinstein, Mark Bell, and Dave Gillespie pro- vided mathmatical insights in the analysis of the circuit. Lyn Dupr6 proofread the document. We thank Hewlett-Packard for computing support, and DARPA and MOSIS for chip fabrication. This work was sponsored by the Office of Naval Research and the System Development Foundation.

[This page contains 1 picture or other non-text object]

Page 4 of 28

[This page contains 1 picture or other non-text object]

Page 5 of 28

TABLE OF CONTENTS

Introduction .......................................... 1

The Winner-Take-All Circuit ............................ 1

Time Response of the Winner-Take-All Circuit ............... 7

The Local Nonlinear Inhibition Circuit ..................... 9

Conclusions .......................................... 11

Appendix A: Static Response of the W inner-Take-All 12

Appendix B: Dynamic Response of the Winner-TakeAll 17

Appendix C: Representing Multiple Intensity Scales 19

References ........................................... 21

..........

........

...........

[This page contains 1 picture or other non-text object]

Page 6 of 28

[This page contains 1 picture or other non-text object]

Page 7 of 28

[This page contains 1 picture or other non-text object]

Page 8 of 28

INTRODUCTION

  Two general types of inhibition mediate activity in neural systems: .subtractive inhibition, which sets a zero level for the computation, and multiplicative (nonlin- ear) inhibition, which regulates the gain of the computation. We report a physical realization of general nonlinear inhibition in its extreme form, known as winner-

take-all.

  We have designed and fabricated a series of compact, completely functional CMOS integrated circuits that realize the winner-take-all function, using the full analog nature of the medium. This circuit has been used successfully as a component in several VLSI sensory systems, that perform auditory localization (Lazzaro and Mead, in press) and visual stereopsis (Mahowald and Delbmck, 1988). Winner- takeall circuits with over 170 inputs function correctly in tRese sensory systems.

  We have also modified this global winner-take-all circuit, realizing a circuit that computes local nonlinear inhibition. The circuit allows multiple winners in the network, and is well suited for use in systems that represent a feature space topographically and that process several fe...