Winner Take All Nets
- We used a simple topology of a line of
neurons to represent the continous value. In particular,
we were interested in categories like temperature, so we had
101 neurons to represent temperatures between 0 and 100 celsius.
- The neurons connected to nearby neurons with excitatory connections,
- and further away with inhibitory connections.
- In an entirely expected way, if you turned on one or a few adjacent
neurons, a stream of neurons persisted.
- The width of the stream varied depending on the weights and number
of excitatory and inhibitory neurons, but it was pretty stable.
