Simulation replay of brain learning eye/ear association
This video is a replay of the Brainiac GUI simulating a 400-neuron, 19,263-synapse Brainiac brain with an eye and an ear that is learning to associate the sound “X” with the written letter “X.” Once this brain has learned the association, if it hears an X but doesn’t see one, the visual X neuron will still fire because the brain is recalling the association.
Here is the timeline in brain milliseconds:
#### Associative Learning Phase #######
80ms to 272ms eye sees 'x', ear hears 'x'
303ms to 574ms eye sees 'o', ear hears 'o'
#### Recall Testing Phase ################
605ms to 684ms eye sees 'x', ear hears nothing
715ms to 794ms eye sees nothing, ear hears 'x'
825ms to 904ms eye sees 'o', ear hears nothing
935ms to 1014ms eye sees nothing, ear hears 'o'
The neurons of the eye are in the top left region of the brain, while the ear is in the top right. The association region of the brain is in the top right. The two regions below the eye hash the eye's input into a few unique key, visual recognition neurons in the bottom left. Similarly, the two regions below the ear hash the ears input into a few unique audio recognition neurons in the bottom right. The association region (top right, excluding ear), associates the key neurons.
Notice at the end of this video (last frame) how the correct key visual 'o' neurons recalls (lighting up) when hearing but not seeing an 'o', because of the association 'o' neurons.