Logo image
Decoding second order isomorphisms in the brain: the case of colors and letters
Journal article   Open access

Decoding second order isomorphisms in the brain: the case of colors and letters

Catherine Hanson
05/05/2020

Abstract

We introduce a new method for decoding neural data from fMRI. It is based on two assumptions, first that neural representation is distributed over networks of neurons embeded in voxel noise and second that the stimuli can be decoded as learned relations from sets of categorical stimuli. We illustrate these principles with two types of stimuli, color (wavelength) and letters (visual shape), both of which have early visual system response, but at the same time must be learned within a given function or category (color contrast, alphabet). Key to the decoding method is reducing the stimulus cross-correlation by a matched noise voxel sample by normalizing the stimulus voxel matrix thus unmasking a highly discriminative neural profile per stimulus. Projection of this new voxel space (ROI) to a smaller set of dimensions (with e.g., non-metric Multidimensional scaling), the relational information takes a unique geometric form revealing functional relationships between sets of stimuli, defined by R. Shepard, as second-order isomorphisms (SOI). In the case of colors the SOI appears as a nearly equally spaced set of wavelengths arranged in a color wheel, with a gap between the " purples " and " reds " (consistent with the gap in the original Ekman's color set). In the case of letters, a cluster space resulted from the decorrelated voxel neural profiles, which matched the phrase structure of the mnemonic used for more than 100 years to teach children the alphabet (across multiple languages), The Alphabet Song.
pdf
Hanson et al. - 2020 - DECODING SECOND ORDER ISOMORPHISMS IN THE BRAIN T627.41 kBDownloadView
Accepted Manuscript (AM) Open Access
url
https://doi.org/10.1101/2020.05.04.076703View
Accepted Manuscript (AM) BioArxiv
url
Report an accessibility issueView
Please complete a content remediation request to report an accessibility issue with a library electronic resource, website, or service.

Metrics

4 File downloads
22 Record Views

Details

Logo image