Fixed versus mixed RSA: Explaining visual representations by fixed and mixed feature sets from shallow and deep computational models

BioRxiv : the Preprint Server for Biology
Seyed-Mahdi Khaligh-RazaviNikolaus Kriegeskorte

Abstract

Studies of the primate visual system have begun to test a wide range of complex computational object-vision models. Realistic models have many parameters, which in practice cannot be fitted using the limited amounts of brain-activity data typically available. Task performance optimization (e.g. using backpropagation to train neural networks) provides major constraints for fitting parameters and discovering nonlinear representational features appropriate for the task (e.g. object classification). Model representations can be compared to brain representations in terms of the representational dissimilarities they predict for an image set. This method, called representational similarity analysis (RSA), enables us to test the representational feature space as is (fixed RSA) or to fit a linear transformation that mixes the nonlinear model features so as to best explain a cortical area's representational space (mixed RSA). Like voxel/population-receptive-field modelling, mixed RSA uses a training set (different stimuli) to fit one weight per model feature and response channel (voxels here), so as to best predict the response profile across images for each response channel. We analysed response patterns elicited by natural images, whic...Continue Reading

Related Concepts

Brain
Classification
Objective (Goal)
Ion Channel
Magnetic Resonance Imaging
Depth
Anatomical Space Structure
Flank (Surface Region)
FMRI
Brain Activity

Related Feeds

BioRxiv & MedRxiv Preprints

BioRxiv and MedRxiv are the preprint servers for biology and health sciences respectively, operated by Cold Spring Harbor Laboratory. Here are the latest preprint articles (which are not peer-reviewed) from BioRxiv and MedRxiv.

Related Papers

Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences
Nikolaus Kriegeskorte, Jörn Diedrichsen
PLoS Computational Biology
Seyed-Mahdi Khaligh-Razavi, Nikolaus Kriegeskorte
© 2021 Meta ULC. All rights reserved