The temporal interaction of modality specific and process specific neural networks supporting simple working memory tasks.

Several theories of brain function emphasize distinctions between sensory and cognitive systems. We hypothesized, instead, that sensory and cognitive systems interact to instantiate the task at the neural level. We tested whether input modality interacts with working memory operations in that, despite similar cognitive demands, differences in the anatomical locations or temporal dynamics of activations following auditory or visual input would not be limited to the sensory cortices. We recorded event-related brain potentials (ERPs) while participants performed simple short-term memory tasks involving visually or auditorily presented bandpass-filtered noise stimuli. Our analyses suggested that working memory operations in each modality had a very similar spatial distribution of current sources outside the sensory cortices, but differed in terms of time course. Specifically, information for visual processing was updated and held online in a manner that was different from auditory processing, which was done mostly after the offset of the final stimulus. Our results suggest that the neural networks that support working memory operations have different temporal dynamics for auditory and visual material, even when the stimuli are matched in term of discriminability, and are designed to undergo very similar transformations when they are encoded and retrieved from memory.