Nathan Crone

Publication Detail

The publication detail shows the title, authors (with indicators showing other profiled authors), information on the publishing organization, abstract and a link to the article in PubMed. This abstract is what is used to create the fingerprint of the publication. If any grants are referenced by the publication, they will be listed here as well.

Reconstructing speech from human auditory cortex.

Brian N Pasley; Stephen V David; Nima Mesgarani; Adeen Flinker; Shihab A Shamma; Nathan E Crone; Robert T Knight; Edward F Chang (Profiled Author: Nathan Crone)

Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, United States of America. bpasley@berkeley.edu
PLoS biology 2012;10(1):e1001251.

How the human auditory system extracts perceptually relevant acoustic features of speech is unknown. To address this question, we used intracranial recordings from nonprimary auditory cortex in the human superior temporal gyrus to determine what acoustic information in speech sounds can be reconstructed from population neural activity. We found that slow and intermediate temporal fluctuations, such as those corresponding to syllable rate, were accurately reconstructed using a linear model based on the auditory spectrogram. However, reconstruction of fast temporal fluctuations, such as syllable onsets and offsets, required a nonlinear sound representation based on temporal modulation energy. Reconstruction accuracy was highest within the range of spectro-temporal fluctuations that have been found to be critical for speech intelligibility. The decoded speech representations allowed readout and identification of individual words directly from brain activity during single trial sound presentations. These findings reveal neural encoding mechanisms of speech acoustic parameters in higher order human auditory cortex.

Scientific Context

This section shows information related to the publication - computed using the fingerprint of the publication - including related publications, related experts and related grants with fingerprints representing significant amounts of overlap between their fingerprint and this publication. The red dots indicate whether those experts or terms appear within the publication, thereby showing potential and actual connections.