Science @lemmy.ml wordman @lemmy.ml 1y ago

Pink Floyd Song Reconstructed From Brain Scans

journals.plos.org Music can be reconstructed from human auditory cortex activity using nonlinear decoding models

Using combined regression-based decoding models and encoding analyses, this study successfully reconstructed a Pink Floyd song from recorded neural activity, revealing involvement of the superior temporal gyrus in information processing during music perception, and making an important step towards a...

Researchers who recorded direct neural signals from people listening to “Another Brick in the Wall” have reproduced a recognizable version of the song from the neural data.

Machine Learning @lemmy.ml ☆ Yσɠƚԋσʂ ☆ @lemmy.ml 1y ago

Music can be reconstructed from human auditory cortex activity using nonlinear decoding models

journals.plos.org /plosbiology/article

6 comments

Were the test subjects comfortably numb during the test?
- One would hope.
Here's what you came for: the WAV downloads of the original audio, the version sampled from linear data, and the version sampled with nonlinear data. There are more of these in the OP which use less electrodes on less patients, you can find them quickly by using Control+F.

Original song waveform transformed into a magnitude-only auditory spectrogram, then transformed back into a waveform using an iterative phase-estimation algorithm.

Reconstructed song excerpt using linear models fed with all 347 significant electrodes from all 29 patients.

Reconstructed song excerpt using nonlinear models fed with all 347 significant electrodes from all 29 patients.

The nonlinear sampling sounds far more accurate than the linear sampling.
Black Mirror “Ashley Too” episode anyone?

6 comments