Alert icon
We're changing our privacy policy. This stuff matters.  Learn more  Dismiss

Reconstruction from brain activity

Loading...

Sign in or sign up now!
Alert icon
Upgrade to the latest Flash Player for improved playback performance. Upgrade now or more info.
1,932,500
Loading...
Alert icon
Sign in or sign up now!
Alert icon

Uploaded by on Sep 21, 2011

** PLEASE READ THE CAPTION TO UNDERSTAND THIS VIDEO **
The left clip is a segment of a Hollywood movie trailer that the subject viewed while in the magnet. The right clip shows the reconstruction of this segment from brain activity measured using fMRI. The procedure is as follows:
[1] Record brain activity while the subject watches several hours of movie trailers.
[2] Build dictionaries (i.e., regression models) that translate between the shapes, edges and motion in the movies and measured brain activity. A separate dictionary is constructed for each of several thousand points at which brain activity was measured.
(For experts: The real advance of this study was the construction of a movie-to-brain activity encoding model that accurately predicts brain activity evoked by arbitrary novel movies.)
[3] Record brain activity to a new set of movie trailers that will be used to test the quality of the dictionaries and reconstructions.
[4] Build a random library of ~18,000,000 seconds (5000 hours) of video downloaded at random from YouTube. (Note these videos have no overlap with the movies that subjects saw in the magnet). Put each of these clips through the dictionaries to generate predictions of brain activity. Select the 100 clips whose predicted activity is most similar to the observed brain activity. Average these clips together. This is the reconstruction.

For a related video see: http://www.youtube.com/watch?v=KMA23JJ1M1o
For the paper (Nishimoto et al., 2011, Current Biology) go to:http://dx.doi.org/10.1016/j.cub.2011.08.031
For more information about this work, please check our lab web site:http://gallantlab.org

Category:

Science & Technology

Tags:

License:

Standard YouTube License

Link to this comment:

Share to:

Top Comments

  • Thanks, Hank Green.

  • @skarfaced That is a disturbingly naive comment. Who's in charge of what actions are considered crimes, afterall? It'll start with actions "for our own protection" and creep slowly on from there until we're all in danger of convictions for thought crimes.

see all

All Comments (1,949)

Sign In or Sign Up now to post a comment!
  • @Lbrtyordth8

    the new SOPA

    lmao

  • @kinflyer it's not

  • it's like their brains were trying to match the image up with something else from memory...

  • Could anybody tell me this is real time detection or not?

  • Amazing application of Bayes rule. Just terrific.

  • Can this reconstruct sound? It would be cool if it could.

  • try this on me if you want really strange porn

  • the question is... how does our mind reconstruct the videos on the right that are reconstructions of the videos on the left. brainception

  • i bet they could learn secrets of the universe by studying mine!

  • we are one more step closer to mind reading, congratulations for the study

Loading...

Alert icon
0 / 00Unsaved Playlist Return to active list
    1. Your queue is empty. Add videos to your queue using this button:
      or sign in to load a different list.
    Loading...Loading...Saving...
    • Clear all videos from this list
    • Learn more