DeepShot - Migrating tasks across devices using mobile phone cameras

Deep Shot is a framework for capturing a user's work state that is needed for a task (e.g., the specific part of a webpage being viewed) and resuming it on a different device.
In particular, Deep Shot supports two novel and intuitive interaction techniques, deep shooting and deep posting, for pulling and pushing work states, respectively, using a mobile phone camera.

A user takes a picture of the screen of her computer and then sees the application with the current state on her phone. Our system recognizes the application that the user is looking through the camera, automatically migrates it onto the mobile phone, and recovers its state.

• Category

  Science & Technology

[rashad123us]

Umm, Chrome to phone?

[Onlineshrekjr]

android & imac?

[guygallagher410]

This vid is popular on Vientiane

[nickstout513]

Your video is a favorite on Ghana

[geoff callaghan]

I just found a great cell phone jammer. google :- yapper zapper

[ep010]

Is this the female version of duffy duck speaking

[Felipe Toledo G Oliveira]

2.0

[broetchenmampfer]

Fuck Autofocus!

[gpmoo7]

because the phone sent a message to the computer with the photo it just took and ask the computer to recognize if it may be part of its screen.

[amacaddict]

You have a background process running on all your computers. The software on the phone looks at the picture, seeing the visual 'state' of the computer. It figures out what is open on the computer and opens it on the phone. It's also using URIs to detect states, and they can be transferred back and forth. So when you take a picture of the comp screen, you are actually identifying the target computer by visual 'state', which then gets URI info to the background process from the phone.

[kristaps194]

There must be a pair app for it one the PC. No other explanation I can think of...

[atlien991]

How does the computer even know the phone just took a picture of the monitor???