Search by Sketch
Loading...
Uploaded by chrisharrisoncmu on Feb 18, 2008
After several months of intense development alongside Stacey Kuznetsov, the Rapid Content-Based Image Search (RCBIS) engine was ready for use in user oriented programs. The most obvious and appealing project was to develop an image search engine which took not text, but a sketch as input. Search by Sketch was born - developed by Stacey Kuznetsov, Teobaldo Fernandez and myself.
Mirroring the RCBIS color model, a limited array of colors is available to users. A usability study found that users wanted to draw unnecessary detail, which wasted time and actually hurt search accuracy. Only one, large brush size is provided to preclude this behavior. The red 'X' icon clears the sketch.
Users can draw into two different sketch panels. The upper panel is used to search for image content. Images that closely matched this sketchy are ranked highly in the search results. However, images that have commonalities with the sketch drawn in the lower panel are negatively weighted in the search results. These two sketch panels provide a mechanism that acts like a boolean search.
Search results are presented in order of relevance, with the closest matches at the top. To provide additional detail for probable matches and include as many results on screen as possible, thumbnail size is varied. Since our image search algorithm is supposed to be fast (as per the 'Rapid' in 'RCBIS'), we can hit the DB many times a second. This allows us to present live search results as users are sketching their input.
Link to this comment:
3:55Content Based Image Retrieval demoby wolverine0473,155 views
- 1:43A New Angle on Cheap LCDs - ACM UIST 2011by chrisharrisoncmu15,491 views
- 4:31PhotoSketch: A sketch based image query and com...by frenchboubek3,331 views
- 2:28TapSense - ACM UIST 2011by chrisharrisoncmu57,882 views
- 5:45PicQuest - A content based image retrieval systemby lafernando7772,128 views
- 2:46Cooliris for iPhone: Search and browse images w...by SuperIPAL5,447 views
- 3:43Boolean Searchingby usfplib7,241 views
- 4:12Dear Snape, Love Nikkiby babyporridge7,624 views
- 2:07Lean and Zoom (Chris Harrison, Anind Dey) - CHI...by chrisharrisoncmu8,571 views
- 3:50Microsoft Live Lab Photosynth demoby herebenotions1,259 views
- 0:38Fun With Chargesby chrisharrisoncmu1,343 views
- 4:46Scratch Input (Chris Harrison, Scott Hudson) - ...by chrisharrisoncmu196,851 views
- 1:32Elastic Vision - Smart Image Searcherby CoolM00n674 views
- 3:10Boolean Operatorsby cutemiffy55,314 views
- 1:31CSE-1 CBIR Seminar 22-09-09 PPT's videoby srikanthdakarapu593 views
- 3:37Tim McGraw - Just To See You Smileby gEoRgEsTrAiTjUnKiE911,185,557 views
- 2:06Picitup Videoby PicitupCorp3,121 views
- 2:16Google Goggles Image Search and OCR Translation...by erwinboogert11,269 views
- 2:00SapirTouch: Similarity based image search engineby raulsantosdelacamara369 views
- 4:06Mobile Visual Search Engine on the Apple iPhoneby EvolutionRobotics150,446 views
cool idea but i think its just useless
huntercross14 10 months ago
How my god, this is fucking genius!!! Can we get a working demo of the software somewhere?
nperriault 3 years ago
jesus 0 comments
amazing work, congrats.
lmjabreu 3 years ago