Microsoft Looks to Photos for Search

By the Betanews Staff | Published April 17, 2006, 3:50 PM

Microsoft is working on a way to search the Internet by submitting a photo shot by a cell phone to represent what the user is searching for. The effort is part of a bigger project by Microsoft Research called Photo2Search to make search technologies more usable on cell phones. The search engine would return Web sites that match items in the photo, or similar photos found across the Internet.

By including the details of what a photo captures, Microsoft says the results produced are more useful. According to Microsoft researcher Xing Xie, "the value of camera phones on daily information acquisition" has been overlooked. The findings are planned to be released in mid-May as part of a larger research paper titled "Photo-to-Search: Using Camera Phones to Inquire of the Surrounding World" in Nara, Japan.

Comments

View comments by with a score of at least

Why is it that everytime someone has a great idea the overwhelming reaction from people on the internet is to focus on what the technology “can't” do.

If you took the time to go to the Microsoft Research website and searched the net for 2 or 3 minutes you would be able to get a better idea of what this is intended for.

Sure if I point this thing at a pair of football boots it will have no idea if I mean soccer, rugby, grid iron or aussie rules football boots and would probably get “shoes” at best.

If I instead point the camera at the barcode on the box we are talking a different story.

Competitive shopping sites and Google’s “innovative” Froogle should watch out.

This is one of many different ideas they have for this technology.

Score: 0

|

This is the same as going into a restaurant and immediately getting served their top selling meal with beverage. "Hey, we just want to make it simple for you, sir". :)

So no, even if I explicitly told you I am looking at a movie poster for Movie XYZ, there is no way in the world you could know whether I want to know who stars in it, to buy a ticket, see how much it grossed, when it was released, or a billion and one other questions I may have had in mind. Scrolling through a menu giving me those options is extremely lame when I can specify exactly what I wanted in a search box "[where was it]filmed in".

To me it makes more sense to SPEAK what I am looking for, and have my cell phone send that request for speech recognition or possibly even human assisting in giving you the best info you could possibly want on it... Why? Because you'd wanna sell me something together with the answer... (the ticket, an audio commercial), or just because I'm paying a monthly fee for those researched answers...

Score: 0

|

So now we don't even have to put any thought into typing those confusing word things to look up stuff on the internet.

Screw edukashion, let’s just cater to a nation / world of illiterates.

Score: 0

|

Wow, another useless way to spend millions.
I want to search for my stocks in microsoft, what do i take a picture of?

Score: 0

|

I'm sorry. But I think you need to broaden your horizon a little.

Microsoft Research spends millions on "useless" technologies such as this one. Only a small percentage of these stuff actually make into a real product.

But this is how innovation works.

Score: 0

|

lmao

microsoft...innovative?

i don't think so

Score: 0

|

Microsoft? No. But Microsoft Research does a lot of really interesting, cool, and, yes, innovative things.

Unfortunately, most of it never sees the light of day, but then most of it probably isn't interesting to most people either.

Score: 0

|

Let's see how long it takes Microsoft to buy out this company and incorporate their technology with Photo2Search:

http://www.myheritage.com/

Score: 0

|

LOL. The site is fun. But it's mostly crap, I think. Still too immature.

Score: 0

|

Wow, The possible misuse of this tool brings a smile to my face. :)

Score: 0

|

all of a sudden the word "porn" came to mind

Score: 0

|

And why shouldn't it? It's a major driving force in most media-based industries these days...

Score: 0

|

i agree

Score: 0

|

Microsoft's Ray Ozzie: 'Nobody's going to be 100% open'

The mobile apps ecosystems of the world may converge over time, led by apps being ported over across platforms, according to the Chief Software Architect.

Will Firefox beat IE9 to Direct2D rendering?

Just days after Microsoft executives gave conference attendees a peek at a new rendering technology, a Mozilla contributor revealed he's working on the same thing.

Where there's smoke: Apple warranty stance raises troubling questions

Carmi Levy | Wide Angle Zoom: Smoking can be dangerous not only for your lungs, it appears, but for your Apple hardware warranty.

AOL's decision to rebrand as Aol. takes a bad brand and makes it worse

The idea behind the social Web is to crowd source before bringing out something new. But not at AOL, which new logo debuted with a cry of "fail!" across the blogosphere and Twittersphere today.

Microsoft 'worked with Apple' for Silverlight on iPhone, says Goldfarb

By not making such a big deal out of trying to stream video to the iPhone, Microsoft got a big deal out of it, revealed the Silverlight product manager.

Clicker.com cuts through the Web video chaos

In a world where homemade video and Hollywood movies travel the same pipeline, it's good to have a real search engine to cut through the clutter.

A case study in improving software: What Office 2010 can learn from Notion 3

A music composition product gambles with a complete overhaul, in an effort to make headway against two well-known competitors in a tough market.

Kindle 2 update adds battery life, native PDF reader

Amazon has pushed out an update to the Kindle 2 e-reader that lengthens battery life and adds a native PDF viewer.

Safari on iPhone gets competition from a $1 browser app

Apple likes to say it gives iPhone users a full browsing experience, but a new competitor tries to incorporate more desktop browser features.

Action Replay maker sues Microsoft for Xbox 360 'predatory technological barriers'

Third-party video game accessory maker Datel has filed an antitrust lawsuit against Microsoft over the Xbox 360's recent Dashboard update.

Microsoft's Bob Muglia and Ray Ozzie on Silverlight vs. standards

Bob Muglia: "We're trying to provide people with an environment that has capabilities that you just simply can't do today in the standards-based world."