Bing vs. Google rematch: Who's getting better, quicker?

By Scott M. Fulton, III | Published August 14, 2009, 4:40 PM

Two months ago, Microsoft unveiled its revamped Bing search service, touting it as a "decision engine." There were some genuine new advantages which we did discover, but not everything appeared ready for Bing's first outing, and we were told to expect improvements to some features "in the coming weeks." Not months, weeks.

So this is August, and (do forgive me) what hath Bing brung? In our June series of Face-offs, the final score was Google (4), Bing (3) -- not necessarily a runaway, but good enough for the champion to not feel immediately threatened. With Google testing improvements to its search engine, we wondered if we'd find any evidence of tweaking on Bing's side as well. We've decided to put both services through the same paces a second time to see which service is the one that's really gunning for a rematch.

Obscure literary quotes. In our very first heat last June, Bing did a good job of identifying a passage from psychologist Carl Jung, but Google took us straight to the book. This time, we wondered whether Bing or Google could pull up the identity of a translated poem that is itself excerpted, perhaps only once in modern literary history, in a semi-obscure work of fiction. The original source of the poem is an English-language translation of the Diamond Sutra, a statement of the Buddhist faith believed to be the oldest printed book in existence. It could be translated many ways, so the specific English translation we used might give away its translator.

Thus-Gone to Thus-Gone, I with a Buddha's hand
Offer the unplucked flower, the frog's soliloquy
Among the lotus leaves, the milk-smeared mouth
At my full breast and love, like the cloudless
Sky that makes possible mountains and setting moon,
This emptiness that is the womb of love,
This poetry of silence.

The translator in this case is Aldous Huxley, who cited it in one of his last works of fiction, Island. To begin, we tried the first line of the excerpt, which is so unique that it could only apply to either Island or to some discussion of the Diamond Sutra. Item #1 from Google was a page of Huxley's various poems from the same book, while #2 led to a Google Books excerpt from Island itself. No mention of the Diamond Sutra, but still a correct identification.

Bing returned six results for the query as opposed to Google's two, and the #1 result was the same page of Huxley's poem excerpts from a site devoted specifically to the book, Island.org. But #5 on Bing's list was a surprise: a link not to Google Books, but to an independent researcher's page devoted to Aldous Huxley where the entire text of the book could also be found. Granted, the excerpt in question wasn't automatically highlighted like in Google Books, but it wouldn't take but a moment for the browser user to hit Ctrl+F and do an in-page search.

Here's something else we discovered, curiously enough: When we tried for a unique phrase from later in the poem, frog's soliloquy, Google no longer retrieved results from its own Google Books, even though that phrase definitely appears in its version of the excerpt. Bing, meanwhile, continued to point to Huxley.net.

So essentially, it really is possible for Bing to pull up results that are as useful as Google's, in situations where someone else besides Google compiles the database. It's curious that Google's search results omit the reference to Huxley.net, especially since that site has some other Huxley-related resources that might be of interest to a researcher. It's that curious omission which prompts me to give Bing the nod in this particular heat.

Best price on a 1 TB hard drive. One of the features Microsoft touted right away as a proof-of-concept of its "decision engine" motif is its shopping service. We really liked what we found back in June.

So what happened to the big "Shopping" button on the left side? When we tried our 1 TB hard drive entry in Bing a second time (obviously, without enough information in the query to infer that we're shopping for prices), we had to click on the little-bitty "Shopping" button on Bing's menu bar, which today is buried beneath a picture of a ram's horn.

Evidence of Google's slight tweaks to its shopping section, including narrowing down options to just the best prices.

In fairness, Google makes you click on the same button, but I can't exactly say that Bing is improving for working more like Google. While Bing's Shopping page results remain fairly functional, Google has made some subtle improvements over the past few months. Most notably, the range of prices from various retailers (some of which were a bit dubious, and some which were clearly misinterpreted) has been replaced with a single price and a single vendor listing.

On the one hand, that seems logical -- folks who are shopping for hard drives are usually looking for the best price. Usually. But the second criterion is often quality of vendor; and at the moment, you actually cannot go "shopping," as it were, between vendors -- Google does the shopping for you. I don't want anyone else's "decision engine" doing the deciding for me, thank you very much (which is bad news for Amazon, which gets some serious star treatment in Google's rankings). When I click on Google's listing, it takes me to the vendor it selected; when I click on Bing's listing, it takes me to a list of other vendors offering the same item, which is something I actually want to see.

So I'm actually increasing the size of this particular win for Bing, even though Bing's demotion of the "Shopping" button isn't really an improvement.

Next: Finding that girl from that show with the other girl, you know the one...

1 | 2 | Next Page →

Comments

View comments by with a score of at least

Really enjoyed the different ways you tested the capabilities of both Bing and Google. It's interesting to see the progress of a search engine that is launched up against a giant like Google.

We did some similar research during a week-long experiment and have our findings posted at www.t-3.com/blog -- we would love to get your feedback or input on some of the things we tested out and what we discovered.

Score: 0

|

I find myself happily using Bing 90% of the time now. It returns very useful results. A bit less junk than google these days.

Score: 0

|

I am considering dumping Google and switching to Bing since they have messed up with the colors on their US results page.

Score: 0

|

I like both,. I use the FF plugin that displays both at once, and depending on what I'm looking for, both have their strengths.

Score: 0

|

i like bing, but i cannot change my customer of using google searching sth!

Score: 0

|

Bing will get some better, if they cannibalize things properly from Yahoo. But then, because of the smarmy way that Microsoft operates, I won't use it until it is proven that it beats Google 90% of the time. (translation, I'll probably never use Bing again).

Score: 1

|

I'll give at least another 6 months to even try Bing again. If I search Google using my shop's name, it'll always be #1. For Bing, not even in the first 10 pages (and I stopped there). Note that my shop's name is very unique.

Score: 1

|

Microsoft seems to be playing Pepsi to someone else's Coke in quite a few places. Like Pepsi could never un-seat Coke, is it that once the market leader is established, you can't win by being a bit better? You're only chance is to do something game changing. Is Bing game changing? I think the answer is no. Can it ever be more than a Pepsi to Google's Coke? Not based on what it is today.

Score: 7

|

Many in Germany do not know Bing unfortunately. 90% use google. I find Bing very well successful.

Score: 1

|

PDC 2009: What have we learned this week?

There was the freebie that no one will forget, the heebie-jeebies courtesy of Scott Guthrie, and a teensy bit clearer picture of how this cloud thingie should work.

Live report: Will Google Chrome OS change Linux?

The mysteries of just what Chrome OS is, and how much of an operating system it truly is, may be resolved today.

PDC 2009: Microsoft cares about Web browser performance

The effort to give users of the world's dominant Web browser the impression of quality, is a personal one for the man who leads that battle.

Nokia re-affirms its commitment to Symbian, sort of

Maemo won't necessarily be replacing Symbian in the Nokia N-Series, but that's definitely a place where it will be found.

E-book readers will be in short supply this holiday season

E-readers are hot this year, and a lot of compelling new products have been released, but are there enough electrophoretic displays to go around?

Sony looks to finally open a single storefront for downloads

Sony has had many different download portals for movies, music, e-books, and games, and now it's looking to make a single shop for all of it.

Tuning out the tablet: Time to give the endless speculation a rest

Wide Angle Zoom: Wishing and hoping and thinking and praying....won't put an iTablet on the market.

Five improvements for IT managers in 2010

If businesses are to improve their efficiency for next year, they need to stop and reassess the basic tenets of their job.

AOL's spinoff from Time Warner to shed 2,500 jobs

As AOL moves toward become an independent company again, it will cut nearly a third of its workforce.

Gartner: SMS-based money transfer will be bigger than mobile browsing, search

Gartner issues its predictions for the 10 things our phones will be doing in 2012.

Don't forget to upgrade to Firefox 3.6 beta 3 today

Mozilla has released the latest beta its Firefox 3.6 browser software, just over one week after beta 2.