Could Microsoft Tag augment Windows Mobile reality?

By Joe Wilcox | Published September 18, 2009, 5:28 PM

Microsoft is promoting its Tag barcode system over at its PressPass this week. The PR is a big marketing pitch showcasing brands like Ford and Proctor & Gamble; it's a sensible approach for the technology. But I see another: Making augmented reality more real, and in so doing recover Microsoft's botched handset strategy. AR isn't new, but it's all the geek rage now that iPhone has a compass: BBC, CNET News, Robert Scoble and Telegraph UK, among many others.

A quick AR primer: Augmented reality is essentially the overlay of additional visual information onto something real. American football is great example, where during TV broadcasts yellow lines and other information overlay the field of play. What? You thought those lines were really there? You experienced augmented reality.

AR's future potential on mobile devices is huge, and it's one of the many applications that has me asserting once more that mobile phones will supplant PCs in the not so distant future. Pew Internet says 2020, but I predict 2015 (I really think sooner, but who would believe it?).

A handset with accelerometer, camera, compass and GPS can orientate its position relative to objects as well as geographic location. This orientation, and through the camera ability to identify specific objects, makes it possible for software or service providers to augment reality, perhaps with educational or marketing information.

Informational example: Jack Consumer takes his kids to Washington, DC. Perhaps he uses the phone's GPS to navigate from a Metro station to the National Mall. Along the way, the mapping program offers additional information about historic sites -- even videos or, gasp, special events going on in the area right then. All this overlays the GPS map on the screen. Jack points the phone's camera at the Washington Monument and sees overlay of information about when each portion of the structure was completed, its height and what the heck those flashing lights mean (Jack slept through American history class).

Marketing example: After a hot and humid day walking in the city, Jack's family wants to see Hayao Miyazaki film Ponyo, which Disney recently released in the United States. Jack points the cell phone's camera at a movie poster in the Metro, and the image overlays with theatre locations and showtimes. He then taps the screen for the theatre in Union Station. Based on information contained on the movie poster and gathered from the handset, the mapping service brings up a Metro map. That's augmented reality. Jack conducts a sophisticated search without ever having to launch Bing or Google and type in keywords. But wait, Jack sees another option -- to buy tickets with the tap of the screen.

Making Augmented Reality Real

It's hard to understate augmented reality's potential on mobile devices and, in succeeding, for disrupting keyword search. Yes, keyword search. People will need to manually search less, if the information indirectly comes to them through the mobile software or service or directly by the consumer pointing the camera at something.

I predict that mobile augmented reality will displace mobile keyword search, which is lots worse for Google than Microsoft. I'm assuming it will succeed, just not necessarily as envisioned by all the augmented reality freaks -- eh, geeks -- pining over iPhone's compass: Edible Apple, Fast Company and O'Reilly, among many others.

For all the buzz about iPhone and augmented reality, Apple is a latecomer, following Google and Nokia, among others. Big support came with iPhone 3.1 software, which Apple released last week.

Google Sky Map, for Android phones, is augmented reality for the stars. The software uses a Google phone's accelerometer, compass and GPS to correctly display the right map of the night sky, overlayed with constellation names. Nokia's three year-old MARA (Mobile Augmented Reality Applications) project adds the camera to accelerometer, compass and GPS for overlaying information.

For mobile augmented reality to be most meaningful, it must be real time. Google Sky Map is a good example of real-time augmented reality. But like other augmented reality mapping services, the user is real-time but not necessarily the overlaid information. Augmented reality apps that show, say, friends or Twitter followers in physical relationship to you or local traffic laid out onto a mobile map are much more real time.

The real-time value shouldn't come from disparate apps only tied to the phone's positioning functions but to broader services, or even a software-services platform. There, Nokia's MARA approach, which also utilizes the phone's camera, makes loads of sense. AR can provide information about landmarks, etc. by what the camera sees. The Wikitude Browser for Android phones is product available now for doing just that.

But positioning and landmark/scene recognition are still early stages development and their third-party commerce potential is somewhat limited. For example, Jack Consumer sees where the nearest McDonalds is by way of Nearest Tube. Location is one thing, but where is the menu or today's specials? Additionally, GPS accuracy isn't good close to buildings and essentially useless inside them. The camera can make up where other phone positioning features fall short.

Tag, You're It!

By using the phone's camera, tagging is one way to broaden mobile augmented reality's commercial and even informational appeal. Things tagged with 2D or 3D barcodes could provide much more information, which could be updated real time on the backend service without necessarily changing the tag. Additionally, positioning information from the phone could allow, say, Sony Pictures to distribute the same barcode tagged movie poster nationwide while providing local movie times. Parental control information from the wireless carrier also could ensure that Sandy Teen views the PG-13 and not the R movie trailer on her phone.

Search is a multi-billion business because of keywords. Barcodes/tags could open up the commercial and informational replacement on handsets. Think tagwords or, ah, codewords. I don't suggest that tagging is the only way for mobile augmented reality to go. I'm saying it's a way to, ah, augment augmented reality -- to extend its reach and also to provide a commercial backbone; as search is today for the Web browser.

Like search keywords, competitors could go after tagwords, too. My daughter likes to shop at Forever 21. Price tags with barcodes could bring up competitive prices at other stores when viewed through the cell phone camera. It's comical to think about -- young women leaning over dresses, jeans and tops with their cell phones.

There is yet no mobile barcode economy. Google doesn't control tagwords. Microsoft Tag has potential to become the barcode development and services platform. The Bing and Windows Live teams should be all over Tag. Microsoft isn't exactly early barcode adopter, but there is yet time as there is no widely adopted standard. There are competitors, like Nokia Mobile Codes. Google isn't sitting idly by, either. For example, the aforementioned Sky Map Web page has a ZXing barcode. Just point your Android phone camera to download the application.

Microsoft is building the services infrastructure to do much more, if company executives have the wherewithal. Tags could be the commercial backbone for mobile information, with no manual search necessary. They could build economy into mobile augmented reality.

I say to Microsoft: Don't wait for third parties. Tag it! Tag everything. Microsoft Tag already is available for most mobile platforms, not just Windows Mobile. I would start with Windows Live Maps, augmenting reality in the browser as well as the device. Even do some augmented augmented reality, by overlaying mapped rooftops with Microsoft Tags. The user clicks or touches the Tag to get more information. Sure, you could overlay name of the store, but a mobile barcode could access so much more information tied to a database service.

Building out infrastructure will take years, and Google is sure to push its own technology if Microsoft does. Microsoft cofounder Bill Gates built the company by selling stuff cheaper than competitors and by controlling key file formats and technology standards. The mobile barcode is a technology standard Microsoft shouldn't want any other company to control, particularly Google.

Comments

View comments by with a score of at least

Actual Comment on the Article. I actually have an app on my iPhone (OMG, Apple, not a paid shill)
that if I take a picture of a bar code, will search the interwebs and give me a price match at online stores. I believe it will even use my GPS location to give me some local brick-&-mortar store prices.
I also used to have one of those cat scanners from Radio Shack that could do similar things. I think I still have it around somewhere. :-)

Score: -2

|
Below viewing threshold. Show

Judging from the hard-on Joe has for Microsoft stuff, (everything on this site from him is a Microsoft advertisement) one can only conclude he is a paid Microsoft shill

Score: -4

|

Judging from your hard-on from commenting on every Microsoft article a negative remark and every Apple article with a positive remark. I would say you were an Apple shill. :)

Score: 1

|

-cry cry cry-

How about commenting on the actual article?

Score: 0

|

http://www.betanews.com/...e-Year-Later/1252965092

http://www.betanews.com/...PCs-says-NPD/1248313624

http://www.betanews.com/...rong-reasons/1250099796

http://www.betanews.com/...-about-right/1249593758

So, have you tried Adderall? It could really help you with that, "not being able to focus or concentrate on anything beyond the last 10 seconds" issue.

Score: 0

|

Because every comment out of you is the same thing and it rarely is on the topic. Sure, its about MS but they could be talking about Office and you bring up the Zune. You could leave forever and we could introduce a fatty comment generator and it would be like you never left.

You don't use any of the products you complain about, the 54% was from ONE poll in a videogame magazine. Most reports put it at 25% and since the newest chipset, it appears it is now very minimal. Granted, thats

MS has not been a monopoly for 10 years now, there are hundreds of alternatives out there you can use.

Have you even used MS tag? I am going to go with no...

You point out MS software is expensive but neglect to see that they are a software company mainly and this is how they make their income. Apple charges higher prices on parts that every other pc manufacturer uses - check out ram sold at apple

http://store.apple.com/us/product/MA987G/A

Seriously?

Score: 0

|

As usual... Fatty and his non-facts... I would hate to spend 5 seconds in his version of reality...

Score: 2

|

*How is pointing out the Microsfot XBox with its 54%+ failure rate a POS negative?
Why would you need to point that out? I know they had issues with failing xboxs. I personally had one of them fail on me and got it back with no charge to me within a few weeks. That's more than Apple would do if you overheated your precious.

*How is pointing out the Microsoft Zune as the complete failure it is negative?
Again, you must define complete failure differently. If I sold something that a 10,000 people bought, I would be happy. Of course, this goes great with your Monopoly question. They sure have the market cornered with the Zune.. LOL

*How is commenting Microsoft is a convicted monopolist negative?
Because it is old news. Who cares, Microsoft is a company that attempts to make money. Believe me when I say Apple would do just as much if not worse. Look at how they handle iTunes.

*How is pointing out Microsoft OSes are the most insecure negative?
Apple has been proven to update their security less:
http://blogs.zdnet.com/security/?p=758 (For example).

*How is pointing out Microsoft software as being super expensive negative?

I personally love Windows 7 and it is well worth the cost.

Again, look at how much your "Cheap" iPhone is really costing you:
http://gizmodo.com/50155...3gs-true-price-compared

Granted that a WinMo phone can cost as much. But, certainly not "Super Expensive" compared to Apple offerings. That is just a bs opinion on your part with no research.

*How is pointing out the Microsoft tax negative?
How is not pointing out Apple tax fair? You don't think you aren't taxed to death on the iPhone you carry? What would you propose Microsoft do? Build hardware and put the cost of the OS into that? Oh wait, that would be "Stealing from Apple".

Score: -1

|

Indeed. *faceroll*

Score: -1

|

Google Buzz: Another attempt to harness the content firehose

Similar to how Google successfully remolded RSS into a Google tool, the company now wants to remold Gmail into one big Google party

Success: Google's Nexus One shipping support line takes tech support questions

UPDATED Though the support line had been set up for shipping, it now appears Google personnel are happy to hear technical concerns.

Goodnight, moon: What I learned from a space shuttle

Carmi Levy | Wide Angle Zoom: Can the tech sector learn a few lessons from the space program? Certainly, if you believe in learning from someone else's mistakes.

Netflix to FCC: NBCU + Comcast could bypass net neutrality

Weaning itself from the post office as its main means of video transfer, Netflix would like someone to ensure the Internet remains just as unencumbered.

Rhapsody to become an independent company

RealNetworks and Viacom subsidiary MTV Networks have begun the process of spinning off music service Rhapsody into an independent company.

Nvidia debuts new dynamically-switched graphics card technology

Today, Nvidia announced that its Optimus technology for GPU switching will soon be available in a handful of Asus notebooks.

Google lowers 'unusually high' early termination fee on Nexus One

Google has lowered the Nexus One's early termination fees which were twice as high as the norm.

Netgear and Ericsson introduce a mobile broadband hotspot with a twist

It's a mobile broadband hotspot, but it's for use in the home.

Report: Streaming video drove 72% global increase in mobile data consumption

A new study says streaming video is "the single most influential factor driving the need for increased mobile network capacity."

Stymied by continuing Nexus One 3G issues, Google blames the environment

If you're still afflicted with the 3G flip-flop trouble, then you might consider moving. That appears to be the only suggestion Google can give for now.

Wolfram|Alpha makes a strong argument for virtual keyboards

"Answer engine" Wolfram|Alpha has updated its iPhone/iPod Touch app, harnessing the strength of the virtual keyboard.

XMPlay 3.5.1

February 9 - 5:26 PM ET

KDE 4.4.0

February 9 - 5:05 PM ET

ooVoo for Windows 2.6.0.19

February 9 - 4:23 PM ET

Bullzip PDF Printer 7.1.0.1140

February 9 - 4:02 PM ET

Fraps 3.1.0

February 9 - 3:41 PM ET

cFosSpeed 5.01 Build 1607 Beta

February 9 - 3:20 PM ET