Amazon Opens Up Alexa Search Index

By Nate Mook | Published December 13, 2005, 1:45 PM

Amazon on Tuesday rolled out the Alexa Web Search Platform, which opens up 5 billion documents and 300 terabytes of data to anyone, along with offering computer and storage time for processing tasks. The idea is to enable the creation of new services that utilize Alexa's vast Web archive and search technology.

In its simplest form, Amazon is providing storage space and server power to users at a price of $1 per CPU hour consumed, $1 per gig of storage used, $1 per 50 gigs of data processed, and $1 per gig of data uploaded. A user will have access to the equivalent of a 3.6GHz Linux server with 4GB of memory.

The Alexa platform offers a giant data store for users, currently boasting 12 terabytes of space. This storage area is separate from Alexa's own Web data, which is comprised of three separate snapshots of the Internet. Each snapshot includes 100 terabytes of files and a new snapshot is rotated in every two months.

"Anyone can also use Alexa's servers and processing power to mine its index to discover things - perhaps, to outsource the crawl needed to create a vertical search engine, for example," explains search expert John Battelle.

"Or maybe to build new kinds of search engines entirely, or ...well, whatever creative folks can dream up. And then, anyone can run that new service on Alexa's (er...Amazon's) platform, should they wish."

Amazon has put together an example photo search that takes advantage of the Alexa platform to seek out photos with very specific parameters such as camera model, exposure time and more. Such vertical searches are not currently possible on closed search platforms such as Google and Yahoo.

"In other words, Alexa and Amazon are turning the index inside out, and offering it as a web service that anyone can mashup to their hearts content. Entrepreneurs can use Alexa's crawl, Alexa's processors, Alexa's server farm....the whole nine yards," adds Battelle.

Because the Alexa Web Search Platform is currently in beta, only a limited number of accounts will be available. Signing up is free, and accounts will be billed once a month for the services used. Amazon account managers will aid in the process of getting users setup and answer any questions.

A FAQ and user guide are available detailing how ASWP can be used by developers.

Comments

View comments by with a score of at least

Alexa isn't really "spyware". It just takes anything you ask/enter into it, and stores it for the future.

Services like Google only record counts - they don't store sensitive stuff like which IP requested "Kill Bush". :P

Alexa also comes preinstalled on computers, so people don't realize everything they search or ask about is being logged and pinned to their IP.

Score: 0

|

Alexa is spyware.

Spyware teh suck.

Duh.

Score: 0

|

Alexa...heh heh heh recognize the name from removing it using Spybot S&D...

Score: 0

|

Brits - you're out, for the moment. US only.

Score: 0

|

Comcast deal for NBC Universal is about content, not broadband

Although Comcast is certainly America's largest broadband provider, at least for PCs, in most regards, today's deal with GE may not impact the Internet at all.

The Black Screen Syndrome, or, Tech news in search of the apocalypse

Scott Fulton On Point: This is a story about something that should not have been a story, about something that at one time was a story.

Five compact digital camera myths and realities

This holiday 2009 primer offers tips on what and what not to look for in a compact digital camera.

Mark Russinovich on MinWin, the new core of Windows

The next version of Windows three years hence will likely build onto a significant architectural change implemented in Windows 7 and Server 2008 R2.

Android team updates 'Donut' and 'Eclair' SDKs

The Android SDK includes components which optimize app development for each version of the mobile operating system. Today, the 1.6 and 2.0 components got updates.

See ya later, WinMo: Microsoft's mobile strategy needs a reboot

Carmi Levy | Wide Angle Zoom: Hands up if you're considering upgrading to a Windows phone for the holidays...Anybody?

Online advertising evolves away from display, toward interactive software

Marketing departments and agencies are increasingly establishing positions for "creative technologists" who can steer designers and developers toward platforms that enable direct connections with consumers.

Google begrudgingly adjusts news crawling for paid publishers

If publishers want to make readers pay for news content, and thereby drive down its popularity and Google ranking, the company says, they can just go right on ahead.

Fee or free? Murdoch, Huffington square off over the cost of Internet news

Participants in an FTC workshop yesterday witnessed the two extremes of the Web news publishing debate, still centered on the issue of long-term profitability.

Security firm: Windows patches not responsible for 'Black Screen of Death'

On second thought, maybe that access control list thingie with the lockdown something-or-rather didn't trigger an alleged, perhaps non-existent, pandemic.

Apple settles with Psystar except for 'circumvention devices'

The fracas with the Florida clone computer maker might have ended today had Apple not have muddled the issue over a cheap piece of Psystar software.