Google Buys Deja Archive

The search engine company buys Deja.com's usenet newsgroup archive. While users are happy the archive will live on, they aren't thrilled that postings before August 2000 are taken offline while Google incorporates the database. By Michelle Delio.

Reader's advisory: Wired News has been unable to confirm some sources for a number of stories written by this author. If you have any information about sources cited in this article, please send an e-mail to sourceinfo[AT]wired.com.

Search Engine Google has acquired one of the Web's most venerated resources, Deja.com's Usenet Discussion Service, and plans to build a new service incorporating its search technology. The collection contains more than 500 million Usenet newsgroups messages dates back to 1995.

Deja.com struggled for the past two years to find a way to turn a profit on its Usenet archive, which caused many Internet enthusiasts to worry that the irreplaceable archive would disappear in another case of dot.com departures. Web enthusiasts warmly greeted news that Google would take over maintaining the record of messages where people freely shared opinions and information.

But some were angered to learn they wouldn't have access to the complete Deja Usenet archive and services during a transition period.

Attempts to access Deja.com lead directly to Google's site where users can only search Usenet postings that date back to August 2000, which is when Google began doing its own archiving of Usenet.

Add all user accounts at Deja.com, which allowed people to post to Usenet, have vanished, although deja.com e-mail is still functioning.

"I was using Deja this morning, and the transition happened mid-post. Now my account has disappeared, and it seems that it won't be coming back as Google has announced (in its press release)," said Jeff Adams, a freelance medical researcher.

But the real furor is being reserved for the sudden removal of Deja's Usenet archives.

"I use Usenet almost every day," fumed Mike Milgen, an open source programmer. "Deja is the best place to answer any questions I have about Linux issues. Now the only stuff that's available is from August 2000 onwards! I don't know how I will finish this project if I can't access Usenet archives."

Milgen and others feel that Google "should have left the archive alone until they were able to provide access to the entire collection of posts."

"Usenet is a treasure that belongs to all of us who ever participated in newsgroups. Now a huge chunk of the Internet has been made inaccessible. I really hope Google kicks it into gear very soon," said Jerry Frank, a systems support manager with RealTech.

People can still access postings through newsgroup reader software, but the service does not archive older messages. Usenet launched its newsgroup service in 1979.

Google did not immediately answer calls requesting comment, but the company posted a statement on its website stating the entire Deja database is being reformatted and optimized to give speedy access to its over 500 million archived messages, many of which had been taken offline previously.

"Google has been working non-stop to ensure access remains available to the largest archive of newsgroups on the net," the statement said.

Many think the Deja database is overdue for a good cleanup. "There have been definite problems with Deja's archiving lately. There are missing news articles, and big gaps in the post threads, along with damaged links that lead nowhere. If Google can really repair and restore Deja's newsgroup archives, then more power to them. And I am willing to wait if it means we will have full access to that database again," said Frank.

"Google needs to remember that they have an irreplaceable and invaluable asset in their hands," Frank said. "Google has a great reputation among the Internet community, but mismanaging this could do them a lot of damage."