Internet Archive
Internet Archive | |
Formation | 1996 |
---|---|
Type | on-line library |
Website | www.archive.org |
The Internet Archive (IA) is a non-profit organization dedicated to maintaining an on-line library and archive of Web and multimedia resources. Located at the Presidio in San Francisco, California, this archive includes "snapshots of the World Wide Web" (archived copies of pages, taken at various points in time), software, movies, books, and audio recordings. To ensure the stability and endurance of the archive, IA is mirrored at Bibliotheca Alexandrina in Egypt, the only library in the world with a mirror.[1] The IA makes the collections available at no cost to researchers, historians, and scholars. It is a member of the American Library Association and is officially recognized by the State of California as a library.[2]
Contents |
History
The Internet Archive was founded by Brewster Kahle in 1996.
According to its website:
- Most societies place importance on preserving artifacts of their culture and heritage. Without such artifacts, civilization has no memory and no mechanism to learn from its successes and failures. Our culture now produces more and more artifacts in digital form. The Archive's mission is to help preserve those artifacts and create an Internet library for researchers, historians, and scholars. The Archive collaborates with institutions including the Library of Congress and the Smithsonian.
Because of its goal of preserving human knowledge and artifacts, and making its collection available to all, proponents of the Internet Archive have likened it to the Library of Alexandria.
Wayback Machine
Examples from the Wayback
Machine's archives:
The Wayback Machine is the Internet Archive's archive of snapshots of the Web, and is maintained with content from Alexa Internet. This service allows users to see archived versions of web pages across time—what the Archive calls a "three dimensional index."
Snapshots become available 6 to 12 months after they are archived. Users who want to permanently archive material and immediately cite an archived version can use the Archive-It system instead.
As of 2006 the Wayback Machine contained almost 2 petabytes of data and was growing at a rate of 20 terabytes per month, a two-thirds increase over the 12 terabytes/month growth rate reported in 2003. Its growth rate eclipses the amount of text contained in the world's largest libraries, including the Library of Congress. The data is stored on Petabox rack systems manufactured by Capricorn Technologies.[3]
The name Wayback Machine is a reference to a segment from The Rocky and Bullwinkle Show in which Mr. Peabody, a bow tie-wearing dog with a professorial air, and his human "pet boy" assistant Sherman use a time machine called the "WABAC machine" to witness famous events in history.[4]
Media collections
In addition to web archives, the Internet Archive maintains extensive collections of digital media that are either public domain or licensed under a license that allows redistribution, such as the Creative Commons License. The media are organized into collections by media type (moving images, audio, text, etc.), and into sub-collections by various criteria. Each of main collection includes an "Open Source" sub-collection where general contributions by the public can be stored.
Moving image collection
Aside from feature films, IA's Moving Image collection includes: newsreels; classic cartoons; pro- and anti-war propaganda; Skip Elsheimer's "A.V. Geeks" collection; and ephemeral material from Prelinger Archives, such as advertising, educational and industrial films and amateur and home movie collections.
IA's Brick Films collection contains stop-motion animation filmed with LEGO bricks, some of which are 'remakes' of feature films. The Election 2004 collection is a non-partisan public resource for sharing video materials related to the 2004 United States Presidential Election. The Independent News collection includes sub-collections such as the Internet Archive's World At War competition from 2001, in which contestants created short films demonstrating "why access to history matters." Among their most-downloaded video files are eyewitness recordings of the devastating 2004 Indian Ocean earthquake.
Some of the films available on the Internet Archive are:
Audio collection
The audio collection includes music, audio books, news broadcasts, old time radio shows and a wide variety of other audio files. The Live Music Archive sub-collection includes 40,000 concert recordings from independent artists, as well as more established artists and musical ensembles with permissive rules about recording their concerts.
Texts collection
The texts collection includes texts from Project Gutenberg as well as texts from various libraries around the world and a collection of papers and memoranda from the Arpanet.
Open Library
The Internet Archive is a member of the Open Content Alliance, and operates the Open Library where more than 200,000 scanned public domain books are made available in an easily browsable and printable format.[5][6] Their "Scribe" book imaging system was used to digitize most of these books.[7] The software that runs it is free/open source software—Scribe Software.
Controversies
Scientology sites
- See also: Scientology versus the Internet
In late 2002, the Internet Archive removed various sites critical of Scientology from the Wayback Machine.[8] The error message stated that this was in response to a "request by the site owner."[9] It was later clarified that lawyers from the Church of Scientology had demanded the removal, on unknown legal grounds, and that the actual site owners did not want their material removed.[10]
Archived web pages as evidence
In an October 2004 case called "Telewizja Polska SA v. Echostar Satellite", a litigant attempted to use the Wayback Machine archives as a source of admissible evidence, perhaps for the first time. Telewizja Polska is the provider of TVP Polonia and EchoStar operates the Dish Network. Prior to the trial proceedings, EchoStar indicated that it intended to offer Wayback Machine snapshots as proof of the past content of Telewizja Polska’s website. Telewizja Polska brought a motion in limine to suppress the snapshots on the grounds of hearsay and unauthenticated source, but Magistrate Judge Arlander Keys rejected Telewizja Polska’s assertion of hearsay and denied TVP's motion in limine to exclude the evidence at trial.[11] However, at the actual trial, district Court Judge Ronald Guzman, the trial judge, overruled Magistrate Keys' findings, and held that neither the affidavit of the Internet Archive employee nor the underlying pages (i.e., the Telewizja Polska website) were admissible as evidence. Judge Guzman reasoned that the employee's affidavit contained both hearsay and inconclusive supporting statements, and the purported webpage printouts themselves were not self-authenticating.[12]
Grateful Dead
In November 2005, free downloads of Grateful Dead concerts were removed from the site. John Perry Barlow identified Bob Weir, Mickey Hart, and Bill Kreutzmann as the instigators of the change, according to a New York Times article.[13] Phil Lesh commented on the change in a November 30, 2005, posting to his personal website:
- It was brought to my attention that all of the Grateful Dead shows were taken down from Archive.org right before Thanksgiving. I was not part of this decision making process and was not notified that the shows were to be pulled. I do feel that the music is the Grateful Dead's legacy and I hope that one way or another all of it is available for those who want it.[14]
A November 30 forum post from Brewster Kahle summarized what appeared to be the compromise reached among the band members. Audience recordings could be downloaded or streamed, but soundboard recordings were to be available for streaming only. Concerts have since been re-added.[15]
Issues with change of domain owners
Due to the nature of the Internet Archive's policy of removing sites that disallow bots to index pages (through the use of robots.txt) a number of websites over the years have now become inaccessible through the Wayback Machine. This is generally due to a new domain owner placing a robots.txt file that disallows indexing of the site. This practice would appear to be detrimental to researchers looking for information that was available in the past. The administrators claim to be working on a system that will allow access to that previous material while excluding after the point the domain switched hands.[citation needed] Currently, the Internet Archive applies robots.txt rules retroactively; if a site blocks the Internet Archive, any previously archived pages from the domain are also removed. In cases of blocked sites, only the robots.txt file is archived.
However, IA also states that, "sometimes a web site owner will contact us directly and ask us to stop crawling or archiving a site. We comply with these requests." [1] They also say, "The Internet Archive is not interested in preserving or offering access to Web sites or other Internet documents of persons who do not want their materials in the collection." [2]
Automatically entered contracts
On December 12, 2005, activist Suzanne Shell demanded Internet Archive pay her US$100,000 for archiving her website profane-justice.org between 1999 and 2004.[16] Internet Archive filed a declaratory judgment action in the United States District Court for the Northern District of California on January 20, 2006, seeking a judicial determination that Internet Archive did not violate Shell’s copyright. Shell responded and brought a countersuit against Internet Archive for archiving her site, which she alleges is in violation of her terms of service.[17] On February 13, 2007, a judge for the United States District Court for the District of Colorado dismissed all counterclaims except breach of contract.[16] The Internet Archive did not move to dismiss copyright infringement claims Shell asserted arising out of its copying activities, which will also go forward.[18] On April 25, 2007, Internet Archive and Suzanne Shell jointly announced the settlement of their lawsuit. The Internet Archive said, “Internet Archive has no interest in including materials in the Wayback Machine of persons who do not wish to have their Web content archived. We recognize that Ms. Shell has a valid and enforceable copyright in her Web site and we regret that the inclusion of her Web site in the Wayback Machine resulted in this litigation. We are happy to have this case behind us.” Ms. Shell said, “I respect the historical value of Internet Archive’s goal. I never intended to interfere with that goal nor cause it any harm.”[19]
See also
Similar projects
- Library of Congress Digital Library project
- National Digital Information Infrastructure and Preservation Program
- Ourmedia - Internet Archive project that freely hosts public image, text, audio, and video submissions
- Project Gutenberg
- WebCite
Other
References
- ^ The Internet Archive at the New Library of Alexandria
- ^ " Internet Archive officially a library", May 2, 2007.
- ^ Kanellos, Michael. "Big storage on the cheap", CNET News.com, July 29, 2005. Retrieved on 2007-07-29.
- ^ Green, Heather. "A Library as Big as the World", BusinessWeek, February 28, 2002. Retrieved on 2007-07-29.
- ^ Gonsalves, Antone. "Internet Archive Claims Progress Against Google Library Initiative", InformationWeek, December 20, 2006. Retrieved on 2007-01-05.
- ^ "The Open Library Makes Its Online Debut", Chronicle of Higher Education, The Wired Campus, July 19, 2007. Retrieved on 2007-07-30.
- ^ Olsen, Stefanie. "An open-source rival to Google's book project", CNET News.com, October 26, 2005. Retrieved on 2007-07-29.
- ^ Bowman, Lisa M. "Net archive silences Scientology critic", CNET News.com, September 24, 2002. Retrieved on 2007-01-04.
- ^ Jeff (23 September 2002). exclusions from the Wayback Machine (Blog). Wayback Machine Forum. Internet Archive. Retrieved on 2007-01-04. Author and Date indicate initiation of forum thread
- ^ Miller, Ernest (24 September). Sherman, Set the Wayback Machine for Scientology (Blog). LawMeme. Yale Law School. Retrieved on 2007-01-04. The posting is billed as a 'feature' and lacks an associated year designation; comments by other contributors appear after the 'feature'
- ^ Gelman, Lauren (17 November 2004). "Internet Archive’s Web Page Snapshots Held Admissible as Evidence". Packets 2 (3). Retrieved on 2007-01-04.
- ^ Howell, Beryl A. (February 2006). "Proving Web History: How to use the Internet Archive" (PDF). Journal of Internet Law: 3–9. Retrieved on 2007-01-04.
- ^ Jeff Leeds, Jesse Fox Mayshark. "Wrath of Deadheads stalls a Web crackdown", International Herald Tribune (republication of article from New York Times), December 1, 2005. Retrieved on 2007-01-04.
- ^ Phil Lesh (30 November 2005). An Announcement from Phil Lesh (Blog). Hotline. PhilLesh.net. Retrieved on 2007-01-05.
- ^ Brewster Kahle; Matt Vernon (1 December 2005). Good News and an Apology: GD on the Internet Archive (Blog). Live Music Archive Forum. Internet Archive. Retrieved on 2007-01-05. Authors and date indicate the first posting in the forum thread
- ^ a b Lewis T. Babcock (13 February 2007). Internet Archive v. Shell (PDF), Civil Action No. 06cv01726LTBCBS.
- ^ Claburn, Thomas. "Colorado Woman Sues To Hold Web Crawlers To Contracts", InformationWeek, March 16, 2007. Retrieved on 2007-07-29.
- ^ Samson, Martin. Internet Archive v. Suzanne Shell. via Phillips Nizer LLP
- ^ Internet Archive and Suzanne Shell Settle Lawsuit, April 25, 2007.
External links
- The Internet Archive
- The International Internet Preservation Consortium (IIPC)
- BLOG - What's New at the Internet Archive
- Library of Congress, Web Capture
- National Digital Information Infrastructure and Preservation Program
- The Open Library
- Wayback Machine
- Pictures and descriptions of the Wayback Machine hardware in 2003 (prior to the Petabox), with cost information
- Form 990-PF for Internet Archive (2003)
- Archive-It 1.5 Press Release and Archive-It FAQ
- Warrick – a tool for recovering websites from the Internet Archive and search engine caches
- Video interview with Internet Archive founder Brewster Kahle (short intro in German language, the interview is in English with German subtitles)
- The European Archive in Amsterdam
- * Wikipedia:Using the Wayback Machine - A guide to the Internet Archive's Wayback machine.