Inside the old church where one trillion webpages are being saved

CNN via MSN: “Just blocks from the Presidio of San Francisco, the national park at the base of the Golden Gate Bridge, stands a gleaming white building, its façade adorned with eight striking gothic columns. But what was once the home of a Christian Scientist church, is now the holy grail of Internet history — the Internet Archive, a non-profit library run by a group of software engineers and librarians, who for nearly 30 years have been saving the web one page at a time. Inside the stained-glass-adorned sanctuary, the sounds of church sermons have been replaced by the hum of servers, where the Internet Archive’s Wayback Machine preserves web pages. The Wayback Machine, a tool used by millions every day, has proven critical for academics and journalists searching for historical information on what corporations, people and governments have published online in the past, long after their websites have been updated or changed. For many, the Wayback Machine is like a living history of the internet, and it just logged its trillionth page last month. Archiving the web is more important and more challenging than ever before. The White House in January ordered vast amounts of government webpages to be taken down. Meanwhile, artificial intelligence is blurring the line between what’s real and what’s artificially generated — in some ways replacing the need to visit websites entirely. And more of the internet is now hidden behind paywalls or tucked in conversations with AI chatbots. It’s the Internet Archive’s job to figure out how to preserve it all…

The rise of artificial intelligence and AI chatbots means the Internet Archive is changing how it records the history of the internet. In addition to web pages, the Internet Archive now captures AI-generated content, like ChatGPT answers and those summaries that appear at the top of Google search results. The Internet Archive team, which is made up of librarians and software engineers, are experimenting with ways to preserve how people get their news from chatbots by coming up with hundreds of questions and prompts each day based on the news, and recording both the queries and outputs, [says Wayback Machine Director Mark Graham]…Archivists use bespoke machines to digitize books page by page, livestreaming their work on YouTube for all to see (alongside some lo-fi music). Record players churn out vintage tunes from 1920s and 1940s, and the building houses every type of media console for any type of content imaginable, from microfilm, to CDs and satellite television. (The Internet Archive preserves music, television, books and video games, too)… “There are a lot of people that are just passionate about the cause. There’s a cyberpunk atmosphere,” Annie Rauwerda, a Wikipedia editor and social media influencer, said at a party thrown at the Internet Archive’s headquarters to celebrate reaching a trillion pages “The internet (feels) quite corporate when I use it a lot these days, but you wouldn’t know from the people here.”

Posted in: AI, Censorship, E-Records, Freedom of Information, Internet, Knowledge Management, Legal Research, Libraries, Search Engines