iOS10.2越狱图文教程 iOS10.2越狱工具更新至Beta7
Shadow libraries (also pirate libraries or black open access) are online repositories of freely available digital media that are normally paywalled, access-controlled, or otherwise not readily accessible.[1][2] Shadow libraries usually contain textual works like academic papers and ebooks, and may include other digital media like software, music, or films.
Anna's Archive, Library Genesis, Sci-Hub, UbuWeb and Z-Library are some of the most popular shadow libraries for books and academic literature.[1][3][4]
History
[edit]
 | The examples and perspective in this section deal primarily with Russia and do not represent a worldwide view of the subject. (February 2025) |
Early predecessors to shadow libraries were informal collections of unauthorized digital copies of books, scholarly literature, and other textual media, often shared with small groups via mailing lists, forums, or social media websites.[1]:?1? Online communities of scientists also collaborated to share paywalled literature among themselves.[5]
Many shadow libraries originate in Russia, which has a rich history of samizdat stemming from the Soviet era. There was strict state censorship and control of print materials, which gave rise to the dissident activity of copying and disseminating censored or underground works. Even after the dissolution of the Soviet Union and the end of the official censorship program, these sharing practices continued as a result of widespread economic hardship.[1]:?31–33? Texts were widely digitized and shared on Russian FidoNet systems as computer and internet access became more widespread in Russia. One early collection of digitized texts was Maksim Moshkow's 1994 Lib.ru.[1]:?34–35? The Russian Kolkhoz collection, named for the kolkhoz collective farms, was created by a community that worked in the early 2000s to download or digitize scientific texts, which they stored on FTP servers and DVDs. This collection eventually grew to around 50,000 documents.[1]:?37?
Some of these early collections later became shadow libraries as they attracted volunteer librarians who catalogued the archives' contents. Early academic shadow libraries in the 2000s included Textz.org, Monoskop, and Gigapedia (later Library.nu). Gigapedia focused more on academic texts than other shadow libraries, which mainly contained literature.[1]:?26–27? Around 2006 or 2007, it incorporated the files amassed by the Kolkhoz collectors,[1]:?37? and had become the largest shadow library by 2010.[1]:?26–27? Gigapedia, by then renamed to Library.nu, was shut down in 2012 through a lawsuit from a coalition of seventeen publishing companies including HarperCollins, Oxford University Press, and MacMillan.[1]:?26–27?[6]
Library Genesis (also known as LibGen) was founded in approximately 2007 or 2008 by a group of Russian scientists, who began by organizing a collection of Russian science and technology texts made available on a torrent site, aggregated from sources including the Kolkhoz collection and lib.ru.[1]:?27–28,?38? In 2011, LibGen absorbed the Library.nu collection, keeping it accessible even as Library.nu was forced to shut down. At the time, LibGen was unique in its focus on its open library infrastructure, prioritizing the free sharing of its collection, catalog, and source code to encourage many others to increase shadow libraries' collective resiliency by mirroring and forking the project.[1]:?27–28?
Motivation
[edit]Shadow libraries are part of the open access and open knowledge movements.[1]:?6?[7] They seek to more freely disseminate academic scholarship and other media, often citing a moral imperative to make knowledge freely available.[2]
LibGen's operators have described the site's mission as enabling access to information for poor people and opposing the gating of knowledge by elite academic institutions, with one administrator writing "the target groups for LibGen are poors: Africa, India, Pakistan, Iran, Iraq, China, Russia and post-USSR etc., and on a separate note, people who do not belong to academia. If you are not at a university, you can't access anything or at least your access will be so much troubled that you won't be able to progress at all."[1]:?28? Alexandra Elbakyan, the creator of Sci-Hub, has justified the site by arguing that the lack of open access to scholarship violates the human right to science and culture, captured in Article 27 of the United Nations Universal Declaration of Human Rights, which states: "Everyone has the right freely to participate in the cultural life of the community, to enjoy the arts and to share in scientific advancement and its benefits."[8] Elbakyan has also argued that "Any law against knowledge is fundamentally unjust".[9] American activist Aaron Swartz captured the motivations of many shadow libraries in his 2008 Guerilla Open Access Manifesto,[1]:?28–29? writing:
The world's entire scientific and cultural heritage, published over centuries in books and journals, is increasingly being digitized and locked up by a handful of private corporations. ... Those with access to these resources—students, librarians, scientists—you have been given a privilege. You get to feed at this banquet of knowledge while the rest of the world is locked out. But you need not—indeed, morally, you cannot—keep this privilege for yourselves.
—?Aaron Swartz, Guerilla Open Access Manifesto[10]
Shadow libraries have also cited the increasing cost of academic literature and books, also termed the "serials crisis".[11]
Technologies
[edit]| Part of a series on |
| File sharing |
|---|
 |
Some shadow libraries (or their content databases) make use of BitTorrent (mainly for database dumps), dark web, and InterPlanetary File System (IPFS) technologies to increase their resilience or distribute loads.[12][13][3][2][14] Shadow libraries including LibGen and Anna's Archive develop and make their software accessible as open source software, enabling code development by any volunteer and encouraging mirrors or forks.[1]:?27–28?[15] Anna's Archive claims that "if we get taken down we'll just pop right up elsewhere, since all our code and data is fully open source".[15]
Legal status
[edit]Shadow libraries often host or link to copyrighted material without the consent of copyright holders, making them illegal or dubiously legal in many countries.[1] Such libraries are also described as pirate libraries.[9][1]:?4? Many shadow libraries maintain bibliographic catalogs separate from the hosting of files themselves. This is both an organizational convenience and a protection against legal challenges, since the law is often ambiguous on the distinction between hosting and indexing copyrighted content. However, several shadow library catalogs have been the target of injunctions and takedown threats.[1]:?25–26?
The aggressive legal strategies pursued by Western music and film industries against online filesharing websites during the 2000s were not widely mirrored by academic or literary publishers against shadow libraries. However, as shadow libraries have grown larger and more visible, they have attracted more legal challenges. Library.nu (previously Gigapedia) was shut down in 2012 by a lawsuit from a coalition of seventeen publishing companies including HarperCollins, Oxford University Press, and MacMillan.[1]:?26–27?[6] In 2015, the academic publisher Elsevier sued LibGen and Sci-Hub in American courts, accusing them of "operat[ing] an international network of piracy and copyright infringement".[16] Elsevier won a default judgment against the two groups, and was awarded $15 million in damages, but has not collected the money as LibGen's operators are unknown and Sci-Hub's are outside the reach of the US legal system.[17] Although the judge in the Elsevier case granted an injunction against several domains used by the shadow libraries, briefly taking them offline, the libraries quickly moved to new domains and onion sites.[18][16] A lawsuit by the American Chemical Society in 2017 against Sci-Hub also resulted in a judgment order for $4.8 million in damages.[17] In November 2022, the FBI seized domains associated with Z-Library and charged two of its operators with criminal copyright infringement, wire fraud, and money laundering.[19] Courts have ordered Internet service providers in countries including Denmark, France, Germany, Russia and the United Kingdom to block access to pirate libraries,[20][21] although these blocks are of limited effectiveness.[22]
The legality of directing individuals to shadow libraries is undetermined. While there are legal theories that linking to copyright infringing material hosted by shadow libraries could constitute vicarious or contributory copyright infringement, there have been no cases brought with these theories. In 2019, Elsevier threatened legal action against Citationsy, the developer of a bibliography management tool, for publishing a blog post directing readers to Sci-Hub, and Citationsy removed the link.[23]
Although most academics are not penalized for distributing their own published works for free, academic publishers have threatened scientists for sharing or republishing their work.[24]
Some publishers have accused shadow libraries, including Sci-Hub, of illegally obtaining login credentials to academic databases, though Sci-Hub says the credentials are voluntarily donated.[25]
A class action lawsuit filed in June 2023 against ChatGPT developer OpenAI, led by authors Paul Tremblay and Mona Awad, alleged that the company used shadow libraries to source training data for their large language model.[26][27][28] Meta has also been alleged to have used data from shadow libraries to train its AI model.[29][30] DeepSeek's Vision-Language (VL) model was trained with data from the shadow library Anna's Archive.[31]
Reception
[edit]By academics
[edit]Some academics have tacitly or explicitly endorsed shadow library efforts,[1] with many viewing them as morally acceptable acts of civil disobedience against the abusive business models of academic publishers.[32] Furthermore, shadow libraries may increase the impact of academics whose work is made available. According to one study from Cornell University, articles that are available on Sci-Hub receive 1.72 times as many citations as articles from journals of similar quality that are not available on Sci-Hub.[33]
By non-academic authors
[edit]Non-academic writers have been more vocally opposed to shadow libraries.[9]
In February 2022, after joining a lawsuit with Amazon Publishing and Penguin Random House against a Ukrainian website selling pirated e-books, American bestselling fiction authors John Grisham and Scott Turow published an op-ed in The Hill calling on US lawmakers to pass a law prohibiting search engines from linking to piracy websites.[9][34]
In October 2022, the US-based Authors Guild submitted a complaint to the United States Trade Representative about LibGen and Z-Library, describing digital book piracy as "one of the biggest threats facing authors’ livelihoods today".[35] The Authors Guild and the UK-based Publishers Association both worked with the FBI in efforts against Z-Library, which culminated with November 2022 the arrest of two of its operators.[19]
However, some authors and writers' organizations have opposed such efforts. British novelist Alison Rumfitt wrote in Dazed ?that she was not celebrating the site's takedown, and that "the hunger to read is something to be encouraged, something which, in my opinion, is a societal good; even as publishing grows ever more overtly capitalist and monopolised, reading still thrives, and piracy allows it to take place despite borders and Digital Rights Management. Not everyone has access to a library, and not every library in the world is well-stocked."[36] Dave Hansen, executive director of the Authors Alliance nonprofit, expressed that students and researchers would be negatively impacted by attempts to shut down shadow libraries, and expressed that such projects were "a kind of symptom of how broken the system is, particularly when you’re looking at access to scientific articles".[2]
References
[edit]- ^ a b c d e f g h i j k l m n o p q r s t u Karaganis, Joe, ed. (2018). Shadow Libraries: Access to Knowledge in Global Higher Education. MIT Press. doi:10.7551/mitpress/11339.001.0001. ISBN 978-0-262-34569-9. Archived from the original on July 2, 2021. Retrieved September 23, 2020.
- ^ a b c d Woodcock, Claire (November 30, 2022). "'Shadow Libraries' Are Moving Their Pirated Books to The Dark Web After Fed Crackdowns". Vice. Archived from the original on November 30, 2022. Retrieved November 30, 2022.
- ^ a b Van der Sar, Ernesto (November 19, 2022). ""Anna's Archive" Opens the Door to Z-Library and Other Pirate Libraries". TorrentFreak. Archived from the original on November 19, 2022. Retrieved January 3, 2023.
- ^ "About UbuWeb". ubu.com. Retrieved April 6, 2025.
- ^ Belluz, Julia (February 18, 2016). "Meet the woman who's breaking the law to make science free for all". Vox. Archived from the original on February 19, 2016. Retrieved February 15, 2025.
- ^ a b Losowsky, Andrew (February 15, 2012). "Book Downloading Site Targeted By Publishers". HuffPost. Archived from the original on April 26, 2019. Retrieved February 15, 2025.
- ^ Kodali, Srinivas (January 16, 2023). "Aaron Swartz and His Legacy of Internet Activism". The Wire. Retrieved February 16, 2025.
- ^ Carlton, Amy (May 31, 2016). "Sci-Hub: What It Is and Why It Matters". American Libraries. Archived from the original on September 18, 2016. Retrieved February 15, 2025.
- ^ a b c d Brown, Elizabeth Nolan (July 24, 2022). "You Can't Stop Pirate Libraries". Reason. Archived from the original on October 9, 2022. Retrieved February 15, 2025.
- ^ Aaron Swartz (2008). Guerilla Open Access Manifesto.
- ^ "Trends in the Price of Academic Titles in the Humanities and Other Fields". American Academy of Arts & Sciences. Archived from the original on April 20, 2021. Retrieved February 15, 2021.
- ^ Maxwell, Andy (December 5, 2019). "Meet the Guy Behind the Libgen Torrent Seeding Movement". TorrentFreak. Archived from the original on May 13, 2021. Retrieved October 23, 2020.
- ^ Wodinsky, Shoshana (May 14, 2021). "Archivists Want to Make Sci-Hub 'Un-Censorable'". Gizmodo. Archived from the original on December 25, 2022. Retrieved June 13, 2021.
- ^ Haldane, Matt (April 16, 2022). "A piece of Web3 tech helps banned books through the Great Firewall's cracks". South China Morning Post. Archived from the original on November 29, 2022. Retrieved January 8, 2023.
- ^ a b "Frequently Asked Questions (FAQ)". Anna's Archive. Retrieved February 15, 2025.
- ^ a b Waddell, Kaveh (February 9, 2016). "The Research Pirates of the Dark Web". The Atlantic. Archived from the original on February 15, 2016. Retrieved February 15, 2025.
- ^ a b Trager, Rebecca (November 8, 2017). "Latest legal defeat unlikely to scuttle Sci-Hub". Chemistry World. Retrieved February 15, 2025.
- ^ Van der Sar, Ernesto (November 2, 2015). "Court Orders Shutdown of Libgen, Bookfi and Sci-Hub". TorrentFreak. Archived from the original on May 4, 2020. Retrieved February 15, 2025.
- ^ a b Maiberg, Emanuel (November 17, 2022). "Feds Arrest Two Russians Behind 'World's Largest Library' of Pirated Books". Vice. Retrieved February 15, 2025.
- ^ Maxwell, Andy (September 26, 2019). "Denmark Blocks Sci-Hub Plus Streaming, Torrent & YouTube-Ripping Sites". TorrentFreak. Archived from the original on May 13, 2021. Retrieved February 15, 2025.
- ^ Maxwell, Andy (February 18, 2021). "Sci-Hub: Elsevier and Springer Nature Obtain UK ISP Blocking Order". TorrentFreak. Archived from the original on September 27, 2021. Retrieved February 15, 2025.
- ^ Glance, David (June 15, 2015). "Elsevier acts against research article pirate sites and claims irreparable harm". The Conversation. Archived from the original on October 6, 2015. Retrieved February 15, 2025.
- ^ McKenzie, Lindsay (August 15, 2019). "Linking Liability". Inside Higher Ed. Archived from the original on January 10, 2023. Retrieved February 15, 2025.
- ^ Flaherty, Colleen (October 22, 2019). "Where Research Meets Profits". Inside Higher Ed. Archived from the original on May 14, 2022. Retrieved February 15, 2025.
- ^ Bohannon, John (April 28, 2016). "Who's downloading pirated papers? Everyone". Science. PMID 27126020. Retrieved February 15, 2025.
- ^ Cheng, Michelle (July 10, 2023). ""Shadow libraries" are at the heart of the mounting copyright lawsuits against OpenAI". Quartz. Retrieved February 15, 2025.
- ^ Creamer, Ella (July 5, 2023). "Authors file a lawsuit against OpenAI for unlawfully 'ingesting' their books". The Guardian. ISSN 0261-3077. Retrieved February 4, 2025.
- ^ Van der Sar, Ernesto (June 30, 2023). "Authors Accuse OpenAI of Using Pirate Sites to Train ChatGPT". TorrentFreak. Retrieved February 15, 2025.
- ^ Knibbs, Kate (January 9, 2025). "Meta Secretly Trained Its AI on a Notorious Piracy Database, Newly Unredacted Court Docs Reveal". Wired. ISSN 1059-1028. Retrieved February 16, 2025.
- ^ "Meta Torrented over 81 TB of Data Through Anna's Archive, Despite Few Seeders". TorrentFreak.
- ^ "Pirate Libraries Are Forbidden Fruit for AI Companies. But at What Cost? * TorrentFreak". Retrieved February 16, 2025.
- ^ Bodó, Balázs; Antal, Dániel; Puha, Zoltán (December 3, 2020). Lozano, Sergi (ed.). "Can scholarly pirate libraries bridge the knowledge access gap? An empirical study on the structural conditions of book piracy in global and European academia". PLOS ONE. 15 (12): e0242509. Bibcode:2020PLoSO..1542509B. doi:10.1371/journal.pone.0242509. ISSN 1932-6203. PMC 7714232. PMID 33270680.
- ^ Correa, Juan C.; Laverde-Rojas, Henry; Tejada, Julian; Marmolejo-Ramos, Fernando (January 2022). "The Sci-Hub effect on papers' citations". Scientometrics. 127 (1): 99–126. doi:10.1007/s11192-020-03806-w. S2CID 234003081. Archived from the original on July 26, 2023. Retrieved July 26, 2023.
- ^ Grisham, John; Turow, Scott (February 14, 2022). "Online piracy is a scourge on American authors — Congress must intervene". The Hill. Archived from the original on September 17, 2024. Retrieved February 16, 2025.
- ^ Rasenberger, Mary E.; Kazi, Umair (October 7, 2022). Re: Docket Number USTR-2022-0010 - 2022 Review of Notorious Markets for Counterfeiting and Piracy, 87 FR 52609 (Report). Retrieved February 16, 2025.
- ^ Rumfitt, Alison (November 25, 2022). "In defence of Z-Library and book piracy". Dazed. Archived from the original on November 25, 2022. Retrieved November 25, 2022.
