Skip to main content

132
UPLOADS


More right-solid

Show sorted alphabetically

Show sorted alphabetically

More right-solid
SHOW DETAILS
up-solid down-solid
eye
Title
Date Added
Creator
Bulk Bibliographic Metadata
Apr 28, 2022 Internet Archive Web Group
data

eye 18

favorite 1

comment 0

URL lists to PDFs on the web (and preserved in the wayback machine) which are likely to contain research materials.
Fatcat Database Snapshots and Bulk Metadata Exports
Apr 27, 2022 Internet Archive Web Group
data

eye 3

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Apr 22, 2022 Internet Archive Web Group
data

eye 19

favorite 1

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Feb 23, 2022 Internet Archive Web Group
data

eye 26

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Feb 22, 2022 Internet Archive Web Group
data

eye 72

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Dec 4, 2021 Internet Archive Web Group
data

eye 46

favorite 0

comment 0

Bulk Bibliographic Metadata
Sep 9, 2021 Internet Archive Web Group
data

eye 10

favorite 1

comment 0

URL lists to PDFs on the web (and preserved in the wayback machine) which are likely to contain research materials.
Fatcat Database Snapshots and Bulk Metadata Exports
Aug 7, 2021 Internet Archive Web Group
data

eye 197

favorite 3

comment 0

See: https://guide.fatcat.wiki/reference_graph.html License: CC-0
Scholarly TDM Corpora
Scholarly TDM Corpora
collection
44
ITEMS
22
VIEWS
Jul 14, 2021 Internet Archive Web Group
collection

eye 22

Access-restricted text and data-mining corpora. If you are interested in getting access to work with this content, contact info@archive.org
Fatcat Database Snapshots and Bulk Metadata Exports
Jun 7, 2021 Internet Archive Web Group
data

eye 49

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Jun 6, 2021 Internet Archive Web Group
data

eye 76

favorite 0

comment 0

UNPAYWALL-PDF-CRAWL-2021-05
UNPAYWALL-PDF-CRAWL-2021-05
collection
123
ITEMS
837,487
VIEWS
Apr 27, 2021 Internet Archive Web Group
collection

eye 837,487

Fatcat Database Snapshots and Bulk Metadata Exports
Mar 11, 2021 Internet Archive Web Group
data

eye 55

favorite 1

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Dec 30, 2020 Internet Archive Web Group
data

eye 28

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Dec 30, 2020 Internet Archive Web Group
data

eye 17

favorite 0

comment 0

OA-DOI-CRAWL-2020-12
OA-DOI-CRAWL-2020-12
collection
191
ITEMS
1.4M
VIEWS
Dec 9, 2020 Internet Archive Web Group
collection

eye 1.4M

Fatcat Database Snapshots and Bulk Metadata Exports
Dec 8, 2020 Internet Archive Web Group
data

eye 16

favorite 0

comment 0

DOAJ-CRAWL-2020-11
DOAJ-CRAWL-2020-11
collection
102
ITEMS
851,272
VIEWS
Nov 24, 2020 Internet Archive Web Group
collection

eye 851,272

UNPAYWALL-PDF-CRAWL-2020-11
Nov 11, 2020 Internet Archive Web Group
data

eye 0

favorite 0

comment 0

UNPAYWALL-PDF-CRAWL-2020-11
Nov 11, 2020 Internet Archive Web Group
data

eye 0

favorite 0

comment 0

Web PDF Training Sets
Nov 10, 2020 Internet Archive Web Group
data

eye 15

favorite 0

comment 0

This item contains three .zip archives, each containing a sample corpus of about 10,000 (or more) HTML documents from the IA web archive. For each, there is some form of metadata (CDX or JSON) with information about the original URL and timestamp for each document, and then directories containing HTML, extracted TEI-XML, and extracted TXT for each document. There are some fraction of documents which failed to download or failed to extract, so there are fewer .html (and derivative) files than...
UNPAYWALL-PDF-CRAWL-2020-11
UNPAYWALL-PDF-CRAWL-2020-11
collection
199
ITEMS
1.6M
VIEWS
Nov 2, 2020 Internet Archive Web Group
collection

eye 1.6M

Fatcat Database Snapshots and Bulk Metadata Exports
Oct 11, 2020 Internet Archive Web Group
data

eye 10

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Oct 10, 2020 Internet Archive Web Group
data

eye 27

favorite 0

comment 0

OA-JOURNAL-CRAWL-2020-07
Sep 29, 2020 Internet Archive Web Group
data

eye 1

favorite 0

comment 0

OA-JOURNAL-CRAWL-2020-07
Sep 29, 2020 Internet Archive Web Group
data

eye 2

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Sep 29, 2020 Internet Archive Web Group
data

eye 54

favorite 0

comment 0

This item contains an example corpus of citations between scholarly documents, as extracted from the fatcat (https://fatcat.wiki) corpus as of the 2020-08-05 bulk release export. This corpus itself was generated from a fatcat-scholar "intermediate" fulltext dump which is not public, using software in the fatcat-scholar repository in mid-September 2020. See also the README for some more notes, and the "sample" file.
PLATFORM-CRAWL-2020
PLATFORM-CRAWL-2020
collection
649
ITEMS
372,726
VIEWS
Aug 27, 2020 Internet Archive Web Group
collection

eye 372,726

Fatcat Database Snapshots and Bulk Metadata Exports
Aug 7, 2020 Internet Archive Web Group
data

eye 32

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Aug 7, 2020 Internet Archive Web Group
data

eye 15

favorite 0

comment 0

OAI-PMH-CRAWL-2020-06
Aug 5, 2020 Internet Archive Web Group
data

eye 2

favorite 0

comment 0

OAI-PMH-CRAWL-2020-06
Aug 5, 2020 Internet Archive Web Group
data

eye 0

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Jul 23, 2020 Internet Archive Web Group
data

eye 9

favorite 0

comment 0

MAG-PDF-CRAWL-2020-07
Jul 20, 2020 Internet Archive Web Group
data

eye 0

favorite 0

comment 0

MAG-PDF-CRAWL-2020-07
Jul 20, 2020 Internet Archive Web Group
data

eye 0

favorite 0

comment 0

MAG-PDF-CRAWL-2020-07
MAG-PDF-CRAWL-2020-07
collection
196
ITEMS
1.5M
VIEWS
Jul 9, 2020 Internet Archive Web Group
collection

eye 1.5M

OA-JOURNAL-CRAWL-2020-07
OA-JOURNAL-CRAWL-2020-07
collection
1,923
ITEMS
9.4M
VIEWS
Jul 6, 2020 Internet Archive Web Group
collection

eye 9.4M

SCIELO-CRAWL-2020-07
SCIELO-CRAWL-2020-07
collection
41
ITEMS
187,324
VIEWS
Jul 6, 2020 Internet Archive Web Group
collection

eye 187,324

Bulk Bibliographic Metadata
Jun 23, 2020 Internet Archive Web Group
data

eye 10

favorite 0

comment 0

This item contains datasets of homepage URLs found by hand using search engines and bibliographic metadata (eg, ISSN and journal title). The "long-tail" batch contains about 4,600 journal lookup results, with about 3,900 successful homepage URLs found. The list of journals was created in May 2020, and the lookup work completed in June 2020. IA staff member Richard Greydanus ran this batch of lookups. All of this metadata can be considered public domain, or CC-0 (Creative Commons Zero)...
OAI-PMH-CRAWL-2020-06
OAI-PMH-CRAWL-2020-06
collection
2,946
ITEMS
4.6M
VIEWS
May 28, 2020 Internet Archive Web Group
collection

eye 4.6M

Fatcat Database Snapshots and Bulk Metadata Exports
May 27, 2020 Internet Archive Web Group
data

eye 18

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
May 27, 2020 Internet Archive Web Group
data

eye 6

favorite 0

comment 0

UNPAYWALL-PDF-CRAWL-2020-05
UNPAYWALL-PDF-CRAWL-2020-05
collection
282
ITEMS
1.6M
VIEWS
May 4, 2020 Internet Archive Web Group
collection

eye 1.6M

ARXIV-PUBMEDCENTRAL-CRAWL-2020-04
ARXIV-PUBMEDCENTRAL-CRAWL-2020-04
collection
60
ITEMS
100,370
VIEWS
Apr 24, 2020 Internet Archive Web Group
collection

eye 100,370

The Dataset Collection
Apr 10, 2020 Internet Archive Web Group
data

eye 67

favorite 0

comment 0

This item contains both metadata and fulltext PDF content (from the public web) related to research on COVID-19 and past influenza pandemics. This content backs the https://covid19.fatcat.wiki search interface. Rough numbers: - over 51,000 metadata records from 2020-04-10 release of CORD19 corpus - over 79,000 metadata records total (union of the above plus fatcat.wiki keyword matches) - over 45,000 fulltext PDF files and derived PNG thumbnails and pdftotext text files The upstream...
Topic: COVID-19, Coronavirus, SARS-CoV-2
Bulk Bibliographic Metadata
Apr 8, 2020 Internet Archive Web Group
data

eye 7

favorite 0

comment 0

About 1 million unique PDFs from Global Wayback before year 2000.
Bulk Bibliographic Metadata
Apr 7, 2020 Internet Archive Web Group
data

eye 33

favorite 0

comment 0

A mirror of the Unpaywall (aka oaDOI.org) metadata corpus, primarily consisting of public open access flags for a large number of Crossref-registered DOIs (identifiers representing published journal articles and other works). For more information see: http://unpaywall.org/products/snapshot
Fatcat Database Snapshots and Bulk Metadata Exports
Apr 6, 2020 Internet Archive Web Group
data

eye 32

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Apr 6, 2020 Internet Archive Web Group
data

eye 17

favorite 0

comment 0

SEMSCHOLAR-DIRECT-PDF-CRAWL-2020-02
Mar 5, 2020 Internet Archive Web Group
data

eye 1

favorite 0

comment 0

MAG-PDF-CRAWL-2020-03
MAG-PDF-CRAWL-2020-03
collection
489
ITEMS
3.6M
VIEWS
Mar 5, 2020 Internet Archive Web Group
collection

eye 3.6M

UNPAYWALL-PDF-CRAWL-2020-03
UNPAYWALL-PDF-CRAWL-2020-03
collection
344
ITEMS
1.7M
VIEWS
Mar 5, 2020 Internet Archive Web Group
collection

eye 1.7M

Fatcat Database Snapshots and Bulk Metadata Exports
Mar 4, 2020 Internet Archive Web Group
data

eye 9

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Mar 4, 2020 Internet Archive Web Group
data

eye 4

favorite 0

comment 0

SEMSCHOLAR-DIRECT-PDF-CRAWL-2020-02
SEMSCHOLAR-DIRECT-PDF-CRAWL-2020-02
collection
1,011
ITEMS
1.4M
VIEWS
Feb 6, 2020 Internet Archive Web Group
collection

eye 1.4M

OA-DOI-CRAWL-2020-02
OA-DOI-CRAWL-2020-02
collection
278
ITEMS
3.2M
VIEWS
Feb 5, 2020 Internet Archive Web Group
collection

eye 3.2M

PUBMEDCENTRAL-CRAWL-2020-02
PUBMEDCENTRAL-CRAWL-2020-02
collection
108
ITEMS
231,100
VIEWS
Feb 5, 2020 Internet Archive Web Group
collection

eye 231,100

DATACITE-DOI-CRAWL-2020-01
DATACITE-DOI-CRAWL-2020-01
collection
1,417
ITEMS
3.6M
VIEWS
Jan 24, 2020 Internet Archive Web Group
collection

eye 3.6M

Fatcat Database Snapshots and Bulk Metadata Exports
Jan 19, 2020 Internet Archive Web Group
data

eye 5

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Jan 19, 2020 Internet Archive Web Group
data

eye 14

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Dec 14, 2019 Internet Archive Web Group
data

eye 22

favorite 1

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Dec 14, 2019 Internet Archive Web Group
data

eye 10

favorite 0

comment 0

PubMed Central Crawl (2019-10)
PubMed Central Crawl (2019-10)
collection
216
ITEMS
398,184
VIEWS
Oct 12, 2019 Internet Archive Web Group
collection

eye 398,184

arXiv Content Crawl (2019-10)
arXiv Content Crawl (2019-10)
collection
37
ITEMS
63,434
VIEWS
Oct 12, 2019 Internet Archive Web Group
collection

eye 63,434

Fatcat Database Snapshots and Bulk Metadata Exports
Oct 11, 2019 Internet Archive Web Group
data

eye 16

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Oct 11, 2019 Internet Archive Web Group
data

eye 11

favorite 0

comment 0

Bulk Bibliographic Metadata
Oct 3, 2019 Internet Archive Web Group
data

eye 23

favorite 0

comment 0

This item contains some bulk research affiliation datasets from Internet Archive cataloging efforts. These are mostly strings included in research papers that indicate the institutional affiliations of specific authors (eg, with a home department, university, or company) at the time of publication. These might be useful datasets for efforts to build complete indices of research organizations, or to test normalization code that maps raw strings to organization identifiers. Attribution and links...
Community Texts
Sep 10, 2019 Internet Archive Web Group
texts

eye 4

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Sep 10, 2019 Internet Archive Web Group
data

eye 13

favorite 0

comment 0

See README.md
Fatcat Database Snapshots and Bulk Metadata Exports
Sep 10, 2019 Internet Archive Web Group
data

eye 12

favorite 0

comment 0

See README.md
Sep 9, 2019 Internet Archive Web Group
collection

eye 1,357

This collection holds database snapshots (SQL) and bulk metadata exports (JSON and TSV) from https:///fatcat.wiki (an Internet Archive service)
OA-JOURNAL-CRAWL-2019-08
OA-JOURNAL-CRAWL-2019-08
collection
201
ITEMS
2.7M
VIEWS
Aug 1, 2019 Internet Archive Web Group
collection

eye 2.7M

Bulk Bibliographic Metadata
Aug 1, 2019 Internet Archive Web Group
data

eye 56

favorite 0

comment 0

This item contains sqlite3 database snapshots, URL crawl status, and other metadata useful for doing analytics on journal OA coverage, homepage status, etc. Particularly in the context of https://fatcat.wiki. Source code: https://github.com/bnewbold/chocula
Bulk Bibliographic Metadata
Jul 31, 2019 Internet Archive Web Group
data

eye 18

favorite 0

comment 0

This item contains SPARQL query exports of journal metadata from wikidata; in particular ISSN/QID mappings. The SPARQL query run is included as wikidata.sparql
Web PDF GROBID Corpus (July 2019)
Web PDF GROBID Corpus (July 2019)
collection
10
ITEMS
17
VIEWS
Jul 30, 2019 Internet Archive Web Group
collection

eye 17

Fatcat Database Snapshots and Bulk Metadata Exports
Jul 8, 2019 Internet Archive Web Group
data

eye 34

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Jul 8, 2019 Internet Archive Web Group
data

eye 28

favorite 0

comment 0

UNPAYWALL-PDF-CRAWL-2018-07
Jul 2, 2019 Internet Archive Web Group
data

eye 2

favorite 0

comment 0

Bulk Bibliographic Metadata
Jun 27, 2019 Internet Archive Web Group
data

eye 4

favorite 0

comment 0

Open Access Journal Test Crawl (2018)
Jun 25, 2019 Internet Archive Web Group
data

eye 8

favorite 0

comment 0

Web PDF Training Sets
Jun 20, 2019 Internet Archive Web Group
data

eye 21

favorite 0

comment 0

Web PDF Training Sets
Jun 20, 2019 Internet Archive Web Group
data

eye 32

favorite 0

comment 0

Web PDF Training Sets
Jun 12, 2019 Internet Archive Web Group
data

eye 41

favorite 0

comment 0

Web PDF Training Sets
Jun 12, 2019 Internet Archive Web Group
data

eye 28

favorite 0

comment 0

Web PDF Training Sets
Web PDF Training Sets
collection
6
ITEMS
178
VIEWS
Jun 12, 2019 Internet Archive Web Group
collection

eye 178

Web PDF GROBID Corpus (June 2019)
Web PDF GROBID Corpus (June 2019)
collection
10
ITEMS
49
VIEWS
Jun 7, 2019 Internet Archive Web Group
collection

eye 49

Fatcat Database Snapshots and Bulk Metadata Exports
Jun 4, 2019 Internet Archive Web Group
data

eye 21

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Jun 4, 2019 Internet Archive Web Group
data

eye 19

favorite 0

comment 0

See README.md
Bulk Bibliographic Metadata
May 23, 2019 Internet Archive Web Group
data

eye 39

favorite 0

comment 0

This item contains a complete PostgreSQL SQL database snapshot from https://fatcat.wiki, in binary 'pg_dump tar mode' format. With the exception of the 'abstracts' table (for which no aggregate license or copyright claims can be made; downstream users are responsible for their use), all metadata here is licensed CC-0 (public domain release) and may be used for any purpose. Downstream users are strongly encouraged to provide attribution and link here to the snapshot, as well as give credit to...
UNPAYWALL-PDF-CRAWL-2019-04
May 9, 2019 Internet Archive Web Group
data

eye 0

favorite 0

comment 0

UNPAYWALL-PDF-CRAWL-2019-04
May 9, 2019 Internet Archive Web Group
data

eye 2

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
May 1, 2019 Internet Archive Web Group
data

eye 12

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
Apr 30, 2019 Internet Archive Web Group
data

eye 16

favorite 0

comment 0

OMICS-DOI-LANDING-CRAWL-2019-04
Apr 29, 2019 Internet Archive Web Group
data

eye 0

favorite 0

comment 0

OMICS-DOI-LANDING-CRAWL-2019-04
Apr 29, 2019 Internet Archive Web Group
data

eye 4

favorite 0

comment 0

UNPAYWALL-PDF-CRAWL-2019-04
UNPAYWALL-PDF-CRAWL-2019-04
collection
641
ITEMS
5.2M
VIEWS
Apr 26, 2019 Internet Archive Web Group
collection

eye 5.2M

OMICS-DOI-LANDING-CRAWL-2019-04
OMICS-DOI-LANDING-CRAWL-2019-04
collection
4
ITEMS
13,804
VIEWS
Apr 26, 2019 Internet Archive Web Group
collection

eye 13,804

This crawl started in April 2019, as an informal collaboration with Crossref. Crawling a smallish number (100k) DOI redirects and landing pages (plus PDF outlinks, and maybe a couple other hops) for a single large publisher (OMICS, which has multiple subsidiaries). Intent is to get reasonably good capture that can be used as canonical preservation copies of the landing pages. Secondary goal is to get decent fulltext capture coverage.
Bulk Bibliographic Metadata
Apr 24, 2019 Internet Archive Web Group
data

eye 28

favorite 0

comment 0

This dump includes all tables (including oauth authentication tables which could be a privacy, but not security, concern). At this time only IA staff have accounts, so the snapshot, which is intended mostly for disaster recovery, is still public.
DIRECT-OA-CRAWL-2019
Apr 11, 2019 Internet Archive Web Group
data

eye 5

favorite 0

comment 0

DIRECT-OA-CRAWL-2019
Apr 11, 2019 Internet Archive Web Group
data

eye 4

favorite 0

comment 0