Skip to main content
SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
WARCZone: Outsider WARCs
by Internet Archive
web

eye 70

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 55

favorite 1

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 46

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 200

favorite 3

comment 0

See: https://guide.fatcat.wiki/reference_graph.html License: CC-0
Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 33

favorite 0

comment 0

UNPAYWALL-PDF-CRAWL-2020-03
UNPAYWALL-PDF-CRAWL-2020-03
collection
344
ITEMS
2.2M
VIEWS
by Internet Archive Web Group
collection

eye 2.2M

DOAJ-CRAWL-2020-11
DOAJ-CRAWL-2020-11
collection
102
ITEMS
1M
VIEWS
by Internet Archive Web Group
collection

eye 1M

SEMSCHOLAR-DIRECT-PDF-CRAWL-2020-02
SEMSCHOLAR-DIRECT-PDF-CRAWL-2020-02
collection
1,011
ITEMS
1.8M
VIEWS
by Internet Archive Web Group
collection

eye 1.8M

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 14

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 5

favorite 0

comment 0

OA-JOURNAL-CRAWL-2020-07
by Internet Archive Web Group
data

eye 1

favorite 0

comment 0

Academic Data and Datasets
by Internet Archive Web Group
data

eye 67

favorite 0

comment 0

This item contains both metadata and fulltext PDF content (from the public web) related to research on COVID-19 and past influenza pandemics. This content backs the https://covid19.fatcat.wiki search interface. Rough numbers: - over 51,000 metadata records from 2020-04-10 release of CORD19 corpus - over 79,000 metadata records total (union of the above plus fatcat.wiki keyword matches) - over 45,000 fulltext PDF files and derived PNG thumbnails and pdftotext text files The upstream...
Topic: COVID-19, Coronavirus, SARS-CoV-2
UNPAYWALL-PDF-CRAWL-2020-11
UNPAYWALL-PDF-CRAWL-2020-11
collection
199
ITEMS
2M
VIEWS
by Internet Archive Web Group
collection

eye 2M

MAG-PDF-CRAWL-2020-07
by Internet Archive Web Group
data

eye 0

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 6

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 33

favorite 0

comment 0

OA-JOURNAL-CRAWL-2020-07
by Internet Archive Web Group
data

eye 4

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 11

favorite 0

comment 0

UNPAYWALL-PDF-CRAWL-2021-05
UNPAYWALL-PDF-CRAWL-2021-05
collection
123
ITEMS
1.1M
VIEWS
by Internet Archive Web Group
collection

eye 1.1M

MAG-PDF-CRAWL-2020-03
MAG-PDF-CRAWL-2020-03
collection
489
ITEMS
4.7M
VIEWS
by Internet Archive Web Group
collection

eye 4.7M

OA-DOI-CRAWL-2020-12
OA-DOI-CRAWL-2020-12
collection
191
ITEMS
1.7M
VIEWS
by Internet Archive Web Group
collection

eye 1.7M

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 17

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 4

favorite 0

comment 0

MAG-PDF-CRAWL-2020-07
MAG-PDF-CRAWL-2020-07
collection
196
ITEMS
2M
VIEWS
by Internet Archive Web Group
collection

eye 2M

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 50

favorite 0

comment 0

SCIELO-CRAWL-2020-07
SCIELO-CRAWL-2020-07
collection
41
ITEMS
219,673
VIEWS
by Internet Archive Web Group
collection

eye 219,673

MAG-PDF-CRAWL-2020-07
by Internet Archive Web Group
data

eye 0

favorite 0

comment 0

Bulk Bibliographic Metadata
by Internet Archive Web Group
data

eye 10

favorite 0

comment 0

This item contains datasets of homepage URLs found by hand using search engines and bibliographic metadata (eg, ISSN and journal title). The "long-tail" batch contains about 4,600 journal lookup results, with about 3,900 successful homepage URLs found. The list of journals was created in May 2020, and the lookup work completed in June 2020. IA staff member Richard Greydanus ran this batch of lookups. All of this metadata can be considered public domain, or CC-0 (Creative Commons Zero)...
Bulk Bibliographic Metadata
by Internet Archive Web Group
data

eye 33

favorite 0

comment 0

A mirror of the Unpaywall (aka oaDOI.org) metadata corpus, primarily consisting of public open access flags for a large number of Crossref-registered DOIs (identifiers representing published journal articles and other works). For more information see: http://unpaywall.org/products/snapshot
Bulk Bibliographic Metadata
by Internet Archive Web Group
data

eye 10

favorite 1

comment 0

URL lists to PDFs on the web (and preserved in the wayback machine) which are likely to contain research materials.
Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 17

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 27

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 17

favorite 0

comment 0

DATACITE-DOI-CRAWL-2020-01
DATACITE-DOI-CRAWL-2020-01
collection
1,417
ITEMS
4.3M
VIEWS
by Internet Archive Web Group
collection

eye 4.3M

Web PDF Training Sets
by Internet Archive Web Group
data

eye 15

favorite 0

comment 0

This item contains three .zip archives, each containing a sample corpus of about 10,000 (or more) HTML documents from the IA web archive. For each, there is some form of metadata (CDX or JSON) with information about the original URL and timestamp for each document, and then directories containing HTML, extracted TEI-XML, and extracted TXT for each document. There are some fraction of documents which failed to download or failed to extract, so there are fewer .html (and derivative) files than...
PLATFORM-CRAWL-2020
PLATFORM-CRAWL-2020
collection
649
ITEMS
687,662
VIEWS
by Internet Archive Web Group
collection

eye 687,662

OA-JOURNAL-CRAWL-2020-07
OA-JOURNAL-CRAWL-2020-07
collection
1,923
ITEMS
11.7M
VIEWS
by Internet Archive Web Group
collection

eye 11.7M

PUBMEDCENTRAL-CRAWL-2020-02
PUBMEDCENTRAL-CRAWL-2020-02
collection
108
ITEMS
296,336
VIEWS
by Internet Archive Web Group
collection

eye 296,336

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 9

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 78

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 58

favorite 0

comment 0

This item contains an example corpus of citations between scholarly documents, as extracted from the fatcat (https://fatcat.wiki) corpus as of the 2020-08-05 bulk release export. This corpus itself was generated from a fatcat-scholar "intermediate" fulltext dump which is not public, using software in the fatcat-scholar repository in mid-September 2020. See also the README for some more notes, and the "sample" file.
Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 22

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 28

favorite 0

comment 0

Fatcat Database Snapshots and Bulk Metadata Exports
by Internet Archive Web Group
data

eye 19

favorite 0

comment 0

OA-DOI-CRAWL-2020-02
OA-DOI-CRAWL-2020-02
collection
278
ITEMS
3.8M
VIEWS
by Internet Archive Web Group
collection

eye 3.8M

ARXIV-PUBMEDCENTRAL-CRAWL-2020-04
ARXIV-PUBMEDCENTRAL-CRAWL-2020-04
collection
60
ITEMS
128,127
VIEWS
by Internet Archive Web Group
collection

eye 128,127