14.3M
14M
Jul 17, 2018
07/18
by
Internet Archive Web Group
Web archive data from a crawl of open access PDF URLs provided by Unpaywall.
4.6M
4.6M
May 28, 2020
05/20
by
Internet Archive Web Group
9.4M
9.4M
Jul 6, 2020
07/20
by
Internet Archive Web Group
11.5M
11M
Aug 4, 2017
08/17
by
Internet Archive Web Group
Microsoft Academic Graph public corpus (Feb 2016) PDF URLs, filtered to remove large sites (pubmed, citeseerx, arxiv) and already-crawled URLs.
Topics: papers, journals
10.6M
11M
Apr 9, 2018
04/18
by
Internet Archive Web Group
5.2M
5.2M
Apr 26, 2019
04/19
by
Internet Archive Web Group
3.6M
3.6M
Mar 5, 2020
03/20
by
Internet Archive Web Group
5.1M
5.1M
Feb 15, 2019
02/19
by
Internet Archive Web Group
1.5M
1.5M
Oct 31, 2018
10/18
by
Internet Archive Web Group
Crawl of "upstream" URLs from CORE (core.ac.uk) metadata dump. Only a partial seedlist of files crawled.
3.2M
3.2M
Feb 5, 2020
02/20
by
Internet Archive Web Group
1.7M
1.7M
Mar 5, 2020
03/20
by
Internet Archive Web Group
3.6M
3.6M
Jan 24, 2020
01/20
by
Internet Archive Web Group
1.4M
1.4M
Dec 9, 2020
12/20
by
Internet Archive Web Group
1.5M
1.5M
Jul 9, 2020
07/20
by
Internet Archive Web Group
1.6M
1.6M
Nov 2, 2020
11/20
by
Internet Archive Web Group
1.6M
1.6M
May 4, 2020
05/20
by
Internet Archive Web Group
3M
3.0M
Sep 21, 2017
09/17
by
Internet Archive Web Group
3.2M
3.2M
Jun 1, 2018
06/18
by
Internet Archive Web Group
2.7M
2.7M
Aug 1, 2019
08/19
by
Internet Archive Web Group
372,726
373K
Aug 27, 2020
08/20
by
Internet Archive Web Group
837,487
837K
Apr 27, 2021
04/21
by
Internet Archive Web Group
1.4M
1.4M
Feb 6, 2020
02/20
by
Internet Archive Web Group
IA crawl of PDF urls provided by Semantic Scholar.
Topic: pdf
851,272
851K
Nov 24, 2020
11/20
by
Internet Archive Web Group
A targeted crawl to fetch research publications from the public web which have been crawled by CiteSeerX but have not previously been crawled by the Internet Archive.
Topics: scholarly, papers, journal
398,184
398K
Oct 12, 2019
10/19
by
Internet Archive Web Group
231,100
231K
Feb 5, 2020
02/20
by
Internet Archive Web Group
100,370
100K
Apr 24, 2020
04/20
by
Internet Archive Web Group
187,324
187K
Jul 6, 2020
07/20
by
Internet Archive Web Group
63,434
63K
Oct 12, 2019
10/19
by
Internet Archive Web Group
194,942
195K
Aug 2, 2020
08/20
by
Internet Archive
web
eye 194,942
favorite 0
comment 0
Internet Archive crawldata of scholarly web journal content captured by wbgrp-svc282.us.archive.org:OA-JOURNAL-CRAWL-2020-07 from Sun Aug 2 19:00:58 PDT 2020 to Sun Aug 2 13:24:24 PDT 2020.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Wed Feb 9 06:43:52 PST 2022 to Wed Feb 9 06:06:53 PST 2022.
Topic: crawldata
89,901
90K
Nov 24, 2020
11/20
by
Internet Archive
web
eye 89,901
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc279.us.archive.org:DOAJ-CRAWL-2020-11 from Tue Nov 24 17:59:21 PST 2020 to Tue Nov 24 11:43:19 PST 2020.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Sun Jan 16 16:05:54 PST 2022 to Sun Jan 16 16:33:31 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Wed Feb 9 12:34:39 PST 2022 to Wed Feb 9 13:13:37 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Wed Feb 2 04:32:21 PST 2022 to Wed Feb 2 06:24:58 PST 2022.
Topic: crawldata
18,761
19K
Mar 9, 2022
03/22
by
Internet Archive
web
eye 18,761
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Fri Mar 4 08:19:11 PST 2022 to Tue Mar 8 18:29:43 PST 2022.
Topic: crawldata
10,228
10K
Feb 27, 2022
02/22
by
Internet Archive
web
eye 10,228
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Sat Feb 26 14:02:15 PST 2022 to Sun Feb 27 05:47:42 PST 2022.
Topic: crawldata
20,293
20K
Feb 24, 2022
02/22
by
Internet Archive
web
eye 20,293
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Wed Feb 23 02:01:38 PST 2022 to Wed Feb 23 15:48:40 PST 2022.
Topic: crawldata
8,894
8.9K
Mar 10, 2022
03/22
by
Internet Archive
web
eye 8,894
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Tue Mar 8 20:50:17 PST 2022 to Wed Mar 9 18:29:43 PST 2022.
Topic: crawldata
33,194
33K
Dec 11, 2020
12/20
by
Internet Archive
web
eye 33,194
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc279.us.archive.org:OA-DOI-CRAWL-2020-12 from Wed Dec 9 22:59:12 PST 2020 to Wed Dec 9 15:45:33 PST 2020.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Sun Jan 16 23:09:54 PST 2022 to Sun Jan 16 23:27:17 PST 2022.
Topic: crawldata
9,108
9.1K
Mar 3, 2022
03/22
by
Internet Archive
web
eye 9,108
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Wed Mar 2 07:41:16 PST 2022 to Thu Mar 3 05:41:51 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Wed Feb 9 19:49:10 PST 2022 to Wed Feb 9 17:48:49 PST 2022.
Topic: crawldata
8,709
8.7K
Feb 26, 2022
02/22
by
Internet Archive
web
eye 8,709
favorite 1
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Fri Feb 25 14:02:24 PST 2022 to Sat Feb 26 06:00:57 PST 2022.
Topic: crawldata
13,003
13K
Feb 24, 2022
02/22
by
Internet Archive
web
eye 13,003
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Wed Feb 23 18:50:55 PST 2022 to Thu Feb 24 11:23:51 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web journal content captured by wbgrp-svc279.us.archive.org:JOURNAL-HOMEPAGE-CRAWL-2022-03 from Thu Mar 10 03:08:12 PST 2022 to Fri Mar 11 04:09:37 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Fri Feb 4 02:18:39 PST 2022 to Fri Feb 4 01:48:51 PST 2022.
Topic: crawldata
8,676
8.7K
Feb 25, 2022
02/22
by
Internet Archive
web
eye 8,676
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Thu Feb 24 14:01:46 PST 2022 to Fri Feb 25 11:54:58 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Sun Jan 16 08:47:48 PST 2022 to Sun Jan 16 09:46:08 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Sat Feb 5 14:19:42 PST 2022 to Sat Feb 5 15:31:51 PST 2022.
Topic: crawldata
9,047
9.0K
Feb 28, 2022
02/22
by
Internet Archive
web
eye 9,047
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Sun Feb 27 13:18:39 PST 2022 to Mon Feb 28 05:15:19 PST 2022.
Topic: crawldata
7,965
8.0K
Mar 2, 2022
03/22
by
Internet Archive
web
eye 7,965
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Tue Mar 1 07:52:41 PST 2022 to Wed Mar 2 05:33:50 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web journal content captured by wbgrp-svc279.us.archive.org:JOURNAL-HOMEPAGE-CRAWL-2022-03 from Wed Mar 30 20:42:30 PDT 2022 to Thu Mar 31 18:02:39 PDT 2022.
Topic: crawldata
Internet Archive crawldata of open access journal content captured by wbgrp-svc281.us.archive.org:UNPAYWALL-PDF-CRAWL-2018-07 from Sun Jul 29 09:54:12 PDT 2018 to Sun Jul 29 04:01:42 PDT 2018.
Topic: crawldata
7,770
7.8K
Mar 9, 2022
03/22
by
Internet Archive
web
eye 7,770
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Thu Mar 3 07:55:41 PST 2022 to Fri Mar 4 06:00:57 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Fri Jan 28 18:32:02 PST 2022 to Fri Jan 28 18:24:26 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Fri Feb 4 09:38:55 PST 2022 to Fri Feb 4 10:01:13 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Tue Feb 1 19:10:45 PST 2022 to Tue Feb 1 22:31:42 PST 2022.
Topic: crawldata
6,919
6.9K
Mar 11, 2022
03/22
by
Internet Archive
web
eye 6,919
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Wed Mar 9 20:55:55 PST 2022 to Fri Mar 11 02:34:43 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Thu Feb 3 11:41:05 PST 2022 to Thu Feb 3 11:55:15 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Sat Feb 5 21:54:41 PST 2022 to Sat Feb 5 22:00:45 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Sat Feb 5 06:11:43 PST 2022 to Sat Feb 5 08:08:47 PST 2022.
Topic: crawldata
7,774
7.8K
Mar 1, 2022
03/22
by
Internet Archive
web
eye 7,774
favorite 0
comment 0
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:DOI-CRAWL-2022-02 from Mon Feb 28 07:53:39 PST 2022 to Tue Mar 1 05:36:50 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web landing page content captured by wbgrp-svc206.us.archive.org:JOURNALS-PATCH-CRAWL-2022-01 from Thu Feb 3 04:12:12 PST 2022 to Thu Feb 3 03:46:54 PST 2022.
Topic: crawldata
Internet Archive crawldata of scholarly web journal content captured by wbgrp-svc279.us.archive.org:JOURNAL-HOMEPAGE-CRAWL-2022-03 from Thu Mar 31 20:37:17 PDT 2022 to Fri Apr 1 13:06:40 PDT 2022.
Topic: crawldata
