ArchiveBot: The Archive Team Crowdsourced Crawler

ArchiveBot is an IRC bot designed to automate the archival of smaller websites (e.g. up to a few hundred thousand URLs). You give it a URL to start at, and it grabs all content under that URL, records it in a WARC, and then uploads that WARC to ArchiveTeam servers for eventual injection into the Internet Archive (or other archive sites).

More...

RSS

ABOUT

COLLECTION

SHOW DETAILS

SORT BY

VIEWS

TITLE

DATE REVIEWED

CREATOR

ArchiveBot: The Archive Team Crowdsourced Crawler

6.7M 6.7M

Archiveteam: Archivebot FalconK pipeline upload www.smithsonianmag.com 20170129

Apr 30, 2022 04/22

Apr 30, 2022

eye 6.7M

favorite 3

comment 1

( 1 reviews )
Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

25,576 26K

Archiveteam: Archivebot GO Pack 20220302210008

Mar 4, 2022 03/22

Mar 4, 2022 Archive Team

eye 25,576

favorite 0

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

15.3M 15M

Archiveteam: Archivebot GO Pack 20210326170001

Aug 16, 2021 08/21

Aug 16, 2021 Archive Team

eye 15.3M

favorite 1

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

58,977 59K

Archiveteam: Archivebot GO Pack 20210517140002

Aug 4, 2021 08/21

Aug 4, 2021 Archive Team

eye 58,977

favorite 0

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

44,763 45K

Archiveteam: Archivebot GO Pack 20201014020001

Oct 14, 2020 10/20

Oct 14, 2020 Archive Team

eye 44,763

favorite 0

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

66.4M 66M

Archiveteam: Archivebot GO Pack 20160123030001

Jul 2, 2020 07/20

Jul 2, 2020 Archive Team

eye 66.4M

favorite 0

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

99,886 100K

Archiveteam: Archivebot GO Pack 20200421030001

Apr 21, 2020 04/20

Apr 21, 2020 Archive Team

eye 99,886

favorite 0

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

172,470 172K

Archiveteam: Archivebot GO Pack 20181123150002

Nov 23, 2018 11/18

Nov 23, 2018 Archive Team

eye 172,470

favorite 0

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

60,373 60K

Archiveteam: Archivebot GO Pack 20181028210001

Oct 28, 2018 10/18

Oct 28, 2018 Archive Team

eye 60,373

favorite 0

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

69,863 70K

Archiveteam: Archivebot GO Pack 20181028170002

Oct 28, 2018 10/18

Oct 28, 2018 Archive Team

eye 69,863

favorite 0

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

75,624 76K

Archiveteam: Archivebot GO Pack 20180419040001

Apr 19, 2018 04/18

Apr 19, 2018 Archive Team

eye 75,624

favorite 0

comment 1

ArchiveBot is an Archive Team service to quickly grab smaller at-risk or critical sites to bring copies into the Internet Archive Wayback machine.
( 1 reviews )

ArchiveBot: The Archive Team Crowdsourced Crawler

0 0.0

Archiveteam: Archivebot GO Pack 20191117202750494457385

- -

eye 0

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

0 0.0

Archiveteam: Archivebot GO Pack 20191115004243289008188

- -

eye 0

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

0 0.0

Archiveteam: Archivebot GO Pack 20191116161927263891943

- -

eye 0

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

0 0.0

Archiveteam: Archivebot GO Pack 20191116055412763721228

- -

eye 0

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

1 1.0

Archiveteam: Archivebot GO Pack 20191110031057336598468

- -

eye 1

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

0 0.0

Archiveteam: Archivebot GO Pack 20191118011025101592479

- -

eye 0

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

1 1.0

Archiveteam: Archivebot GO Pack 20191117075720936028207

- -

eye 1

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

0 0.0

Archiveteam: Archivebot GO Pack 20191114213521114264233

- -

eye 0

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

0 0.0

Archiveteam: Archivebot GO Pack 20191117175131701589893

- -

eye 0

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

0 0.0

Archiveteam: Archivebot GO Pack 20191108150322808111078

- -

eye 0

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

0 0.0

Archiveteam: Archivebot GO Pack 20191111224551847998365

- -

eye 0

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

18 18

Archiveteam: Archivebot GO Pack 20191111143735347289989

- -

eye 18

favorite 0

comment 0

ArchiveBot: The Archive Team Crowdsourced Crawler

2,023 2.0K

Archiveteam: Archivebot Astrid pipeline upload archive.darpa.mil 20171009

- -

eye 2,023

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

213 213

Archiveteam: Archivebot Astrid pipeline upload backchannel.com 20170124

- -

eye 213

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

24 24

Archiveteam: Archivebot Astrid pipeline upload bbs.dailystormer.com 20170814

- -

eye 24

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

42,438 42K

Archiveteam: Archivebot Astrid pipeline upload basicattentiontoken.org 20171009

- -

eye 42,438

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

1.6M 1.6M

Archiveteam: Archivebot Astrid pipeline upload bbs.nextthing.co 20180420

- -

eye 1.6M

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

170 170

Archiveteam: Archivebot Astrid pipeline upload donhopkins.com 20170813

- -

eye 170

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

10,167 10K

Archiveteam: Archivebot Astrid pipeline upload blog.steve.fi 20170601

- -

eye 10,167

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

17,313 17K

Archiveteam: Archivebot Astrid pipeline upload digitalfiregames.com 20170517

- -

eye 17,313

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

31,191 31K

Archiveteam: Archivebot Astrid pipeline upload busy.speccy.cz 20180329

- -

eye 31,191

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

249 249

Archiveteam: Archivebot Astrid pipeline upload dosdude1.com 20180726

- -

eye 249

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

59,887 60K

Archiveteam: Archivebot Astrid pipeline upload cup.cat 20171008

- -

eye 59,887

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

39,421 39K

Archiveteam: Archivebot Astrid pipeline upload halkinnabzi.com.tr 20180709

- -

eye 39,421

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

41,517 42K

Archiveteam: Archivebot Astrid pipeline upload factba.se 20170929

- -

eye 41,517

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

546 546

Archiveteam: Archivebot Astrid pipeline upload europa.eu 20170608

- -

eye 546

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

25,915 26K

Archiveteam: Archivebot Astrid pipeline upload jbr.me.uk 20170723

- -

eye 25,915

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

71 71

Archiveteam: Archivebot Astrid pipeline upload forums.arcade-museum.com 20170217

- -

eye 71

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

27,029 27K

Archiveteam: Archivebot Astrid pipeline upload github.com 20180723

- -

eye 27,029

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

126 126

Archiveteam: Archivebot Astrid pipeline upload github.com 20180528

- -

eye 126

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

2,370 2.4K

Archiveteam: Archivebot Astrid pipeline upload fallout.wikia.com 20170309

- -

eye 2,370

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

635 635

Archiveteam: Archivebot Astrid pipeline upload johnk-jboop.blogspot.com 20180329

- -

eye 635

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

24,165 24K

Archiveteam: Archivebot Astrid pipeline upload marcelle.skytaxi.jp 20170929

- -

eye 24,165

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

9,238 9.2K

Archiveteam: Archivebot Astrid pipeline upload libreflix.org 20171106

- -

eye 9,238

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

17,710 18K

Archiveteam: Archivebot Astrid pipeline upload medium.com 20170602

- -

eye 17,710

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

4,528 4.5K

Archiveteam: Archivebot Astrid pipeline upload laisifinwen.wz.cz 20171112

- -

eye 4,528

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

11,287 11K

Archiveteam: Archivebot Astrid pipeline upload memoriadebusqueda.blogspot.com 20180602

- -

eye 11,287

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

8,693 8.7K

Archiveteam: Archivebot Astrid pipeline upload kern.punkto.info 20170217

- -

eye 8,693

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

134,231 134K

Archiveteam: Archivebot Astrid pipeline upload terrorismodeestadoenchile.blogspot.com 20180807

- -

eye 134,231

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

7,319 7.3K

Archiveteam: Archivebot Astrid pipeline upload the-eye.eu 20180503

- -

eye 7,319

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

3,607 3.6K

Archiveteam: Archivebot Astrid pipeline upload static-1.namx.org 20171122

- -

eye 3,607

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

69 69

Archiveteam: Archivebot Astrid pipeline upload pleroma.site 20180726

- -

eye 69

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

2,588 2.6K

Archiveteam: Archivebot Astrid pipeline upload techcrunch.com 20170807

- -

eye 2,588

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

866 866

Archiveteam: Archivebot Astrid pipeline upload purple.com 20170124

- -

eye 866

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

5,926 5.9K

Archiveteam: Archivebot Astrid pipeline upload testjohnktest.blogspot.com 20180329

- -

eye 5,926

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

21,141 21K

Archiveteam: Archivebot Astrid pipeline upload shoalhaven.net.au 20180527

- -

eye 21,141

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

52,885 53K

Archiveteam: Archivebot Astrid pipeline upload twitter.com 20170720

- -

eye 52,885

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

912 912

Archiveteam: Archivebot Astrid pipeline upload twitter.com 20170124

- -

eye 912

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

14,071 14K

Archiveteam: Archivebot Astrid pipeline upload twitter.com 20171114

- -

eye 14,071

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

486,714 487K

Archiveteam: Archivebot Astrid pipeline upload tw.forumosa.com 20170309

- -

eye 486,714

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

25,222 25K

Archiveteam: Archivebot Astrid pipeline upload twitter.com 20170807

- -

eye 25,222

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

343 343

Archiveteam: Archivebot Astrid pipeline upload twitter.com 20170608

- -

eye 343

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

21,178 21K

Archiveteam: Archivebot Astrid pipeline upload users.cs.duke.edu 20180329

- -

eye 21,178

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

6,496 6.5K

Archiveteam: Archivebot Astrid pipeline upload urls-files.q931.fastmail.fm-dot_tel_domains_04 20170227

- -

eye 6,496

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

27,694 28K

Archiveteam: Archivebot Astrid pipeline upload wpilib.screenstepslive.com 20180602

- -

eye 27,694

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

6,194 6.2K

Archiveteam: Archivebot Astrid pipeline upload urls-ddl3.data.hu-kephost_com_images_20160904_20170123 20170205

- -

eye 6,194

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

8,716 8.7K

Archiveteam: Archivebot Astrid pipeline upload webcache.googleusercontent.com 20170814

- -

eye 8,716

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

39,008 39K

Archiveteam: Archivebot Astrid pipeline upload www3.nhk.or.jp 20171119

- -

eye 39,008

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

371 371

Archiveteam: Archivebot Astrid pipeline upload women2.com 20170818

- -

eye 371

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

2,423 2.4K

Archiveteam: Archivebot Astrid pipeline upload www.bmj.com 20170723

- -

eye 2,423

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

35,003 35K

Archiveteam: Archivebot Astrid pipeline upload www.autismoregon.org 20171107

- -

eye 35,003

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

82,361 82K

Archiveteam: Archivebot Astrid pipeline upload www.emulator-zone.com 20180809

- -

eye 82,361

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

883 883

Archiveteam: Archivebot Astrid pipeline upload www.campcoltonoregon.com 20170819

- -

eye 883

favorite 0

comment 0

Topic: archivebot

ArchiveBot: The Archive Team Crowdsourced Crawler

13 13

Archiveteam: Archivebot Astrid pipeline upload www.copacabanapalace.com.br 20170124

- -

eye 13

favorite 0

comment 0

Topic: archivebot

MORE RESULTS
Fetching more results

DESCRIPTION

To use ArchiveBot, drop by #archivebot on EFNet. To interact with ArchiveBot, you issue commands by typing it into the channel. Note you will need channel operator permissions in order to issue archiving jobs. The dashboard shows the sites being downloaded currently.

There is a dashboard running for the archivebot process at http://www.archivebot.com.

ArchiveBot's source code can be found at https://github.com/ArchiveTeam/ArchiveBot.

ACTIVITY

comment

Collection Info

Addeddate: 2014-04-08 17:05:17

Collection: archiveteam
web

Identifier: archivebot

Mediatype: collection

Num-recent-reviews: 5

Num-top-dl: 5

Publicdate: 2014-04-08 17:05:17

Subject: archiveteam;archivebot;webcrawl;robot;love

Title: ArchiveBot: The Archive Team Crowdsourced Crawler

Created on

April 8
2014

Jason Scott
Archivist

ADDITIONAL CONTRIBUTORS

rewby
Archivist

VIEWS

Total Views 2,403,219,240 (Older Stats)

ITEMS

Total Items 30,499 (Older Stats)

TOP REGIONS (LAST 30 DAYS)

(data not available)

ArchiveBot: The Archive Team Crowdsourced Crawler

Filters 30,643 RESULTS

Media TypeMedia Type

YearYear

Topics & SubjectsTopics & Subjects

CollectionCollection

CreatorCreator

LanguageLanguage

eye 6.7M

favorite 3

comment 1

eye 25,576

favorite 0

comment 1

eye 15.3M

favorite 1

comment 1

eye 58,977

favorite 0

comment 1

eye 44,763

favorite 0

comment 1

eye 66.4M

favorite 0

comment 1

eye 99,886

favorite 0

comment 1

eye 172,470

favorite 0

comment 1

eye 60,373

favorite 0

comment 1

eye 69,863

favorite 0

comment 1

eye 75,624

favorite 0

comment 1

eye 0

favorite 0

comment 0

eye 0

favorite 0

comment 0

eye 0

favorite 0

comment 0

eye 0

favorite 0

comment 0

eye 1

favorite 0

comment 0

eye 0

favorite 0

comment 0

eye 1

favorite 0

comment 0

eye 0

favorite 0

comment 0

eye 0

favorite 0

comment 0

eye 0

favorite 0

comment 0

eye 0

favorite 0

comment 0

eye 18

favorite 0

comment 0

eye 2,023

favorite 0

comment 0

30,643
RESULTS

Media Type

Year

Topics & Subjects

Collection

Creator

Language