Tag: Perl

December 3, 2022

archive.pl v2.2 released

I have released the 2.2 version of my Perl script archive.pl for saving URL sets in the Internet Archive. The most important improvement is that there is a Docker image now that contains TOR as service for a every 10 seconds IP rotation and a headless Firefox browser that betters the quality of HTML downloads and analysis. There is a...

Web Development Comments: 0

March 26, 2020

archive.pl 2.0 released

Today I finally released the latest build of my archive.pl script. Due to its massive changes I decided to increase the main version, although there is no incompatibility to prior version calls. The main purpose of archive.pl is to store sets of URLs in the Internet Archive and store an index of them as Atom feed, HTML page or WordPress...

Culture/Software Comments: 0

January 8, 2020

archive.pl 1.8 released

Today a new version of my Perl script archive.pl has been released (version 1.8). There are three new features: The resulting index page can now automatically get posted to a WordPress blog. The Internet Archive has introduced a request limit (15 requests per minute). archive.pl therefore delays archiving to a reasonable extend (10 seconds as default). On the other hand,...

Software Comments: 0

archive.pl – a Perl script for archiving URL sets in the Internet Archive

The script fetches URLs, extracts some metadata and submits them to Internet Archive. Then it generates a HTML or Atom link list that can be FTPed. Windows binaries are available.

Comments: 0