spider 0.5.4

A Web spidering library: handles robots.txt, scraping, finding more links, and doing it all over again.

Gemfile:
=

install:
=

Versions:

0.5.4 June 04, 2020 (15.5 KB)
0.5.3 April 23, 2018 (15 KB)
0.5.2 April 23, 2018 (15 KB)
0.5.1 September 04, 2016 (15 KB)
0.5.0 May 13, 2016 (15 KB)

Show all versions (14 total)

Owners:

Pushed by:

Authors:

John Nagro

SHA 256 checksum:

=