RubyGems Navigation menu

arachnid 0.1.1

Arachnid is a web crawler that relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling every page on a domain.

Gemfile:
=

Installeer:
=

Versies:

  1. 0.4.1 January 17, 2014 (5 KB)
  2. 0.4.0 January 16, 2014 (4,5 KB)
  3. 0.3.2 January 16, 2014 (5 KB)
  4. 0.3.1 January 16, 2014 (5 KB)
  5. 0.3.0 January 16, 2014 (4,5 KB)
  6. 0.1.1 November 12, 2011 (4,5 KB)
Toon alle versies (12 totaal)

Runtime afhankelijkheden (4):

bloomfilter-rb = 2.1.1
domainatrix = 0.0.10
nokogiri = 1.5.0
typhoeus = 0.3.2

Eigenaren:

Authors:

  • dchuk

SHA 256 checksum:

=

Total downloads 50.110

Voor deze versie 4.516

Versie vrijgegeven:

Licenties:

N/A

Required Ruby Version: Geen

Links: