RubyGems Navigation menu

arachnid 0.2.1

Arachnid is a web crawler that relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling every page on a domain.

Gemfile:
=

安裝:
=

版本列表:

  1. 0.4.1 January 17, 2014 (5.0 KB)
  2. 0.4.0 January 16, 2014 (4.5 KB)
  3. 0.3.2 January 16, 2014 (5.0 KB)
  4. 0.3.1 January 16, 2014 (5.0 KB)
  5. 0.3.0 January 16, 2014 (4.5 KB)
  6. 0.2.1 November 29, 2011 (4.5 KB)
顯示所有版本(共 12)

Runtime 相依性套件 (4):

bloomfilter-rb = 2.1.1
domainatrix = 0.0.10
nokogiri = 1.5.0
typhoeus = 0.3.2

擁有者:

作者:

  • dchuk

SHA 256 總和檢查碼:

=

總下載次數 50,085

這個版本 4,491

版本发布:

授權:

Ruby 版本需求:

相關連結: