Arachnid relies on Bloom Filters to efficiently store visited urls and Typhoeus to avoid the overhead of Mechanize when crawling.
dchuk
November 12, 2011 12:36am
N/A