govuk_seed_crawler 3.2.1
Retrieves a list of URLs to seed the crawler by publishing them to a RabbitMQ exchange.
Gemfile:
=
install:
=
Runtime Dependencies (6):
bunny
>= 1.3, < 3.0
crack
= 0.4.5
nokogiri
>= 1.6, < 1.15
public_suffix
>= 1.4.6, < 5.1.0
sitemap-parser
>= 0.3, < 0.6
slop
>= 4.0, < 4.11