Index

Symbols

-d <sec>, --delay <sec> command line option

-i <regex>, --ignore <regex> command line option

C

command line option -d <sec>, --delay <sec> -i <regex>, --ignore <regex>

crawl() (crawler.main.Crawler method) Crawler (class in crawler.main) crawler.main (module)

G

get() (crawler.main.Crawler method)

L

log() (crawler.utils method)

R

run_main() (in module crawler.main)

S

should_ignore() (crawler.utils method)