httpcrawler

Fast and small web crawler library.

Installation

Download from http://example.com/FIXME.

Usage

FIXME: explanation

(require ['httpcrawler.core :refer ['crawl]])

(crawl ["http://www.test.com/start-page.html"] options
       (fn [{:keys [opts body status headers error]}]
         (...)))

Options

FIXME: listing of options this app accepts.

Examples

...

Bugs

...

Any Other Sections

That You Think

Might be Useful

License

Copyright © 2015 FIXME

Distributed under the Eclipse Public License either version 1.0 or (at your option) any later version.