Package | Description |
---|---|
hu.juranyi.zsolt.pubsearch.crawl |
Crawler engine, with the HTTP downloader and the publication info parser class.
|
Modifier and Type | Class and Description |
---|---|
class |
HTTPRequestEx
Extends HTTPRequest to fit the programs requirements: retries download on error,
sets up random proxy for every try, and stores downloaded pages in a cache.
|