votorola.a.diff.harvest.run

Class AbstractFetcher

java.lang.Object

AbstractFetcher

All Implemented Interfaces:

Runnable, Fetcher

Direct Known Subclasses:

PipermailHarvester.Archive.SetupFetcher, PipermailHarvester.ContextFetcher

public abstract class AbstractFetcher
extends Object
implements Fetcher

Wrapper class around Runnable to work with asynchronous HTTP responses from HarvestRunner. Implement this and then schedule it. Once the scheduler can fetch the URL it sets the input stream and executes this job in its thread pool. All you have to care about is implementing Runnable.run() properly and schedule cascading jobs from there in the same way. See PipermailHarvester for reference.

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	AbstractFetcher(String archiveUrl, String path) Constructor depending on split URL parameters.

Method Summary

Methods

Modifier and Type	Method and Description
String	archiveUrl() Access to the base-url of the archive.
boolean	equals(Object o) Jobs are equal if and only if this.url.equals(job.url)
protected InputStream	getInputStream()
int	getStatusCode() Access HTTP error code, e.g. 404 for not found.
int	hashCode() Obey equals contract.
String	path()
void	setInputStream(InputStream is) Used by HarvestRunner to set the data stream returned by the request of the url.
void	setStatusCode(int code) Set HTTP status code, e.g. 404 for not found.
String	url() Base-url and path combined to complete url.

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface Fetcher

fault, run

Constructor Detail

AbstractFetcher

protected AbstractFetcher(String archiveUrl,
               String path)

Constructor depending on split URL parameters.

Parameters:

archiveUrl - url of this archive, unique

path - path and query of this archive

Method Detail

equals

public boolean equals(Object o)

Jobs are equal if and only if

 this.url.equals(job.url)
 

Overrides:

equals in class Object

Returns:

whether the jobs are equal

hashCode

public int hashCode()

Obey equals contract.

Overrides:

hashCode in class Object

archiveUrl

public String archiveUrl()

Access to the base-url of the archive.

Specified by:

archiveUrl in interface Fetcher

Returns:

base-url

path

public String path()

Returns:

URL of this job. This is final and cannot change.

url

public String url()

Base-url and path combined to complete url.

Specified by:

url in interface Fetcher

Returns:

url

setInputStream

public void setInputStream(InputStream is)

Used by HarvestRunner to set the data stream returned by the request of the url.

Specified by:

setInputStream in interface Fetcher

getInputStream

protected InputStream getInputStream()

Returns:

Once the HTTP response is complete, use this InputStream to read the response entity.

setStatusCode

public void setStatusCode(int code)

Set HTTP status code, e.g. 404 for not found.

Specified by:

setStatusCode in interface Fetcher

Parameters:

code -

getStatusCode

public int getStatusCode()

Access HTTP error code, e.g. 404 for not found.

Returns:

code