gov.nasa.pds.harvest.search.crawler

Class CollectionCrawler

java.lang.Object

gov.nasa.jpl.oodt.cas.crawl.config.ProductCrawlerBean

gov.nasa.pds.harvest.search.crawler.ProductCrawler

gov.nasa.pds.harvest.search.crawler.PDSProductCrawler

gov.nasa.pds.harvest.search.crawler.CollectionCrawler

All Implemented Interfaces:

gov.nasa.jpl.oodt.cas.commons.spring.SpringSetIdInjectionType, gov.nasa.jpl.oodt.cas.filemgr.metadata.CoreMetKeys

Direct Known Subclasses:

BundleCrawler

public class CollectionCrawler
extends PDSProductCrawler

A crawler class for a PDS Collection file.

Author:

mcayanan

Field Summary

Fields inherited from class gov.nasa.pds.harvest.search.crawler.PDSProductCrawler

inPersistanceMode, touchedFiles

Fields inherited from class gov.nasa.pds.harvest.search.crawler.ProductCrawler

DIR_FILTER, FILE_FILTER, LOG

Fields inherited from class gov.nasa.jpl.oodt.cas.crawl.config.ProductCrawlerBean

MIME_TYPES_HIERARCHY

Fields inherited from interface gov.nasa.jpl.oodt.cas.filemgr.metadata.CoreMetKeys

FILE_LOCATION, FILENAME, MIME_TYPE, PRODUCT_ID, PRODUCT_NAME, PRODUCT_RECEVIED_TIME, PRODUCT_STRUCTURE, PRODUCT_TYPE

Constructor Summary

Constructors

Constructor and Description
CollectionCrawler(Pds4MetExtractorConfig extractorConfig) Constructor.

Method Summary

Methods

Modifier and Type	Method and Description
void	crawl(File collection) Crawl a PDS4 collection file.
protected boolean	generateDoc(File product, gov.nasa.jpl.oodt.cas.metadata.Metadata productMetadata)

Methods inherited from class gov.nasa.pds.harvest.search.crawler.PDSProductCrawler

addAction, addActions, addKnownMetadata, getActions, getMetadataForProduct, getMetExtractorConfig, passesPreconditions, setDirectoryFilter, setFileFilter, setInPersistanceMode, setMetExtractorConfig

Methods inherited from class gov.nasa.pds.harvest.search.crawler.ProductCrawler

clearIngestStatus, crawl, createProduct, getIngestStatus, getSearchDocGenerator, handleFile, setActionRepo, setSearchDocGenerator

Methods inherited from class gov.nasa.jpl.oodt.cas.crawl.config.ProductCrawlerBean

addRequiredMetadata, getActionIds, getApplicationContext, getDaemonPort, getDaemonWait, getFilemgrUrl, getGlobalMetadata, getId, getIngester, getProductPath, getRequiredMetadata, isCrawlForDirs, isNoRecur, isSkipIngest, setActionIds, setApplicationContext, setCrawlForDirs, setDaemonPort, setDaemonWait, setFilemgrUrl, setGlobalMetadata, setId, setIngester, setNoRecur, setProductPath, setRequiredMetadata, setSkipIngest

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CollectionCrawler

public CollectionCrawler(Pds4MetExtractorConfig extractorConfig)

Constructor.

Parameters:

extractorConfig - A configuration class for the metadata extractor.

Method Detail

crawl

public void crawl(File collection)

Crawl a PDS4 collection file. Method will register the collection first before attempting to register the product files it is pointing to.

Overrides:

crawl in class PDSProductCrawler

Parameters:

collection - The PDS4 Collection file.

generateDoc

protected boolean generateDoc(File product,
                  gov.nasa.jpl.oodt.cas.metadata.Metadata productMetadata)

Overrides:

generateDoc in class ProductCrawler