Interface | Description |
---|---|
IngestFromHdfsPlugin<I,O> |
This is the main plugin interface for ingesting intermediate data into Geowave that has
previously been staged in HDFS.
|
IngestWithMapper<I,O> |
This interface is used by the IngestFromHdfsPlugin to implement ingestion within a mapper only.
|
IngestWithReducer<I,K extends org.apache.hadoop.io.WritableComparable<?>,V extends org.apache.hadoop.io.Writable,O> |
This interface is used by the IngestFromHdfsPlugin to implement ingestion with a mapper to
aggregate key value pairs and a reducer to ingest data into GeoWave.
|
Class | Description |
---|---|
AbstractLocalIngestWithMapper<T> |
This class can be sub-classed as a general-purpose recipe for parallelizing ingestion of files
either locally or by directly staging the binary of the file to HDFS and then ingesting it within
the map phase of a map-reduce job.
|
AbstractLocalIngestWithMapper.InternalIngestWithMapper<T> | |
AbstractMapReduceIngest<T extends Persistable & DataAdapterProvider<?>> |
This class can be sub-classed to run map-reduce jobs within the ingest framework using plugins
provided by types that are discovered through SPI.
|
ByteBufferBackedInputStream | |
IngestFromHdfsDriver |
This class actually executes the ingestion of intermediate data into GeoWave that had been staged
in HDFS.
|
IngestMapper |
This class is the map-reduce mapper for ingestion with the mapper only.
|
IngestPersistableRegistry | |
IngestReducer |
This is the map-reduce reducer for ingestion with both the mapper and reducer.
|
IngestWithMapperJobRunner |
This will run the mapper only ingest process.
|
IngestWithReducerJobRunner |
This class will run the ingestion process by using a mapper to aggregate key value pairs and a
reducer to ingest data into GeoWave.
|
IntermediateKeyValueMapper |
This class is the mapper used when aggregating key value pairs from intermediate data to be
ingested into GeoWave using a reducer.
|
KeyValueData<K extends org.apache.hadoop.io.WritableComparable<?>,V extends org.apache.hadoop.io.Writable> |
The Key-Value pair that will be emitted from a mapper and used by a reducer in the
IngestWithReducer flow.
|
MapReduceCommandLineOptions |
This class encapsulates all of the options and parsed values specific to setting up the GeoWave
ingestion framework to run on hadoop map-reduce.
|
MapReduceCommandLineOptions.NoSplitter |
Copyright © 2013–2022. All rights reserved.