Package com.marklogic.contentpump
Class RDFInputFormat
- java.lang.Object
-
- org.apache.hadoop.mapreduce.InputFormat<K,V>
-
- org.apache.hadoop.mapreduce.lib.input.FileInputFormat<K,V>
-
- com.marklogic.contentpump.FileAndDirectoryInputFormat<DocumentURIWithSourceInfo,org.apache.hadoop.io.Text>
-
- com.marklogic.contentpump.RDFInputFormat
-
- Direct Known Subclasses:
CompressedRDFInputFormat
public class RDFInputFormat extends FileAndDirectoryInputFormat<DocumentURIWithSourceInfo,org.apache.hadoop.io.Text>
InputFormat for RDF.
-
-
Nested Class Summary
-
Nested classes/interfaces inherited from class com.marklogic.contentpump.FileAndDirectoryInputFormat
FileAndDirectoryInputFormat.MultiPathFilter
-
-
Field Summary
Fields Modifier and Type Field Description static org.apache.commons.logging.LogLOG-
Fields inherited from class com.marklogic.contentpump.FileAndDirectoryInputFormat
hiddenFileFilter, SPLIT_COUNT_LIMIT
-
-
Constructor Summary
Constructors Constructor Description RDFInputFormat()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description org.apache.hadoop.mapreduce.RecordReader<DocumentURIWithSourceInfo,org.apache.hadoop.io.Text>createRecordReader(org.apache.hadoop.mapreduce.InputSplit is, org.apache.hadoop.mapreduce.TaskAttemptContext context)protected LinkedMapWritablegetRoleMap(org.apache.hadoop.mapreduce.TaskAttemptContext context)protected StringgetServerVersion(org.apache.hadoop.mapreduce.TaskAttemptContext context)protected booleanisSplitable(org.apache.hadoop.mapreduce.JobContext context, org.apache.hadoop.fs.Path filename)-
Methods inherited from class com.marklogic.contentpump.FileAndDirectoryInputFormat
getSplits, listStatus, simpleAddInputPathRecursively
-
Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat
addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, makeSplit, makeSplit, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize
-
-
-
-
Method Detail
-
isSplitable
protected boolean isSplitable(org.apache.hadoop.mapreduce.JobContext context, org.apache.hadoop.fs.Path filename)- Overrides:
isSplitablein classFileAndDirectoryInputFormat<DocumentURIWithSourceInfo,org.apache.hadoop.io.Text>
-
createRecordReader
public org.apache.hadoop.mapreduce.RecordReader<DocumentURIWithSourceInfo,org.apache.hadoop.io.Text> createRecordReader(org.apache.hadoop.mapreduce.InputSplit is, org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException, InterruptedException
- Specified by:
createRecordReaderin classorg.apache.hadoop.mapreduce.InputFormat<DocumentURIWithSourceInfo,org.apache.hadoop.io.Text>- Throws:
IOExceptionInterruptedException
-
getRoleMap
protected LinkedMapWritable getRoleMap(org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException
- Throws:
IOException
-
getServerVersion
protected String getServerVersion(org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException
- Throws:
IOException
-
-