MarkLogic Connector for Hadoop 1.1-3

com.marklogic.mapreduce
Class ValueInputFormat<VALUEIN>

java.lang.Object
  extended by org.apache.hadoop.mapreduce.InputFormat<KEYIN,VALUEIN>
      extended by com.marklogic.mapreduce.MarkLogicInputFormat<org.apache.hadoop.io.LongWritable,VALUEIN>
          extended by com.marklogic.mapreduce.ValueInputFormat<VALUEIN>
Type Parameters:
VALUEIN -
All Implemented Interfaces:
MarkLogicConstants

public class ValueInputFormat<VALUEIN>
extends MarkLogicInputFormat<org.apache.hadoop.io.LongWritable,VALUEIN>
implements MarkLogicConstants

MarkLogicInputFormat for a value other than document or node with user specified key and connector-generated key.

Use this class to get input data from a MarkLogic database and produce key-value pairs with value types such as Text and IntWritable through implicit conversions performed by the connector. For details on the supported conversions, see "Using KeyValueInputFormat and ValueInputFormat" in the Hadoop MapReduce Connector Developer's Guide.

The LongWritable key created with this class is not intended to be a meaningful value. Use this class when only the content in the value is interesting. The key is simply the number of values seen at the time a key-value pair is generated.

See Also:
LinkCount

Field Summary
 
Fields inherited from class com.marklogic.mapreduce.MarkLogicInputFormat
LOG
 
Fields inherited from interface com.marklogic.mapreduce.MarkLogicConstants
ADVANCED_MODE, BASIC_MODE, BATCH_SIZE, BIND_SPLIT_RANGE, CONTENT_TYPE, DEFAULT_BATCH_SIZE, DEFAULT_CONTENT_TYPE, DEFAULT_MAX_SPLIT_SIZE, DEFAULT_OUTPUT_CONTENT_ENCODING, DEFAULT_OUTPUT_XML_REPAIR_LEVEL, DEFAULT_PROPERTY_OPERATION_TYPE, DOCUMENT_SELECTOR, INDENTED, INPUT_DATABASE_NAME, INPUT_HOST, INPUT_KEY_CLASS, INPUT_LEXICON_FUNCTION_CLASS, INPUT_MODE, INPUT_PASSWORD, INPUT_PORT, INPUT_QUERY, INPUT_SSL_OPTIONS_CLASS, INPUT_USE_SSL, INPUT_USERNAME, INPUT_VALUE_CLASS, MAX_SPLIT_SIZE, MR_NAMESPACE, NODE_OPERATION_TYPE, OUTPUT_CLEAN_DIR, OUTPUT_COLLECTION, OUTPUT_CONTENT_ENCODING, OUTPUT_CONTENT_LANGUAGE, OUTPUT_CONTENT_NAMESPACE, OUTPUT_DIRECTORY, OUTPUT_FAST_LOAD, OUTPUT_FOREST_HOST, OUTPUT_HOST, OUTPUT_KEY_TYPE, OUTPUT_KEY_VARNAME, OUTPUT_NAMESPACE, OUTPUT_PASSWORD, OUTPUT_PERMISSION, OUTPUT_PORT, OUTPUT_PROPERTY_ALWAYS_CREATE, OUTPUT_QUALITY, OUTPUT_QUERY, OUTPUT_SSL_OPTIONS_CLASS, OUTPUT_STREAMING, OUTPUT_TOLERATE_ERRORS, OUTPUT_USE_SSL, OUTPUT_USERNAME, OUTPUT_VALUE_TYPE, OUTPUT_VALUE_VARNAME, OUTPUT_XML_REPAIR_LEVEL, PATH_NAMESPACE, PROPERTY_OPERATION_TYPE, RECORD_TO_FRAGMENT_RATIO, SPLIT_END_VARNAME, SPLIT_QUERY, SPLIT_START_VARNAME, SUBDOCUMENT_EXPRESSION, TXN_SIZE
 
Constructor Summary
ValueInputFormat()
           
 
Method Summary
 org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,VALUEIN> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
           
 
Methods inherited from class com.marklogic.mapreduce.MarkLogicInputFormat
getSplits
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

ValueInputFormat

public ValueInputFormat()
Method Detail

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,VALUEIN> createRecordReader(org.apache.hadoop.mapreduce.InputSplit split,
                                                                                                              org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                                                       throws IOException,
                                                                                                              InterruptedException
Specified by:
createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.LongWritable,VALUEIN>
Throws:
IOException
InterruptedException

MarkLogic Connector for Hadoop 1.1-3

Copyright © 2013 MarkLogic Corporation. All Rights Reserved.

Complete online documentation for MarkLogic Server, XQuery and related components may be found at developer.marklogic.com