Class FileIterator

  • All Implemented Interfaces:
    Iterator<org.apache.hadoop.mapreduce.lib.input.FileSplit>

    public class FileIterator
    extends Object
    implements Iterator<org.apache.hadoop.mapreduce.lib.input.FileSplit>
    A Iterator that returns a FileSplit per file, excluding directories
    • Field Detail

      • LOG

        public static final org.apache.commons.logging.Log LOG
      • iterator

        protected Iterator<org.apache.hadoop.mapreduce.lib.input.FileSplit> iterator
      • fileDirSplits

        protected List<org.apache.hadoop.mapreduce.lib.input.FileSplit> fileDirSplits
      • expandedFileSplits

        protected List<org.apache.hadoop.mapreduce.lib.input.FileSplit> expandedFileSplits
      • inputFilter

        protected org.apache.hadoop.fs.PathFilter inputFilter
      • conf

        protected org.apache.hadoop.conf.Configuration conf
    • Constructor Detail

      • FileIterator

        public FileIterator​(Iterator<org.apache.hadoop.mapreduce.lib.input.FileSplit> iterator,
                            org.apache.hadoop.mapreduce.TaskAttemptContext context)
      • FileIterator

        public FileIterator​(org.apache.hadoop.mapreduce.lib.input.FileSplit inSplit,
                            org.apache.hadoop.mapreduce.TaskAttemptContext context)
    • Method Detail

      • hasNext

        public boolean hasNext()
        Specified by:
        hasNext in interface Iterator<org.apache.hadoop.mapreduce.lib.input.FileSplit>
      • next

        public org.apache.hadoop.mapreduce.lib.input.FileSplit next()
        Specified by:
        next in interface Iterator<org.apache.hadoop.mapreduce.lib.input.FileSplit>
      • remove

        public void remove()
        Specified by:
        remove in interface Iterator<org.apache.hadoop.mapreduce.lib.input.FileSplit>
      • getInputPathFilter

        protected org.apache.hadoop.fs.PathFilter getInputPathFilter()