com.github.panhongan.util.hadoop

类 SuffixMultipleTextOutputFormat

java.lang.Object

org.apache.hadoop.mapred.FileOutputFormat<K,V>

org.apache.hadoop.mapred.lib.MultipleOutputFormat<K,V>

org.apache.hadoop.mapred.lib.MultipleTextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

com.github.panhongan.util.hadoop.SuffixMultipleTextOutputFormat

所有已实现的接口:

org.apache.hadoop.mapred.OutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

public class SuffixMultipleTextOutputFormat
extends org.apache.hadoop.mapred.lib.MultipleTextOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

嵌套类概要

从类继承的嵌套类/接口 org.apache.hadoop.mapred.FileOutputFormat

org.apache.hadoop.mapred.FileOutputFormat.Counter

构造器概要

构造器

构造器和说明
SuffixMultipleTextOutputFormat()

方法概要

方法

限定符和类型	方法和说明
protected org.apache.hadoop.io.Text	generateActualKey(org.apache.hadoop.io.Text key, org.apache.hadoop.io.Text value)
protected org.apache.hadoop.io.Text	generateActualValue(org.apache.hadoop.io.Text key, org.apache.hadoop.io.Text value)
protected String	generateFileNameForKeyValue(org.apache.hadoop.io.Text key, org.apache.hadoop.io.Text value, String name)
static void	main(String[] args)
void	test(org.apache.hadoop.io.Text key, org.apache.hadoop.io.Text value, String name)

从类继承的方法 org.apache.hadoop.mapred.lib.MultipleTextOutputFormat

getBaseRecordWriter

从类继承的方法 org.apache.hadoop.mapred.lib.MultipleOutputFormat

generateLeafFileName, getInputFileBasedOutputFileName, getRecordWriter

从类继承的方法 org.apache.hadoop.mapred.FileOutputFormat

checkOutputSpecs, getCompressOutput, getOutputCompressorClass, getOutputPath, getPathForCustomFile, getTaskOutputPath, getUniqueName, getWorkOutputPath, setCompressOutput, setOutputCompressorClass, setOutputPath

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SuffixMultipleTextOutputFormat

public SuffixMultipleTextOutputFormat()

方法详细资料

test

public void test(org.apache.hadoop.io.Text key,
        org.apache.hadoop.io.Text value,
        String name)

generateActualKey

protected org.apache.hadoop.io.Text generateActualKey(org.apache.hadoop.io.Text key,
                                          org.apache.hadoop.io.Text value)

覆盖:

generateActualKey 在类中 org.apache.hadoop.mapred.lib.MultipleOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

generateActualValue

protected org.apache.hadoop.io.Text generateActualValue(org.apache.hadoop.io.Text key,
                                            org.apache.hadoop.io.Text value)

覆盖:

generateActualValue 在类中 org.apache.hadoop.mapred.lib.MultipleOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

generateFileNameForKeyValue

protected String generateFileNameForKeyValue(org.apache.hadoop.io.Text key,
                                 org.apache.hadoop.io.Text value,
                                 String name)

覆盖:

generateFileNameForKeyValue 在类中 org.apache.hadoop.mapred.lib.MultipleOutputFormat<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

main

public static void main(String[] args)