org.apache.flink.formats.avro

类 AvroInputFormat<E>

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<OT,org.apache.flink.core.fs.FileInputSplit>

org.apache.flink.api.common.io.FileInputFormat<E>

org.apache.flink.formats.avro.AvroInputFormat<E>

类型参数:

E - the type of the result Avro record. If you specify GenericRecord then the result will be returned as a GenericRecord, so you do not have to know the schema ahead of time.

所有已实现的接口:

Serializable, org.apache.flink.api.common.io.CheckpointableInputFormat<org.apache.flink.core.fs.FileInputSplit,org.apache.flink.api.java.tuple.Tuple2<Long,Long>>, org.apache.flink.api.common.io.InputFormat<E,org.apache.flink.core.fs.FileInputSplit>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<E>, org.apache.flink.core.io.InputSplitSource<org.apache.flink.core.fs.FileInputSplit>

public class AvroInputFormat<E>
extends org.apache.flink.api.common.io.FileInputFormat<E>
implements org.apache.flink.api.java.typeutils.ResultTypeQueryable<E>, org.apache.flink.api.common.io.CheckpointableInputFormat<org.apache.flink.core.fs.FileInputSplit,org.apache.flink.api.java.tuple.Tuple2<Long,Long>>

Provides a FileInputFormat for Avro records.

另请参阅:

序列化表格

嵌套类概要

从类继承的嵌套类/接口 org.apache.flink.api.common.io.FileInputFormat

org.apache.flink.api.common.io.FileInputFormat.FileBaseStatistics, org.apache.flink.api.common.io.FileInputFormat.InputSplitOpenThread

字段概要

从类继承的字段 org.apache.flink.api.common.io.FileInputFormat

currentSplit, ENUMERATE_NESTED_FILES_FLAG, enumerateNestedFiles, filePath, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable

构造器概要

构造器

构造器和说明
AvroInputFormat(org.apache.flink.core.fs.Path filePath, Class<E> type)

方法概要

限定符和类型	方法和说明
org.apache.flink.api.java.tuple.Tuple2<Long,Long>	getCurrentState()
org.apache.flink.api.common.typeinfo.TypeInformation<E>	getProducedType()
long	getRecordsReadFromBlock()
E	nextRecord(E reuseValue)
void	open(org.apache.flink.core.fs.FileInputSplit split)
boolean	reachedEnd()
void	reopen(org.apache.flink.core.fs.FileInputSplit split, org.apache.flink.api.java.tuple.Tuple2<Long,Long> state)
void	setReuseAvroValue(boolean reuseAvroValue) Sets the flag whether to reuse the Avro value instance for all records.
void	setUnsplittable(boolean unsplittable) If set, the InputFormat will only read entire files.
boolean	supportsMultiPaths()

从类继承的方法 org.apache.flink.api.common.io.FileInputFormat

acceptFile, close, configure, createInputSplits, decorateInputStream, extractFileExtension, getFilePath, getFilePaths, getFileStats, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNestedFileEnumeration, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, getStatistics, registerInflaterInputStreamFactory, setFilePath, setFilePath, setFilePaths, setFilePaths, setFilesFilter, setMinSplitSize, setNestedFileEnumeration, setNumSplits, setOpenTimeout, testForUnsplittable, toString

从类继承的方法 org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

构造器详细资料

AvroInputFormat

public AvroInputFormat(org.apache.flink.core.fs.Path filePath,
                       Class<E> type)

方法详细资料

setReuseAvroValue

public void setReuseAvroValue(boolean reuseAvroValue)

Sets the flag whether to reuse the Avro value instance for all records. By default, the input format reuses the Avro value.

参数:

reuseAvroValue - True, if the input format should reuse the Avro value instance, false otherwise.

setUnsplittable

public void setUnsplittable(boolean unsplittable)

If set, the InputFormat will only read entire files.

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<E> getProducedType()

指定者:

getProducedType 在接口中 org.apache.flink.api.java.typeutils.ResultTypeQueryable<E>

open

public void open(org.apache.flink.core.fs.FileInputSplit split)
          throws IOException

指定者:

open 在接口中 org.apache.flink.api.common.io.InputFormat<E,org.apache.flink.core.fs.FileInputSplit>

覆盖:

open 在类中 org.apache.flink.api.common.io.FileInputFormat<E>

抛出:

IOException

reachedEnd

public boolean reachedEnd()
                   throws IOException

指定者:

reachedEnd 在接口中 org.apache.flink.api.common.io.InputFormat<E,org.apache.flink.core.fs.FileInputSplit>

抛出:

IOException

getRecordsReadFromBlock

public long getRecordsReadFromBlock()

nextRecord

public E nextRecord(E reuseValue)
             throws IOException

指定者:

nextRecord 在接口中 org.apache.flink.api.common.io.InputFormat<E,org.apache.flink.core.fs.FileInputSplit>

抛出:

IOException

supportsMultiPaths

public boolean supportsMultiPaths()

覆盖:

supportsMultiPaths 在类中 org.apache.flink.api.common.io.FileInputFormat<E>

getCurrentState

public org.apache.flink.api.java.tuple.Tuple2<Long,Long> getCurrentState()
                                                                  throws IOException

指定者:

getCurrentState 在接口中 org.apache.flink.api.common.io.CheckpointableInputFormat<org.apache.flink.core.fs.FileInputSplit,org.apache.flink.api.java.tuple.Tuple2<Long,Long>>

抛出:

IOException

reopen

public void reopen(org.apache.flink.core.fs.FileInputSplit split,
                   org.apache.flink.api.java.tuple.Tuple2<Long,Long> state)
            throws IOException

指定者:

reopen 在接口中 org.apache.flink.api.common.io.CheckpointableInputFormat<org.apache.flink.core.fs.FileInputSplit,org.apache.flink.api.java.tuple.Tuple2<Long,Long>>

抛出:

IOException