org.apache.flink.streaming.api.functions.sink.filesystem

类 OutputStreamBasedPartFileWriter<IN,BucketID>

java.lang.Object

org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter<IN,BucketID>

org.apache.flink.streaming.api.functions.sink.filesystem.OutputStreamBasedPartFileWriter<IN,BucketID>

类型参数:

IN - the element type

BucketID - the bucket type

所有已实现的接口:

CompactingFileWriter, InProgressFileWriter<IN,BucketID>, OutputStreamBasedCompactingFileWriter, PartFileInfo<BucketID>, RecordWiseCompactingFileWriter<IN>

直接已知子类:

RowWisePartWriter

public abstract class OutputStreamBasedPartFileWriter<IN,BucketID>
extends AbstractPartFileWriter<IN,BucketID>
implements OutputStreamBasedCompactingFileWriter

The base class for all the part file writer that use RecoverableFsDataOutputStream.

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable The InProgressFileRecoverable implementation for OutputStreamBasedBucketWriter.
static class	OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverableSerializer The serializer for OutputStreamBasedPartFileWriter.OutputStreamBasedInProgressFileRecoverable.
static class	OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable The PendingFileRecoverable implementation for OutputStreamBasedBucketWriter.
static class	OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverableSerializer The serializer for OutputStreamBasedPartFileWriter.OutputStreamBasedPendingFileRecoverable.

从接口继承的嵌套类/接口 org.apache.flink.streaming.api.functions.sink.filesystem.CompactingFileWriter

CompactingFileWriter.Type

从接口继承的嵌套类/接口 org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter

InProgressFileWriter.InProgressFileRecoverable, InProgressFileWriter.PendingFileRecoverable

方法概要

限定符和类型	方法和说明
OutputStream	asOutputStream() Gets the output stream underlying the writer.
InProgressFileWriter.PendingFileRecoverable	closeForCommit() Closes the writer and gets the InProgressFileWriter.PendingFileRecoverable of the written compacting file.
void	dispose() Dispose the part file.
protected void	ensureWriteType(CompactingFileWriter.Type type)
long	getSize()
InProgressFileWriter.InProgressFileRecoverable	persist()

从类继承的方法 org.apache.flink.streaming.api.functions.sink.filesystem.AbstractPartFileWriter

getBucketId, getCreationTime, getLastUpdateTime, markWrite

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.functions.sink.filesystem.InProgressFileWriter

write, write

方法详细资料

persist

public InProgressFileWriter.InProgressFileRecoverable persist()
                                                       throws IOException

指定者:

persist 在接口中 InProgressFileWriter<IN,BucketID>

返回:

The state of the current part file.

抛出:

IOException - Thrown if persisting the part file fails.

closeForCommit

public InProgressFileWriter.PendingFileRecoverable closeForCommit()
                                                           throws IOException

从接口复制的说明: CompactingFileWriter

Closes the writer and gets the InProgressFileWriter.PendingFileRecoverable of the written compacting file.

指定者:

closeForCommit 在接口中 CompactingFileWriter

指定者:

closeForCommit 在接口中 InProgressFileWriter<IN,BucketID>

返回:

The state of the pending part file. Bucket uses this to commit the pending file.

抛出:

IOException - Thrown if an I/O error occurs.

dispose

public void dispose()

从接口复制的说明: InProgressFileWriter

Dispose the part file.

指定者:

dispose 在接口中 InProgressFileWriter<IN,BucketID>

getSize

public long getSize()
             throws IOException

指定者:

getSize 在接口中 PartFileInfo<BucketID>

返回:

The size of the currently open part file.

抛出:

IOException

asOutputStream

public OutputStream asOutputStream()
                            throws IOException

从接口复制的说明: OutputStreamBasedCompactingFileWriter

Gets the output stream underlying the writer. The close method of the returned stream should never be called.

指定者:

asOutputStream 在接口中 OutputStreamBasedCompactingFileWriter

返回:

The output stream to write the compacting file.

抛出:

IOException - Thrown if acquiring the stream fails.

ensureWriteType

protected void ensureWriteType(CompactingFileWriter.Type type)