Index (Flink : Connectors : Files 1.12.0 API)

A B C D E F G H I L M N O P R S T U W

A

AbstractFileSource<T,SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.src: The base class for File Sources.
AbstractFileSource(Path[], FileEnumerator.Provider, FileSplitAssigner.Provider, BulkFormat<T, SplitT>, ContinuousEnumerationSettings) - Constructor for class org.apache.flink.connector.file.src.AbstractFileSource
AbstractFileSource.AbstractFileSourceBuilder<T,SplitT extends FileSourceSplit,SELF extends AbstractFileSource.AbstractFileSourceBuilder<T,SplitT,SELF>> - Class in org.apache.flink.connector.file.src: The generic base builder.
AbstractFileSourceBuilder(Path[], BulkFormat<T, SplitT>, FileEnumerator.Provider, FileSplitAssigner.Provider) - Constructor for class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder
add(T) - Method in class org.apache.flink.connector.file.src.util.Pool: Adds an entry to the pool with an optional payload.
addReader(int) - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator
addReader(int) - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator
addSplits(Collection<FileSourceSplit>) - Method in interface org.apache.flink.connector.file.src.assigners.FileSplitAssigner: Adds a set of splits to this assigner.
addSplits(Collection<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.assigners.LocalityAwareSplitAssigner
addSplits(Collection<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner
addSplitsBack(List<FileSourceSplit>, int) - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator
addSplitsBack(List<FileSourceSplit>, int) - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator
ArrayResultIterator<E> - Class in org.apache.flink.connector.file.src.util: A simple BulkFormat.RecordIterator that returns the elements of an array, one after the other.
ArrayResultIterator() - Constructor for class org.apache.flink.connector.file.src.util.ArrayResultIterator: Creates a new, initially empty, ArrayResultIterator.
ArrayResultIterator(Runnable) - Constructor for class org.apache.flink.connector.file.src.util.ArrayResultIterator: Creates a new, initially empty, ArrayResultIterator.

B

BlockSplittingRecursiveEnumerator - Class in org.apache.flink.connector.file.src.enumerate: This FileEnumerator enumerates all files under the given paths recursively, and creates a separate split for each file block.
BlockSplittingRecursiveEnumerator() - Constructor for class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveEnumerator: Creates a new enumerator that enumerates all files except hidden files.
BlockSplittingRecursiveEnumerator(Predicate<Path>, String[]) - Constructor for class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveEnumerator: Creates a new enumerator that uses the given predicate as a filter for file paths, and avoids splitting files with the given extension (typically to avoid splitting compressed files).
build() - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder: Creates the actual sink.
build() - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder: Creates the actual sink.
build() - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder: Creates the file source with the settings applied to this builder.
build() - Method in class org.apache.flink.connector.file.src.FileSource.FileSourceBuilder
BulkFormat<T,SplitT extends FileSourceSplit> - Interface in org.apache.flink.connector.file.src.reader: The BulkFormat reads and decodes batches of records at a time.
BulkFormat.Reader<T> - Interface in org.apache.flink.connector.file.src.reader: The actual reader that reads the batches of records.
BulkFormat.RecordIterator<T> - Interface in org.apache.flink.connector.file.src.reader: An iterator over records with their position in the file.
BulkFormatBuilder(Path, BulkWriter.Factory<IN>, BucketAssigner<IN, String>) - Constructor for class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder
BulkFormatBuilder(Path, long, BulkWriter.Factory<IN>, BucketAssigner<IN, String>, CheckpointRollingPolicy<IN, String>, FileWriterBucketFactory<IN>, OutputFileConfig) - Constructor for class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder

C

CheckpointedPosition - Class in org.apache.flink.connector.file.src.util: The position of a reader, to be stored in a checkpoint.
CheckpointedPosition(long, long) - Constructor for class org.apache.flink.connector.file.src.util.CheckpointedPosition: Creates a new CheckpointedPosition for given offset and records-to-skip.
close() - Method in class org.apache.flink.connector.file.sink.committer.FileCommitter
close() - Method in class org.apache.flink.connector.file.sink.writer.FileWriter
close() - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator
close() - Method in class org.apache.flink.connector.file.src.impl.FileRecordFormatAdapter.Reader
close() - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator
close() - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter.Reader
close() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat.Reader: Closes the reader and should release all resources.
close() - Method in interface org.apache.flink.connector.file.src.reader.FileRecordFormat.Reader: Closes the reader to release all resources.
close() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat.Reader: Closes the reader to release all resources.
close() - Method in class org.apache.flink.connector.file.src.reader.TextLineFormat.Reader
commit(List<FileSinkCommittable>) - Method in class org.apache.flink.connector.file.sink.committer.FileCommitter
ContinuousEnumerationSettings - Class in org.apache.flink.connector.file.src: Settings describing how to do continuous file discovery and enumeration for the file source's continuous discovery and streaming mode.
ContinuousEnumerationSettings(Duration) - Constructor for class org.apache.flink.connector.file.src.ContinuousEnumerationSettings
ContinuousFileSplitEnumerator - Class in org.apache.flink.connector.file.src.impl: A continuously monitoring enumerator.
ContinuousFileSplitEnumerator(SplitEnumeratorContext<FileSourceSplit>, FileEnumerator, FileSplitAssigner, Path[], Collection<Path>, long) - Constructor for class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator
continuousSourceSettings - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder
convertToSourceSplits(FileStatus, FileSystem, List<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveEnumerator
convertToSourceSplits(FileStatus, FileSystem, List<FileSourceSplit>) - Method in class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator
create(Collection<FileSourceSplit>) - Method in interface org.apache.flink.connector.file.src.assigners.FileSplitAssigner.Provider: Creates a new FileSplitAssigner that starts with the given set of initial splits.
create() - Method in interface org.apache.flink.connector.file.src.enumerate.FileEnumerator.Provider
createCommitter() - Method in class org.apache.flink.connector.file.sink.FileSink
createEnumerator(SplitEnumeratorContext<SplitT>) - Method in class org.apache.flink.connector.file.src.AbstractFileSource
createGlobalCommitter() - Method in class org.apache.flink.connector.file.sink.FileSink
createReader(SourceReaderContext) - Method in class org.apache.flink.connector.file.src.AbstractFileSource
createReader(Configuration, FileSourceSplit) - Method in class org.apache.flink.connector.file.src.impl.FileRecordFormatAdapter
createReader(Configuration, FileSourceSplit) - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter
createReader(Configuration, SplitT) - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat: Creates a new reader that reads from the split's path starting at the FileSourceSplit.offset() split's offset} and reads length bytes after the offset.
createReader(Configuration, Path, long, long) - Method in interface org.apache.flink.connector.file.src.reader.FileRecordFormat: Creates a new reader to read in this format.
createReader(Configuration, FSDataInputStream) - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat: Creates a new reader.
createReader(Configuration, FSDataInputStream, long, long) - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat
createReader(Configuration, FSDataInputStream, long, long) - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat: Creates a new reader to read in this format.
createReader(Configuration, FSDataInputStream) - Method in class org.apache.flink.connector.file.src.reader.TextLineFormat
createWriter(Sink.InitContext, List<FileWriterBucketState>) - Method in class org.apache.flink.connector.file.sink.FileSink

D

DEFAULT_CHARSET_NAME - Static variable in class org.apache.flink.connector.file.src.reader.TextLineFormat
DEFAULT_NON_SPLITTABLE_FILE_ENUMERATOR - Static variable in class org.apache.flink.connector.file.src.FileSource: The default file enumerator used for non-splittable formats.
DEFAULT_SPLIT_ASSIGNER - Static variable in class org.apache.flink.connector.file.src.FileSource: The default split assigner, a lazy locality-aware assigner.
DEFAULT_SPLITTABLE_FILE_ENUMERATOR - Static variable in class org.apache.flink.connector.file.src.FileSource: The default file enumerator used for splittable formats.
DefaultFileFilter - Class in org.apache.flink.connector.file.src.enumerate: A file filter that filters out hidden files based on common naming patterns, i.e., files where the filename starts with '.' or with '_'.
DefaultFileFilter() - Constructor for class org.apache.flink.connector.file.src.enumerate.DefaultFileFilter
DefaultFileWriterBucketFactory<IN> - Class in org.apache.flink.connector.file.sink.writer: A factory returning writer.
DefaultFileWriterBucketFactory() - Constructor for class org.apache.flink.connector.file.sink.writer.DefaultFileWriterBucketFactory
deserialize(int, byte[]) - Method in class org.apache.flink.connector.file.sink.FileSinkCommittableSerializer
deserialize(int, byte[]) - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketStateSerializer
deserialize(int, byte[]) - Method in class org.apache.flink.connector.file.src.FileSourceSplitSerializer
deserialize(int, byte[]) - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpointSerializer
doWithCleanupOnException(Closeable, SupplierWithException<E, IOException>) - Static method in class org.apache.flink.connector.file.src.util.Utils: Runs the given SupplierWithException (a piece of code producing a result).
doWithCleanupOnException(Closeable, ThrowingRunnable<IOException>) - Static method in class org.apache.flink.connector.file.src.util.Utils: Runs the given Runnable.

E

enumerateSplits(Path[], int) - Method in interface org.apache.flink.connector.file.src.enumerate.FileEnumerator: Generates all file splits for the relevant files under the given paths.
enumerateSplits(Path[], int) - Method in class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator
equals(Object) - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition

F

FETCH_IO_SIZE - Static variable in interface org.apache.flink.connector.file.src.reader.StreamFormat: The config option to define how many bytes to be read by the I/O thread in one fetch operation.
FileCommitter - Class in org.apache.flink.connector.file.sink.committer: Committer implementation for FileSink.
FileCommitter(BucketWriter<?, ?>) - Constructor for class org.apache.flink.connector.file.sink.committer.FileCommitter
fileEnumerator - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder
FileEnumerator - Interface in org.apache.flink.connector.file.src.enumerate: The FileEnumerator's task is to discover all files to be read and to split them into a set of FileSourceSplit.
FileEnumerator.Provider - Interface in org.apache.flink.connector.file.src.enumerate: Factory for the FileEnumerator, to allow the FileEnumerator to be eagerly initialized and to not be serializable.
FileRecordFormat<T> - Interface in org.apache.flink.connector.file.src.reader: A reader format that reads individual records from a file.
FileRecordFormat.Reader<T> - Interface in org.apache.flink.connector.file.src.reader: The actual reader that reads the records.
FileRecordFormatAdapter<T> - Class in org.apache.flink.connector.file.src.impl: The FormatReaderAdapter turns a FileRecordFormat into a BulkFormat.
FileRecordFormatAdapter(FileRecordFormat<T>) - Constructor for class org.apache.flink.connector.file.src.impl.FileRecordFormatAdapter
FileRecordFormatAdapter.Reader<T> - Class in org.apache.flink.connector.file.src.impl: The reader adapter, from FileRecordFormat.Reader to BulkFormat.Reader.
FileRecords<T> - Class in org.apache.flink.connector.file.src.impl: A collection of records for one file split.
FileSink<IN> - Class in org.apache.flink.connector.file.sink: A unified sink that emits its input elements to FileSystem files within buckets.
FileSink.BulkFormatBuilder<IN,T extends FileSink.BulkFormatBuilder<IN,T>> - Class in org.apache.flink.connector.file.sink: A builder for configuring the sink for bulk-encoding formats, e.g.
FileSink.DefaultBulkFormatBuilder<IN> - Class in org.apache.flink.connector.file.sink: Builder for the vanilla FileSink using a bulk format.
FileSink.DefaultRowFormatBuilder<IN> - Class in org.apache.flink.connector.file.sink: Builder for the vanilla FileSink using a row format.
FileSink.RowFormatBuilder<IN,T extends FileSink.RowFormatBuilder<IN,T>> - Class in org.apache.flink.connector.file.sink: A builder for configuring the sink for row-wise encoding formats.
FileSinkCommittable - Class in org.apache.flink.connector.file.sink: Wrapper class for both type of committables in FileSink.
FileSinkCommittable(InProgressFileWriter.PendingFileRecoverable) - Constructor for class org.apache.flink.connector.file.sink.FileSinkCommittable
FileSinkCommittable(InProgressFileWriter.InProgressFileRecoverable) - Constructor for class org.apache.flink.connector.file.sink.FileSinkCommittable
FileSinkCommittableSerializer - Class in org.apache.flink.connector.file.sink: Versioned serializer for FileSinkCommittable.
FileSinkCommittableSerializer(SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable>, SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable>) - Constructor for class org.apache.flink.connector.file.sink.FileSinkCommittableSerializer
FileSource<T> - Class in org.apache.flink.connector.file.src: A unified data source that reads files - both in batch and in streaming mode.
FileSource.FileSourceBuilder<T> - Class in org.apache.flink.connector.file.src: The builder for the FileSource, to configure the various behaviors.
FileSourceReader<T,SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.src.impl: A SourceReader that read records from FileSourceSplit.
FileSourceReader(SourceReaderContext, BulkFormat<T, SplitT>, Configuration) - Constructor for class org.apache.flink.connector.file.src.impl.FileSourceReader
FileSourceSplit - Class in org.apache.flink.connector.file.src: A SourceSplit that represents a file, or a region of a file.
FileSourceSplit(String, Path, long, long) - Constructor for class org.apache.flink.connector.file.src.FileSourceSplit: Constructs a split with host information.
FileSourceSplit(String, Path, long, long, String...) - Constructor for class org.apache.flink.connector.file.src.FileSourceSplit: Constructs a split with host information.
FileSourceSplit(String, Path, long, long, String[], CheckpointedPosition) - Constructor for class org.apache.flink.connector.file.src.FileSourceSplit: Constructs a split with host information.
FileSourceSplitSerializer - Class in org.apache.flink.connector.file.src: A serializer for the FileSourceSplit.
FileSourceSplitSerializer() - Constructor for class org.apache.flink.connector.file.src.FileSourceSplitSerializer
FileSourceSplitState<SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.src: State of the reader, essentially a mutable version of the FileSourceSplit.
FileSourceSplitState(SplitT) - Constructor for class org.apache.flink.connector.file.src.FileSourceSplitState
FileSplitAssigner - Interface in org.apache.flink.connector.file.src.assigners: The FileSplitAssigner is responsible for deciding what split should be processed next by which node.
FileSplitAssigner.Provider - Interface in org.apache.flink.connector.file.src.assigners: Factory for the FileSplitAssigner, to allow the FileSplitAssigner to be eagerly initialized and to not be serializable.
FileWriter<IN> - Class in org.apache.flink.connector.file.sink.writer: A SinkWriter implementation for FileSink.
FileWriter(Path, BucketAssigner<IN, String>, FileWriterBucketFactory<IN>, BucketWriter<IN, String>, RollingPolicy<IN, String>, OutputFileConfig, Sink.ProcessingTimeService, long) - Constructor for class org.apache.flink.connector.file.sink.writer.FileWriter: A constructor creating a new empty bucket manager.
FileWriterBucketFactory<IN> - Interface in org.apache.flink.connector.file.sink.writer: A factory able to create FileWriterBucket for the FileSink.
FileWriterBucketState - Class in org.apache.flink.connector.file.sink.writer: States for FileWriterBucket.
FileWriterBucketState(String, Path, long, InProgressFileWriter.InProgressFileRecoverable) - Constructor for class org.apache.flink.connector.file.sink.writer.FileWriterBucketState
FileWriterBucketState(String, Path, long, InProgressFileWriter.InProgressFileRecoverable, Map<Long, List<InProgressFileWriter.PendingFileRecoverable>>) - Constructor for class org.apache.flink.connector.file.sink.writer.FileWriterBucketState
FileWriterBucketStateSerializer - Class in org.apache.flink.connector.file.sink.writer: A SimpleVersionedSerializer used to serialize the BucketState.
FileWriterBucketStateSerializer(SimpleVersionedSerializer<InProgressFileWriter.InProgressFileRecoverable>, SimpleVersionedSerializer<InProgressFileWriter.PendingFileRecoverable>) - Constructor for class org.apache.flink.connector.file.sink.writer.FileWriterBucketStateSerializer
finishedSplit(String) - Static method in class org.apache.flink.connector.file.src.impl.FileRecords
finishedSplits() - Method in class org.apache.flink.connector.file.src.impl.FileRecords
forBulkFileFormat(BulkFormat<T, FileSourceSplit>, Path...) - Static method in class org.apache.flink.connector.file.src.FileSource: Builds a new FileSource using a BulkFormat to read batches of records from files.
forBulkFormat(Path, BulkWriter.Factory<IN>) - Static method in class org.apache.flink.connector.file.sink.FileSink
forEachRemaining(BulkFormat.Reader<T>, Consumer<? super T>) - Static method in class org.apache.flink.connector.file.src.util.Utils: Performs the given action for each remaining element in BulkFormat.Reader until all elements have been processed or the action throws an exception.
forRecordFileFormat(FileRecordFormat<T>, Path...) - Static method in class org.apache.flink.connector.file.src.FileSource: Builds a new FileSource using a FileRecordFormat to read record-by-record from a a file path.
forRecords(String, BulkFormat.RecordIterator<T>) - Static method in class org.apache.flink.connector.file.src.impl.FileRecords
forRecordStreamFormat(StreamFormat<T>, Path...) - Static method in class org.apache.flink.connector.file.src.FileSource: Builds a new FileSource using a StreamFormat to read record-by-record from a file stream.
forRowFormat(Path, Encoder<IN>) - Static method in class org.apache.flink.connector.file.sink.FileSink
fromCollectionSnapshot(Collection<T>) - Static method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint
fromCollectionSnapshot(Collection<T>, Collection<Path>) - Static method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint

G

getAlreadyProcessedPaths() - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint
getAssignerFactory() - Method in class org.apache.flink.connector.file.src.AbstractFileSource
getBoundedness() - Method in class org.apache.flink.connector.file.src.AbstractFileSource
getBucketId() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState
getBucketPath() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState
getCheckpointedPosition() - Method in interface org.apache.flink.connector.file.src.reader.FileRecordFormat.Reader: Optionally returns the current position of the reader.
getCheckpointedPosition() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat.Reader: Optionally returns the current position of the reader.
getCommittableSerializer() - Method in class org.apache.flink.connector.file.sink.FileSink
getCommonSuffixes() - Static method in class org.apache.flink.connector.file.src.compression.StandardDeCompressors: Gets all common file extensions of supported file compression formats.
getContinuousEnumerationSettings() - Method in class org.apache.flink.connector.file.src.AbstractFileSource
getDecompressorForExtension(String) - Static method in class org.apache.flink.connector.file.src.compression.StandardDeCompressors: Gets the decompressor for a file extension.
getDecompressorForFileName(String) - Static method in class org.apache.flink.connector.file.src.compression.StandardDeCompressors: Gets the decompressor for a file name.
getDiscoveryInterval() - Method in class org.apache.flink.connector.file.src.ContinuousEnumerationSettings
getEnumeratorCheckpointSerializer() - Method in class org.apache.flink.connector.file.src.AbstractFileSource
getGlobalCommittableSerializer() - Method in class org.apache.flink.connector.file.sink.FileSink
getInProgressFileCreationTime() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState
getInProgressFileToCleanup() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable
getNewBucket(String, Path, BucketWriter<IN, String>, RollingPolicy<IN, String>, OutputFileConfig) - Method in class org.apache.flink.connector.file.sink.writer.DefaultFileWriterBucketFactory
getNewBucket(String, Path, BucketWriter<IN, String>, RollingPolicy<IN, String>, OutputFileConfig) - Method in interface org.apache.flink.connector.file.sink.writer.FileWriterBucketFactory
getNext(String) - Method in interface org.apache.flink.connector.file.src.assigners.FileSplitAssigner: Gets the next split.
getNext(String) - Method in class org.apache.flink.connector.file.src.assigners.LocalityAwareSplitAssigner
getNext(String) - Method in class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner
getNextId() - Method in class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator
getOffset() - Method in class org.apache.flink.connector.file.src.FileSourceSplitState
getOffset() - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition: Gets the offset that the reader will seek to when restored from this checkpoint.
getOffset() - Method in class org.apache.flink.connector.file.src.util.RecordAndPosition
getPendingFile() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable
getPendingFileRecoverablesPerCheckpoint() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState
getProducedType() - Method in class org.apache.flink.connector.file.src.AbstractFileSource
getProducedType() - Method in class org.apache.flink.connector.file.src.impl.FileRecordFormatAdapter
getProducedType() - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter
getProducedType() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat: Gets the type produced by this format.
getProducedType() - Method in interface org.apache.flink.connector.file.src.reader.FileRecordFormat: Gets the type produced by this format.
getProducedType() - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat: Gets the type produced by this format.
getProducedType() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat: Gets the type produced by this format.
getProducedType() - Method in class org.apache.flink.connector.file.src.reader.TextLineFormat
getReaderPosition() - Method in class org.apache.flink.connector.file.src.FileSourceSplit: Gets the (checkpointed) position of the reader, if set.
getRecord() - Method in class org.apache.flink.connector.file.src.util.RecordAndPosition
getRecordsAfterOffset() - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition: Gets the records to skip after the offset.
getRecordSkipCount() - Method in class org.apache.flink.connector.file.src.util.RecordAndPosition
getRecordsToSkipAfterOffset() - Method in class org.apache.flink.connector.file.src.FileSourceSplitState
getSplits() - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint
getSplitSerializer() - Method in class org.apache.flink.connector.file.src.AbstractFileSource
getSplitSerializer() - Method in class org.apache.flink.connector.file.src.FileSource
getVersion() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittableSerializer
getVersion() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketStateSerializer
getVersion() - Method in class org.apache.flink.connector.file.src.FileSourceSplitSerializer
getVersion() - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpointSerializer
getWriterStateSerializer() - Method in class org.apache.flink.connector.file.sink.FileSink

H

handleSourceEvent(int, SourceEvent) - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator
handleSourceEvent(int, SourceEvent) - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator
handleSplitRequest(int, String) - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator
handleSplitRequest(int, String) - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator
hashCode() - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition
hasInProgressFileToCleanup() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable
hasPendingFile() - Method in class org.apache.flink.connector.file.sink.FileSinkCommittable
hostnames() - Method in class org.apache.flink.connector.file.src.FileSourceSplit: Gets the hostnames of the nodes storing the file range described by this split.

I

initializedState(SplitT) - Method in class org.apache.flink.connector.file.src.impl.FileSourceReader
initializeState(List<FileWriterBucketState>) - Method in class org.apache.flink.connector.file.sink.writer.FileWriter: Initializes the state after recovery from a failure.
inputPaths - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder
INSTANCE - Static variable in class org.apache.flink.connector.file.src.FileSourceSplitSerializer
isFileSplittable(Path) - Method in class org.apache.flink.connector.file.src.enumerate.BlockSplittingRecursiveEnumerator
isSplittable() - Method in class org.apache.flink.connector.file.src.impl.FileRecordFormatAdapter
isSplittable() - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter
isSplittable() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat: Checks whether this format is splittable.
isSplittable() - Method in interface org.apache.flink.connector.file.src.reader.FileRecordFormat: Checks whether this format is splittable.
isSplittable() - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat: This format is always not splittable.
isSplittable() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat: Checks whether this format is splittable.
IteratorResultIterator<E> - Class in org.apache.flink.connector.file.src.util: A simple BulkFormat.RecordIterator that returns the elements of an iterator, augmented with position information.
IteratorResultIterator(Iterator<E>, long, long) - Constructor for class org.apache.flink.connector.file.src.util.IteratorResultIterator: Creates a new RecordIterator returning the records from the given iterator, augmented with their position information.
IteratorResultIterator(Iterator<E>, long, long, Runnable) - Constructor for class org.apache.flink.connector.file.src.util.IteratorResultIterator: Creates a new RecordIterator returning the records from the given iterator, augmented with their position information.

L

length() - Method in class org.apache.flink.connector.file.src.FileSourceSplit: Returns the number of bytes in the file region described by this source split.
LocalityAwareSplitAssigner - Class in org.apache.flink.connector.file.src.assigners: A FileSplitAssigner that assigns to each host preferably splits that are local, before assigning splits that are not local.
LocalityAwareSplitAssigner(Collection<FileSourceSplit>) - Constructor for class org.apache.flink.connector.file.src.assigners.LocalityAwareSplitAssigner

M

monitorContinuously(Duration) - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder: Sets this source to streaming ("continuous monitoring") mode.
MutableRecordAndPosition<E> - Class in org.apache.flink.connector.file.src.util: A mutable version of the RecordAndPosition.
MutableRecordAndPosition() - Constructor for class org.apache.flink.connector.file.src.util.MutableRecordAndPosition

N

next() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator: Gets the next record from the file, together with its position.
next() - Method in class org.apache.flink.connector.file.src.util.ArrayResultIterator
next() - Method in class org.apache.flink.connector.file.src.util.IteratorResultIterator
next() - Method in class org.apache.flink.connector.file.src.util.SingletonResultIterator
nextRecordFromSplit() - Method in class org.apache.flink.connector.file.src.impl.FileRecords
nextSplit() - Method in class org.apache.flink.connector.file.src.impl.FileRecords
NO_OFFSET - Static variable in class org.apache.flink.connector.file.src.util.CheckpointedPosition: Constant for the offset, reflecting that the position does not contain any offset information.
NO_OFFSET - Static variable in class org.apache.flink.connector.file.src.util.RecordAndPosition: Constant for the offset, reflecting that the position does not contain any offset information.
NonSplittingRecursiveEnumerator - Class in org.apache.flink.connector.file.src.enumerate: This FileEnumerator enumerates all files under the given paths recursively.
NonSplittingRecursiveEnumerator() - Constructor for class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator: Creates a NonSplittingRecursiveEnumerator that enumerates all files except hidden files.
NonSplittingRecursiveEnumerator(Predicate<Path>) - Constructor for class org.apache.flink.connector.file.src.enumerate.NonSplittingRecursiveEnumerator: Creates a NonSplittingRecursiveEnumerator that uses the given predicate as a filter for file paths.

O

offset() - Method in class org.apache.flink.connector.file.src.FileSourceSplit: Returns the start of the file region referenced by this source split.
onProcessingTime(long) - Method in class org.apache.flink.connector.file.sink.writer.FileWriter
onSplitFinished(Map<String, FileSourceSplitState<SplitT>>) - Method in class org.apache.flink.connector.file.src.impl.FileSourceReader
org.apache.flink.connector.file.sink - package org.apache.flink.connector.file.sink
org.apache.flink.connector.file.sink.committer - package org.apache.flink.connector.file.sink.committer
org.apache.flink.connector.file.sink.writer - package org.apache.flink.connector.file.sink.writer
org.apache.flink.connector.file.src - package org.apache.flink.connector.file.src
org.apache.flink.connector.file.src.assigners - package org.apache.flink.connector.file.src.assigners
org.apache.flink.connector.file.src.compression - package org.apache.flink.connector.file.src.compression
org.apache.flink.connector.file.src.enumerate - package org.apache.flink.connector.file.src.enumerate
org.apache.flink.connector.file.src.impl - package org.apache.flink.connector.file.src.impl
org.apache.flink.connector.file.src.reader - package org.apache.flink.connector.file.src.reader
org.apache.flink.connector.file.src.util - package org.apache.flink.connector.file.src.util

P

path() - Method in class org.apache.flink.connector.file.src.FileSourceSplit: Gets the file's path.
PendingSplitsCheckpoint<SplitT extends FileSourceSplit> - Class in org.apache.flink.connector.file.src: A checkpoint of the current state of the containing the currently pending splits that are not yet assigned.
PendingSplitsCheckpoint(Collection<SplitT>, Collection<Path>) - Constructor for class org.apache.flink.connector.file.src.PendingSplitsCheckpoint
PendingSplitsCheckpointSerializer<T extends FileSourceSplit> - Class in org.apache.flink.connector.file.src: A serializer for the PendingSplitsCheckpoint.
PendingSplitsCheckpointSerializer(SimpleVersionedSerializer<T>) - Constructor for class org.apache.flink.connector.file.src.PendingSplitsCheckpointSerializer
pollEntry() - Method in class org.apache.flink.connector.file.src.util.Pool: Gets the next cached entry.
Pool<T> - Class in org.apache.flink.connector.file.src.util: A pool to cache and recycle heavyweight objects, to reduce object allocation.
Pool(int) - Constructor for class org.apache.flink.connector.file.src.util.Pool: Creates a pool with the given capacity.
Pool.Recycler<T> - Interface in org.apache.flink.connector.file.src.util: A Recycler puts objects into the pool that the recycler is associated with.
prepareCommit(boolean) - Method in class org.apache.flink.connector.file.sink.writer.FileWriter
processStaticFileSet() - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder: Sets this source to bounded (batch) mode.

R

read() - Method in interface org.apache.flink.connector.file.src.reader.FileRecordFormat.Reader: Reads the next record.
read() - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat.Reader: Reads the next record.
read() - Method in class org.apache.flink.connector.file.src.reader.TextLineFormat.Reader
readBatch() - Method in class org.apache.flink.connector.file.src.impl.FileRecordFormatAdapter.Reader
readBatch() - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter.Reader
readBatch() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat.Reader: Reads one batch.
readerFormat - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder
RecordAndPosition<E> - Class in org.apache.flink.connector.file.src.util: A record, together with the reader position to be stored in the checkpoint.
RecordAndPosition(E, long, long) - Constructor for class org.apache.flink.connector.file.src.util.RecordAndPosition: Creates a new RecordAndPosition with the given record and position info.
RECORDS_PER_FETCH - Static variable in interface org.apache.flink.connector.file.src.reader.FileRecordFormat: Config option for the number of records to hand over in each fetch.
RecyclableIterator<E> - Class in org.apache.flink.connector.file.src.util: Utility base class for iterators that accept a recycler.
RecyclableIterator(Runnable) - Constructor for class org.apache.flink.connector.file.src.util.RecyclableIterator: Creates a RecyclableIterator with the given optional recycler.
recycle() - Method in class org.apache.flink.connector.file.src.impl.FileRecords
recycle(T) - Method in interface org.apache.flink.connector.file.src.util.Pool.Recycler: Recycles the given object to the pool that this recycler works with.
recycler() - Method in class org.apache.flink.connector.file.src.util.Pool: Gets the recycler for this pool.
releaseBatch() - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat.RecordIterator: Releases the batch that this iterator iterated over.
releaseBatch() - Method in class org.apache.flink.connector.file.src.util.RecyclableIterator
remainingSplits() - Method in interface org.apache.flink.connector.file.src.assigners.FileSplitAssigner: Gets the remaining splits that this assigner has pending.
remainingSplits() - Method in class org.apache.flink.connector.file.src.assigners.LocalityAwareSplitAssigner
remainingSplits() - Method in class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner
restoreBucket(BucketWriter<IN, String>, RollingPolicy<IN, String>, FileWriterBucketState, OutputFileConfig) - Method in class org.apache.flink.connector.file.sink.writer.DefaultFileWriterBucketFactory
restoreBucket(BucketWriter<IN, String>, RollingPolicy<IN, String>, FileWriterBucketState, OutputFileConfig) - Method in interface org.apache.flink.connector.file.sink.writer.FileWriterBucketFactory
restoreEnumerator(SplitEnumeratorContext<SplitT>, PendingSplitsCheckpoint<SplitT>) - Method in class org.apache.flink.connector.file.src.AbstractFileSource
restoreReader(Configuration, FileSourceSplit) - Method in class org.apache.flink.connector.file.src.impl.FileRecordFormatAdapter
restoreReader(Configuration, FileSourceSplit) - Method in class org.apache.flink.connector.file.src.impl.StreamFormatAdapter
restoreReader(Configuration, SplitT) - Method in interface org.apache.flink.connector.file.src.reader.BulkFormat: Creates a new reader that reads from split.path() starting at offset and reads until length bytes after the offset.
restoreReader(Configuration, Path, long, long, long) - Method in interface org.apache.flink.connector.file.src.reader.FileRecordFormat: Restores a reader from a checkpointed position.
restoreReader(Configuration, FSDataInputStream, long, long, long) - Method in class org.apache.flink.connector.file.src.reader.SimpleStreamFormat
restoreReader(Configuration, FSDataInputStream, long, long, long) - Method in interface org.apache.flink.connector.file.src.reader.StreamFormat: Restores a reader from a checkpointed position.
RowFormatBuilder(Path, Encoder<IN>, BucketAssigner<IN, String>) - Constructor for class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder
RowFormatBuilder(Path, long, Encoder<IN>, BucketAssigner<IN, String>, RollingPolicy<IN, String>, FileWriterBucketFactory<IN>, OutputFileConfig) - Constructor for class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder

S

serialize(FileSinkCommittable) - Method in class org.apache.flink.connector.file.sink.FileSinkCommittableSerializer
serialize(FileWriterBucketState) - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketStateSerializer
serialize(FileSourceSplit) - Method in class org.apache.flink.connector.file.src.FileSourceSplitSerializer
serialize(PendingSplitsCheckpoint<T>) - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpointSerializer
set(E[], int, long, long) - Method in class org.apache.flink.connector.file.src.util.ArrayResultIterator: Sets the records to be returned by this iterator.
set(E, long, long) - Method in class org.apache.flink.connector.file.src.util.MutableRecordAndPosition: Updates the record and position in this object.
set(E, long, long) - Method in class org.apache.flink.connector.file.src.util.SingletonResultIterator: Sets the single record to be returned by this iterator.
setFileEnumerator(FileEnumerator.Provider) - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder: Configures the FileEnumerator for the source.
setNext(E) - Method in class org.apache.flink.connector.file.src.util.MutableRecordAndPosition: Sets the next record of a sequence.
setOffset(long) - Method in class org.apache.flink.connector.file.src.FileSourceSplitState
setPosition(long, long) - Method in class org.apache.flink.connector.file.src.FileSourceSplitState
setPosition(CheckpointedPosition) - Method in class org.apache.flink.connector.file.src.FileSourceSplitState
setPosition(long, long) - Method in class org.apache.flink.connector.file.src.util.MutableRecordAndPosition: Sets the position without setting a record.
setRecordsToSkipAfterOffset(long) - Method in class org.apache.flink.connector.file.src.FileSourceSplitState
setSplitAssigner(FileSplitAssigner.Provider) - Method in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder: Configures the FileSplitAssigner for the source.
SimpleSplitAssigner - Class in org.apache.flink.connector.file.src.assigners: The SimpleSplitAssigner hands out splits in a random order, without any consideration for order or locality.
SimpleSplitAssigner(Collection<FileSourceSplit>) - Constructor for class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner
SimpleStreamFormat<T> - Class in org.apache.flink.connector.file.src.reader: A simple version of the StreamFormat, for formats that are not splittable.
SimpleStreamFormat() - Constructor for class org.apache.flink.connector.file.src.reader.SimpleStreamFormat
SingletonResultIterator<E> - Class in org.apache.flink.connector.file.src.util: A simple BulkFormat.RecordIterator that returns a single value.
SingletonResultIterator() - Constructor for class org.apache.flink.connector.file.src.util.SingletonResultIterator
SingletonResultIterator(Runnable) - Constructor for class org.apache.flink.connector.file.src.util.SingletonResultIterator
snapshotState() - Method in class org.apache.flink.connector.file.sink.writer.FileWriter
snapshotState() - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator
snapshotState() - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator
splitAssigner - Variable in class org.apache.flink.connector.file.src.AbstractFileSource.AbstractFileSourceBuilder
splitId() - Method in class org.apache.flink.connector.file.src.FileSourceSplit
StandardDeCompressors - Class in org.apache.flink.connector.file.src.compression: A collection of common compression formats and de-compressors.
start() - Method in class org.apache.flink.connector.file.src.impl.ContinuousFileSplitEnumerator
start() - Method in class org.apache.flink.connector.file.src.impl.FileSourceReader
start() - Method in class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator
StaticFileSplitEnumerator - Class in org.apache.flink.connector.file.src.impl: A SplitEnumerator implementation for bounded / batch FileSource input.
StaticFileSplitEnumerator(SplitEnumeratorContext<FileSourceSplit>, FileSplitAssigner) - Constructor for class org.apache.flink.connector.file.src.impl.StaticFileSplitEnumerator
StreamFormat<T> - Interface in org.apache.flink.connector.file.src.reader: A reader format that reads individual records from a stream.
StreamFormat.Reader<T> - Interface in org.apache.flink.connector.file.src.reader: The actual reader that reads the records.
StreamFormatAdapter<T> - Class in org.apache.flink.connector.file.src.impl: Adapter to turn a StreamFormat into a BulkFormat.
StreamFormatAdapter(StreamFormat<T>) - Constructor for class org.apache.flink.connector.file.src.impl.StreamFormatAdapter
StreamFormatAdapter.Reader<T> - Class in org.apache.flink.connector.file.src.impl: The reader adapter, from StreamFormat.Reader to BulkFormat.Reader.

T

test(Path) - Method in class org.apache.flink.connector.file.src.enumerate.DefaultFileFilter
TextLineFormat - Class in org.apache.flink.connector.file.src.reader: A reader format that text lines from a file.
TextLineFormat() - Constructor for class org.apache.flink.connector.file.src.reader.TextLineFormat
TextLineFormat(String) - Constructor for class org.apache.flink.connector.file.src.reader.TextLineFormat
TextLineFormat.Reader - Class in org.apache.flink.connector.file.src.reader: The actual reader for the TextLineFormat.
toFileSourceSplit() - Method in class org.apache.flink.connector.file.src.FileSourceSplitState: Use the current row count as the starting row count to create a new FileSourceSplit.
toSplitType(String, FileSourceSplitState<SplitT>) - Method in class org.apache.flink.connector.file.src.impl.FileSourceReader
toString() - Method in class org.apache.flink.connector.file.sink.writer.FileWriterBucketState
toString() - Method in class org.apache.flink.connector.file.src.assigners.SimpleSplitAssigner
toString() - Method in class org.apache.flink.connector.file.src.ContinuousEnumerationSettings
toString() - Method in class org.apache.flink.connector.file.src.FileSourceSplit
toString() - Method in class org.apache.flink.connector.file.src.PendingSplitsCheckpoint
toString() - Method in class org.apache.flink.connector.file.src.util.CheckpointedPosition
toString() - Method in class org.apache.flink.connector.file.src.util.RecordAndPosition
tryPollEntry() - Method in class org.apache.flink.connector.file.src.util.Pool: Tries to get the next cached entry.

U

updateWithCheckpointedPosition(CheckpointedPosition) - Method in class org.apache.flink.connector.file.src.FileSourceSplit: Creates a copy of this split where the checkpointed position is replaced by the given new position.
Utils - Class in org.apache.flink.connector.file.src.util: Miscellaneous utilities for the file source.

W

withBucketAssigner(BucketAssigner<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder
withBucketAssigner(BucketAssigner<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder
withBucketCheckInterval(long) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder
withBucketCheckInterval(long) - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder
withNewBucketAssigner(BucketAssigner<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder
withOutputFileConfig(OutputFileConfig) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder
withOutputFileConfig(OutputFileConfig) - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder
withRollingPolicy(CheckpointRollingPolicy<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.BulkFormatBuilder
withRollingPolicy(RollingPolicy<IN, String>) - Method in class org.apache.flink.connector.file.sink.FileSink.RowFormatBuilder
write(IN, SinkWriter.Context) - Method in class org.apache.flink.connector.file.sink.writer.FileWriter

A B C D E F G H I L M N O P R S T U W