| Modifier and Type | Class and Description |
|---|---|
class |
AbstractIterativeTask<S extends org.apache.flink.api.common.functions.Function,OT>
The abstract base class for all tasks able to participate in an iteration.
|
class |
IterationHeadTask<X,Y,S extends org.apache.flink.api.common.functions.Function,OT>
The head is responsible for coordinating an iteration and can run a
Driver inside. |
class |
IterationIntermediateTask<S extends org.apache.flink.api.common.functions.Function,OT>
An intermediate iteration task, which runs a
Driver
inside. |
class |
IterationSynchronizationSinkTask
The task responsible for synchronizing all iteration heads, implemented as an output task.
|
class |
IterationTailTask<S extends org.apache.flink.api.common.functions.Function,OT>
An iteration tail, which runs a driver inside.
|
| Modifier and Type | Class and Description |
|---|---|
class |
BatchTask<S extends org.apache.flink.api.common.functions.Function,OT>
The base class for all batch tasks.
|
class |
DataSinkTask<IT>
DataSinkTask which is executed by a task manager.
|
class |
DataSourceTask<OT>
DataSourceTask which is executed by a task manager.
|
| Modifier and Type | Method and Description |
|---|---|
AbstractInvokable |
TaskContext.getContainingTask() |
AbstractInvokable |
BatchTask.getContainingTask() |
| Modifier and Type | Method and Description |
|---|---|
static void |
BatchTask.closeChainedTasks(List<ChainedDriver<?,?>> tasks,
AbstractInvokable parent)
Closes all chained tasks, in the order as they are stored in the array.
|
static String |
BatchTask.constructLogString(String message,
String taskName,
AbstractInvokable parent)
Utility function that composes a string for logging purposes.
|
static <T> org.apache.flink.util.Collector<T> |
BatchTask.getOutputCollector(AbstractInvokable task,
TaskConfig config,
ClassLoader cl,
List<RecordWriter<?>> eventualOutputs,
int outputOffset,
int numOutputs)
Creates the
Collector for the given task, as described by the given configuration. |
static <T> org.apache.flink.util.Collector<T> |
BatchTask.initOutputs(AbstractInvokable containingTask,
org.apache.flink.util.UserCodeClassLoader cl,
TaskConfig config,
List<ChainedDriver<?,?>> chainedTasksTarget,
List<RecordWriter<?>> eventualOutputs,
org.apache.flink.api.common.ExecutionConfig executionConfig,
Map<String,org.apache.flink.api.common.accumulators.Accumulator<?,?>> accumulatorMap)
Creates a writer for each output.
|
static void |
BatchTask.logAndThrowException(Exception ex,
AbstractInvokable parent)
Prints an error message and throws the given exception.
|
static void |
BatchTask.openChainedTasks(List<ChainedDriver<?,?>> tasks,
AbstractInvokable parent)
Opens all chained tasks, in the order as they are stored in the array.
|
void |
NoOpChainedDriver.setup(AbstractInvokable parent) |
| Constructor and Description |
|---|
TempBarrier(AbstractInvokable owner,
org.apache.flink.util.MutableObjectIterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializerFactory<T> serializerFactory,
MemoryManager memManager,
IOManager ioManager,
int numPages,
List<org.apache.flink.core.memory.MemorySegment> preAllocated) |
| Modifier and Type | Method and Description |
|---|---|
abstract void |
ChainedDriver.setup(AbstractInvokable parent) |
void |
ChainedReduceCombineDriver.setup(AbstractInvokable parent) |
void |
ChainedAllReduceDriver.setup(AbstractInvokable parent) |
void |
ChainedTerminationCriterionDriver.setup(AbstractInvokable parent) |
void |
ChainedMapDriver.setup(AbstractInvokable parent) |
void |
SynchronousChainedCombineDriver.setup(AbstractInvokable parent) |
void |
ChainedFlatMapDriver.setup(AbstractInvokable parent) |
void |
ChainedDriver.setup(TaskConfig config,
String taskName,
org.apache.flink.util.Collector<OT> outputCollector,
AbstractInvokable parent,
org.apache.flink.util.UserCodeClassLoader userCodeClassLoader,
org.apache.flink.api.common.ExecutionConfig executionConfig,
Map<String,org.apache.flink.api.common.accumulators.Accumulator<?,?>> accumulatorMap) |
| Modifier and Type | Method and Description |
|---|---|
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
HashJoinIteratorBase.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBloomFilters) |
<BT,PT> MutableHashTable<BT,PT> |
NonReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildSecondReOpenableHashJoinIterator.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
<BT,PT> MutableHashTable<BT,PT> |
ReusingBuildFirstReOpenableHashJoinIterator.getHashJoin(org.apache.flink.api.common.typeutils.TypeSerializer<BT> buildSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<BT> buildSideComparator,
org.apache.flink.api.common.typeutils.TypeSerializer<PT> probeSideSerializer,
org.apache.flink.api.common.typeutils.TypeComparator<PT> probeSideComparator,
org.apache.flink.api.common.typeutils.TypePairComparator<PT,BT> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean useBitmapFilters) |
| Constructor and Description |
|---|
NonReusingBuildFirstHashJoinIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildFirstReOpenableHashJoinIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondHashJoinIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
NonReusingBuildSecondReOpenableHashJoinIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildFirstHashJoinIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildFirstReOpenableHashJoinIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V2,V1> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondHashJoinIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
ReusingBuildSecondReOpenableHashJoinIterator(org.apache.flink.util.MutableObjectIterator<V1> firstInput,
org.apache.flink.util.MutableObjectIterator<V2> secondInput,
org.apache.flink.api.common.typeutils.TypeSerializer<V1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<V1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<V2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<V2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<V1,V2> pairComparator,
MemoryManager memManager,
IOManager ioManager,
AbstractInvokable ownerTask,
double memoryFraction,
boolean probeSideOuterJoin,
boolean buildSideOuterJoin,
boolean useBitmapFilters) |
| Constructor and Description |
|---|
BlockResettableMutableObjectIterator(MemoryManager memoryManager,
org.apache.flink.util.MutableObjectIterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numMemoryPages,
AbstractInvokable ownerTask) |
NonReusingBlockResettableIterator(MemoryManager memoryManager,
Iterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numPages,
AbstractInvokable ownerTask) |
NonReusingBlockResettableIterator(MemoryManager memoryManager,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numPages,
AbstractInvokable ownerTask) |
ReusingBlockResettableIterator(MemoryManager memoryManager,
Iterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numPages,
AbstractInvokable ownerTask) |
ReusingBlockResettableIterator(MemoryManager memoryManager,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
int numPages,
AbstractInvokable ownerTask) |
SpillingResettableIterator(Iterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
MemoryManager memoryManager,
IOManager ioManager,
int numPages,
AbstractInvokable parentTask) |
SpillingResettableMutableObjectIterator(org.apache.flink.util.MutableObjectIterator<T> input,
org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
MemoryManager memoryManager,
IOManager ioManager,
int numPages,
AbstractInvokable parentTask) |
| Modifier and Type | Method and Description |
|---|---|
static <E> ExternalSorterBuilder<E> |
ExternalSorter.newBuilder(MemoryManager memoryManager,
AbstractInvokable parentTask,
org.apache.flink.api.common.typeutils.TypeSerializer<E> serializer,
org.apache.flink.api.common.typeutils.TypeComparator<E> comparator)
Creates a builder for the
ExternalSorter. |
| Constructor and Description |
|---|
AbstractMergeInnerJoinIterator(org.apache.flink.util.MutableObjectIterator<T1> input1,
org.apache.flink.util.MutableObjectIterator<T2> input2,
org.apache.flink.api.common.typeutils.TypeSerializer<T1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<T1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<T2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<T2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<T1,T2> pairComparator,
MemoryManager memoryManager,
IOManager ioManager,
int numMemoryPages,
AbstractInvokable parentTask) |
AbstractMergeIterator(org.apache.flink.util.MutableObjectIterator<T1> input1,
org.apache.flink.util.MutableObjectIterator<T2> input2,
org.apache.flink.api.common.typeutils.TypeSerializer<T1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<T1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<T2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<T2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<T1,T2> pairComparator,
MemoryManager memoryManager,
IOManager ioManager,
int numMemoryPages,
AbstractInvokable parentTask) |
AbstractMergeOuterJoinIterator(org.apache.flink.api.common.operators.base.OuterJoinOperatorBase.OuterJoinType outerJoinType,
org.apache.flink.util.MutableObjectIterator<T1> input1,
org.apache.flink.util.MutableObjectIterator<T2> input2,
org.apache.flink.api.common.typeutils.TypeSerializer<T1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<T1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<T2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<T2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<T1,T2> pairComparator,
MemoryManager memoryManager,
IOManager ioManager,
int numMemoryPages,
AbstractInvokable parentTask) |
NonReusingMergeInnerJoinIterator(org.apache.flink.util.MutableObjectIterator<T1> input1,
org.apache.flink.util.MutableObjectIterator<T2> input2,
org.apache.flink.api.common.typeutils.TypeSerializer<T1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<T1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<T2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<T2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<T1,T2> pairComparator,
MemoryManager memoryManager,
IOManager ioManager,
int numMemoryPages,
AbstractInvokable parentTask) |
NonReusingMergeOuterJoinIterator(org.apache.flink.api.common.operators.base.OuterJoinOperatorBase.OuterJoinType outerJoinType,
org.apache.flink.util.MutableObjectIterator<T1> input1,
org.apache.flink.util.MutableObjectIterator<T2> input2,
org.apache.flink.api.common.typeutils.TypeSerializer<T1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<T1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<T2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<T2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<T1,T2> pairComparator,
MemoryManager memoryManager,
IOManager ioManager,
int numMemoryPages,
AbstractInvokable parentTask) |
ReusingMergeInnerJoinIterator(org.apache.flink.util.MutableObjectIterator<T1> input1,
org.apache.flink.util.MutableObjectIterator<T2> input2,
org.apache.flink.api.common.typeutils.TypeSerializer<T1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<T1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<T2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<T2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<T1,T2> pairComparator,
MemoryManager memoryManager,
IOManager ioManager,
int numMemoryPages,
AbstractInvokable parentTask) |
ReusingMergeOuterJoinIterator(org.apache.flink.api.common.operators.base.OuterJoinOperatorBase.OuterJoinType outerJoinType,
org.apache.flink.util.MutableObjectIterator<T1> input1,
org.apache.flink.util.MutableObjectIterator<T2> input2,
org.apache.flink.api.common.typeutils.TypeSerializer<T1> serializer1,
org.apache.flink.api.common.typeutils.TypeComparator<T1> comparator1,
org.apache.flink.api.common.typeutils.TypeSerializer<T2> serializer2,
org.apache.flink.api.common.typeutils.TypeComparator<T2> comparator2,
org.apache.flink.api.common.typeutils.TypePairComparator<T1,T2> pairComparator,
MemoryManager memoryManager,
IOManager ioManager,
int numMemoryPages,
AbstractInvokable parentTask) |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.