org.apache.flink.runtime.operators.resettable

Class SpillingResettableIterator<T>

java.lang.Object

org.apache.flink.runtime.operators.resettable.SpillingResettableIterator<T>

Type Parameters:

T - The type of record that the iterator handles.

All Implemented Interfaces:

Iterator<T>, ResettableIterator<T>

public class SpillingResettableIterator<T>
extends Object
implements ResettableIterator<T>

Implementation of a resettable iterator. While iterating the first time over the data, the iterator writes the records to a spillable buffer. Any subsequent iteration re-reads the data from that buffer.

Field Summary

Fields

Modifier and Type	Field and Description
protected SpillingBuffer	buffer
protected Iterator<T>	input
protected org.apache.flink.core.memory.DataInputView	inView
protected MemoryManager	memoryManager
protected org.apache.flink.api.common.typeutils.TypeSerializer<T>	serializer

Constructor Summary

Constructors

Constructor and Description
SpillingResettableIterator(Iterator<T> input, org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, int numPages, AbstractInvokable parentTask)
SpillingResettableIterator(Iterator<T> input, org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer, MemoryManager memoryManager, IOManager ioManager, List<org.apache.flink.core.memory.MemorySegment> memory)

Method Summary

Modifier and Type	Method and Description
List<org.apache.flink.core.memory.MemorySegment>	close()
boolean	hasNext()
T	next()
void	open()
void	remove()
void	reset() Resets the iterator.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.Iterator

forEachRemaining

Field Detail

inView

protected org.apache.flink.core.memory.DataInputView inView

serializer

protected final org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer

buffer

protected final SpillingBuffer buffer

input

protected final Iterator<T> input

memoryManager

protected final MemoryManager memoryManager

Constructor Detail

SpillingResettableIterator

public SpillingResettableIterator(Iterator<T> input,
                                  org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
                                  MemoryManager memoryManager,
                                  IOManager ioManager,
                                  int numPages,
                                  AbstractInvokable parentTask)
                           throws MemoryAllocationException

Throws:

MemoryAllocationException

SpillingResettableIterator

public SpillingResettableIterator(Iterator<T> input,
                                  org.apache.flink.api.common.typeutils.TypeSerializer<T> serializer,
                                  MemoryManager memoryManager,
                                  IOManager ioManager,
                                  List<org.apache.flink.core.memory.MemorySegment> memory)

Method Detail

open

public void open()

reset

public void reset()
           throws IOException

Description copied from interface: ResettableIterator

Resets the iterator.

Specified by:

reset in interface ResettableIterator<T>

Throws:

IOException

hasNext

public boolean hasNext()

Specified by:

hasNext in interface Iterator<T>

next

public T next()

Specified by:

next in interface Iterator<T>

remove

public void remove()

Specified by:

remove in interface Iterator<T>

close

public List<org.apache.flink.core.memory.MemorySegment> close()
                                                       throws IOException

Throws:

IOException