Package org.infinispan.stream.impl

Class DistributedIntCacheStream<Original>

java.lang.Object

org.infinispan.stream.impl.AbstractCacheStream<Original,Integer,IntStream,IntCacheStream>

org.infinispan.stream.impl.DistributedIntCacheStream<Original>

Type Parameters:

Original - original stream type

All Implemented Interfaces:

AutoCloseable, BaseStream<Integer,IntStream>, IntStream, BaseCacheStream<Integer,IntStream>, IntCacheStream

public class DistributedIntCacheStream<Original>
extends AbstractCacheStream<Original,Integer,IntStream,IntCacheStream>
implements IntCacheStream

Implementation of IntStream that utilizes a lazily evaluated distributed back end execution. Note this class is only able to be created using CacheStream.mapToInt(ToIntFunction) or similar methods from the CacheStream interface.

Nested Class Summary

Nested classes/interfaces inherited from interface org.infinispan.BaseCacheStream

BaseCacheStream.SegmentCompletionListener

Nested classes/interfaces inherited from interface java.util.stream.IntStream

IntStream.Builder

Field Summary

Fields inherited from class org.infinispan.stream.impl.AbstractCacheStream

closeRunnable, cpm, distributedBatchSize, dm, executor, includeLoader, intermediateOperations, invocationContext, iteratorOperation, keyPartitioner, keysToFilter, localAddress, parallel, parallelDistribution, partition, registry, rehashAware, segmentCompletionListener, segmentsToFilter, stateTransferLock, supplier, timeout, timeoutUnit, toKeyFunction

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	DistributedIntCacheStream(AbstractCacheStream other)	This constructor is to be used only when a user calls a map or flat map method changing to an IntStream from a CacheStream, Stream, DoubleStream, LongStream etc.

Method Summary

Modifier and Type	Method	Description
boolean	allMatch(IntPredicate predicate)
boolean	anyMatch(IntPredicate predicate)
DoubleCacheStream	asDoubleStream()
LongCacheStream	asLongStream()
OptionalDouble	average()
CacheStream<Integer>	boxed()
protected <R> DistributedCacheStream<Original,R>	cacheStream()
<R> R	collect(Supplier<R> supplier, ObjIntConsumer<R> accumulator, BiConsumer<R,R> combiner)
long	count()
IntCacheStream	disableRehashAware()	Disables tracking of rehash events that could occur to the underlying cache.
IntCacheStream	distinct()
IntCacheStream	distributedBatchSize(int batchSize)	Controls how many keys are returned from a remote node when using a stream terminal operation with a distributed cache to back this stream.
protected DistributedDoubleCacheStream<Original>	doubleCacheStream()
IntCacheStream	filter(IntPredicate predicate)
IntCacheStream	filter(SerializableIntPredicate predicate)	Same as IntCacheStream.filter(IntPredicate) except that the IntPredicate must also implement Serializable
IntCacheStream	filterKeys(Set<?> keys)	Filters which entries are returned by only returning ones that map to the given key.
IntCacheStream	filterKeySegments(Set<Integer> segments)	Filters which entries are returned by what segment they are present in.
IntCacheStream	filterKeySegments(org.infinispan.commons.util.IntSet segments)	Filters which entries are returned by what segment they are present in.
OptionalInt	findAny()
OptionalInt	findFirst()
IntCacheStream	flatMap(IntFunction<? extends IntStream> mapper)
IntCacheStream	flatMap(SerializableIntFunction<? extends IntStream> mapper)	Same as IntCacheStream.flatMap(IntFunction) except that the IntFunction must also implement Serializable
void	forEach(IntConsumer action)
<K,V> void	forEach(ObjIntConsumer<Cache<K,V>> action)	Same as IntStream.forEach(IntConsumer) except that it takes an ObjIntConsumer that provides access to the underlying Cache that is backing this stream.
void	forEach(SerializableIntConsumer action)	Same as IntStream.forEach(IntConsumer) except that the IntConsumer must also implement Serializable
<K,V> void	forEach(SerializableObjIntConsumer<Cache<K,V>> action)	Same as IntCacheStream.forEach(ObjIntConsumer) except that the BiConsumer must also implement Serializable
void	forEachOrdered(IntConsumer action)
protected Log	getLog()
PrimitiveIterator.OfInt	iterator()
IntCacheStream	limit(long maxSize)
protected DistributedLongCacheStream<Original>	longCacheStream()
IntCacheStream	map(IntUnaryOperator mapper)
IntCacheStream	map(SerializableIntUnaryOperator mapper)	Same as IntCacheStream.map(IntUnaryOperator) except that the IntUnaryOperator must also implement Serializable
DoubleCacheStream	mapToDouble(IntToDoubleFunction mapper)
DoubleCacheStream	mapToDouble(SerializableIntToDoubleFunction mapper)	Same as IntCacheStream.mapToDouble(IntToDoubleFunction) except that the IntToIntFunction must also implement Serializable
LongCacheStream	mapToLong(IntToLongFunction mapper)
LongCacheStream	mapToLong(SerializableIntToLongFunction mapper)	Same as IntCacheStream.mapToLong(IntToLongFunction) except that the IntToLongFunction must also implement Serializable
<U> CacheStream<U>	mapToObj(IntFunction<? extends U> mapper)
<U> CacheStream<U>	mapToObj(SerializableIntFunction<? extends U> mapper)	Same as IntCacheStream.mapToObj(IntFunction) except that the IntFunction must also implement Serializable
OptionalInt	max()
OptionalInt	min()
boolean	noneMatch(IntPredicate predicate)
IntCacheStream	parallelDistribution()	This would enable sending requests to all other remote nodes when a terminal operator is performed.
IntCacheStream	peek(IntConsumer action)
IntCacheStream	peek(SerializableIntConsumer action)	Same as IntCacheStream.flatMap(IntFunction) except that the IntFunction must also implement Serializable
int	reduce(int identity, IntBinaryOperator op)
OptionalInt	reduce(IntBinaryOperator op)
IntCacheStream	segmentCompletionListener(BaseCacheStream.SegmentCompletionListener listener)	Allows registration of a segment completion listener that is notified when a segment has completed processing.
IntCacheStream	sequentialDistribution()	This would disable sending requests to all other remote nodes compared to one at a time.
IntCacheStream	skip(long n)
IntCacheStream	sorted()
Spliterator.OfInt	spliterator()
int	sum()
IntSummaryStatistics	summaryStatistics()
IntCacheStream	timeout(long timeout, TimeUnit unit)	Sets a given time to wait for a remote operation to respond by.
int[]	toArray()
protected DistributedIntCacheStream	unwrap()

Methods inherited from class org.infinispan.stream.impl.AbstractCacheStream

addIntermediateOperation, addIntermediateOperation, addIntermediateOperationMap, close, composeWithExceptions, isParallel, isPrimaryOwner, onClose, parallel, sequential, unordered

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface java.util.stream.BaseStream

close, isParallel

Methods inherited from interface org.infinispan.IntCacheStream

allMatch, anyMatch, collect, noneMatch, onClose, parallel, reduce, reduce, sequential, unordered

Methods inherited from interface java.util.stream.IntStream

dropWhile, takeWhile

Constructor Detail

DistributedIntCacheStream

protected DistributedIntCacheStream(AbstractCacheStream other)

This constructor is to be used only when a user calls a map or flat map method changing to an IntStream from a CacheStream, Stream, DoubleStream, LongStream etc.

Parameters:

other - other instance of AbstractCacheStream to copy details from

Method Detail

getLog

protected Log getLog()

Specified by:

getLog in class AbstractCacheStream<Original,Integer,IntStream,IntCacheStream>

unwrap

protected DistributedIntCacheStream unwrap()

Specified by:

unwrap in class AbstractCacheStream<Original,Integer,IntStream,IntCacheStream>

filter

public IntCacheStream filter(IntPredicate predicate)

Description copied from interface: IntCacheStream

Specified by:

filter in interface IntCacheStream

Specified by:

filter in interface IntStream

Returns:

the new cache int stream

filter

public IntCacheStream filter(SerializableIntPredicate predicate)

Description copied from interface: IntCacheStream

Same as IntCacheStream.filter(IntPredicate) except that the IntPredicate must also implement Serializable

The compiler will pick this overload for lambda parameters, making them Serializable

Specified by:

filter in interface IntCacheStream

Parameters:

predicate - a non-interfering, stateless predicate to apply to each element to determine if it should be included

Returns:

the new cache int stream

map

public IntCacheStream map(IntUnaryOperator mapper)

Description copied from interface: IntCacheStream

Specified by:

map in interface IntCacheStream

Specified by:

map in interface IntStream

Returns:

the new cache int stream

map

public IntCacheStream map(SerializableIntUnaryOperator mapper)

Description copied from interface: IntCacheStream

Same as IntCacheStream.map(IntUnaryOperator) except that the IntUnaryOperator must also implement Serializable

The compiler will pick this overload for lambda parameters, making them Serializable

Specified by:

map in interface IntCacheStream

Parameters:

mapper - a non-interfering, stateless function to apply to each element

Returns:

the new cache int stream

mapToObj

public <U> CacheStream<U> mapToObj(IntFunction<? extends U> mapper)

Description copied from interface: IntCacheStream

Specified by:

mapToObj in interface IntCacheStream

Specified by:

mapToObj in interface IntStream

Returns:

the new cache stream

mapToObj

public <U> CacheStream<U> mapToObj(SerializableIntFunction<? extends U> mapper)

Description copied from interface: IntCacheStream

Same as IntCacheStream.mapToObj(IntFunction) except that the IntFunction must also implement Serializable

The compiler will pick this overload for lambda parameters, making them Serializable

Specified by:

mapToObj in interface IntCacheStream

Type Parameters:

U - the element type of the new stream

Parameters:

mapper - a non-interfering, stateless function to apply to each element

Returns:

the new cache stream

mapToLong

public LongCacheStream mapToLong(IntToLongFunction mapper)

Description copied from interface: IntCacheStream

Specified by:

mapToLong in interface IntCacheStream

Specified by:

mapToLong in interface IntStream

Returns:

the new cache long stream

mapToLong

public LongCacheStream mapToLong(SerializableIntToLongFunction mapper)

Description copied from interface: IntCacheStream

Same as IntCacheStream.mapToLong(IntToLongFunction) except that the IntToLongFunction must also implement Serializable

The compiler will pick this overload for lambda parameters, making them Serializable

Specified by:

mapToLong in interface IntCacheStream

Parameters:

mapper - a non-interfering, stateless function to apply to each element

Returns:

the new cache long stream

mapToDouble

public DoubleCacheStream mapToDouble(IntToDoubleFunction mapper)

Description copied from interface: IntCacheStream

Specified by:

mapToDouble in interface IntCacheStream

Specified by:

mapToDouble in interface IntStream

Returns:

the new cache double stream

mapToDouble

public DoubleCacheStream mapToDouble(SerializableIntToDoubleFunction mapper)

Description copied from interface: IntCacheStream

Same as IntCacheStream.mapToDouble(IntToDoubleFunction) except that the IntToIntFunction must also implement Serializable

The compiler will pick this overload for lambda parameters, making them Serializable

Specified by:

mapToDouble in interface IntCacheStream

Parameters:

mapper - a non-interfering, stateless function to apply to each element

Returns:

the new cache double stream

flatMap

public IntCacheStream flatMap(IntFunction<? extends IntStream> mapper)

Description copied from interface: IntCacheStream

Specified by:

flatMap in interface IntCacheStream

Specified by:

flatMap in interface IntStream

Returns:

the new cache int stream

flatMap

public IntCacheStream flatMap(SerializableIntFunction<? extends IntStream> mapper)

Description copied from interface: IntCacheStream

Same as IntCacheStream.flatMap(IntFunction) except that the IntFunction must also implement Serializable

The compiler will pick this overload for lambda parameters, making them Serializable

Specified by:

flatMap in interface IntCacheStream

Parameters:

mapper - a non-interfering, stateless function to apply to each element which produces a IntStream of new values

Returns:

the new cache int stream

distinct

public IntCacheStream distinct()

Description copied from interface: IntCacheStream

Specified by:

distinct in interface IntCacheStream

Specified by:

distinct in interface IntStream

Returns:

the new cache int stream

sorted

public IntCacheStream sorted()

Description copied from interface: IntCacheStream

Specified by:

sorted in interface IntCacheStream

Specified by:

sorted in interface IntStream

Returns:

the new cache int stream

peek

public IntCacheStream peek(IntConsumer action)

Description copied from interface: IntCacheStream

Specified by:

peek in interface IntCacheStream

Specified by:

peek in interface IntStream

Returns:

the new cache int stream

peek

public IntCacheStream peek(SerializableIntConsumer action)

Description copied from interface: IntCacheStream

Same as IntCacheStream.flatMap(IntFunction) except that the IntFunction must also implement Serializable

The compiler will pick this overload for lambda parameters, making them Serializable

Specified by:

peek in interface IntCacheStream

Parameters:

action - a non-interfering action to perform on the elements as they are consumed from the stream

Returns:

the new cache int stream

limit

public IntCacheStream limit(long maxSize)

Description copied from interface: IntCacheStream

Specified by:

limit in interface IntCacheStream

Specified by:

limit in interface IntStream

Returns:

the new cache int stream

skip

public IntCacheStream skip(long n)

Description copied from interface: IntCacheStream

Specified by:

skip in interface IntCacheStream

Specified by:

skip in interface IntStream

Returns:

the new cache int stream

asLongStream

public LongCacheStream asLongStream()

Description copied from interface: IntCacheStream

Specified by:

asLongStream in interface IntCacheStream

Specified by:

asLongStream in interface IntStream

Returns:

the cache long stream

asDoubleStream

public DoubleCacheStream asDoubleStream()

Description copied from interface: IntCacheStream

Specified by:

asDoubleStream in interface IntCacheStream

Specified by:

asDoubleStream in interface IntStream

Returns:

the cache double stream

boxed

public CacheStream<Integer> boxed()

Description copied from interface: IntCacheStream

Specified by:

boxed in interface IntCacheStream

Specified by:

boxed in interface IntStream

Returns:

the new cache stream containing integers

forEach

public void forEach(IntConsumer action)

Specified by:

forEach in interface IntStream

forEach

public void forEach(SerializableIntConsumer action)

Description copied from interface: IntCacheStream

Same as IntStream.forEach(IntConsumer) except that the IntConsumer must also implement Serializable

The compiler will pick this overload for lambda parameters, making them Serializable

Specified by:

forEach in interface IntCacheStream

Parameters:

action - a non-interfering action to perform on the elements

forEach

public <K,V> void forEach(ObjIntConsumer<Cache<K,V>> action)

Description copied from interface: IntCacheStream

Same as IntStream.forEach(IntConsumer) except that it takes an ObjIntConsumer that provides access to the underlying Cache that is backing this stream.

Note that the CacheAware interface is not supported for injection using this method as the cache is provided in the consumer directly.

Specified by:

forEach in interface IntCacheStream

Type Parameters:

K - key type of the cache

V - value type of the cache

Parameters:

action - consumer to be ran for each element in the stream

forEach

public <K,V> void forEach(SerializableObjIntConsumer<Cache<K,V>> action)

Description copied from interface: IntCacheStream

Same as IntCacheStream.forEach(ObjIntConsumer) except that the BiConsumer must also implement Serializable

Specified by:

forEach in interface IntCacheStream

Type Parameters:

K - key type of the cache

V - value type of the cache

Parameters:

action - consumer to be ran for each element in the stream

forEachOrdered

public void forEachOrdered(IntConsumer action)

Specified by:

forEachOrdered in interface IntStream

toArray

public int[] toArray()

Specified by:

toArray in interface IntStream

reduce

public int reduce(int identity,
                  IntBinaryOperator op)

Specified by:

reduce in interface IntStream

reduce

public OptionalInt reduce(IntBinaryOperator op)

Specified by:

reduce in interface IntStream

collect

public <R> R collect(Supplier<R> supplier,
                     ObjIntConsumer<R> accumulator,
                     BiConsumer<R,R> combiner)

Specified by:

collect in interface IntStream

sum

public int sum()

Specified by:

sum in interface IntStream

min

public OptionalInt min()

Specified by:

min in interface IntStream

max

public OptionalInt max()

Specified by:

max in interface IntStream

average

public OptionalDouble average()

Specified by:

average in interface IntStream

summaryStatistics

public IntSummaryStatistics summaryStatistics()

Specified by:

summaryStatistics in interface IntStream

anyMatch

public boolean anyMatch(IntPredicate predicate)

Specified by:

anyMatch in interface IntStream

allMatch

public boolean allMatch(IntPredicate predicate)

Specified by:

allMatch in interface IntStream

noneMatch

public boolean noneMatch(IntPredicate predicate)

Specified by:

noneMatch in interface IntStream

findFirst

public OptionalInt findFirst()

Specified by:

findFirst in interface IntStream

findAny

public OptionalInt findAny()

Specified by:

findAny in interface IntStream

iterator

public PrimitiveIterator.OfInt iterator()

Specified by:

iterator in interface BaseStream<Integer,IntStream>

Specified by:

iterator in interface IntStream

spliterator

public Spliterator.OfInt spliterator()

Specified by:

spliterator in interface BaseStream<Integer,IntStream>

Specified by:

spliterator in interface IntStream

count

public long count()

Specified by:

count in interface IntStream

sequentialDistribution

public IntCacheStream sequentialDistribution()

Description copied from interface: IntCacheStream

This would disable sending requests to all other remote nodes compared to one at a time. This can reduce memory pressure on the originator node at the cost of performance.

Parallel distribution is enabled by default except for CacheStream.iterator() and CacheStream.spliterator()

Specified by:

sequentialDistribution in interface BaseCacheStream<Integer,IntStream>

Specified by:

sequentialDistribution in interface IntCacheStream

Returns:

a stream with parallel distribution disabled.

parallelDistribution

public IntCacheStream parallelDistribution()

Description copied from interface: BaseCacheStream

This would enable sending requests to all other remote nodes when a terminal operator is performed. This requires additional overhead as it must process results concurrently from various nodes, but should perform faster in the majority of cases.

Parallel distribution is enabled by default except for CacheStream.iterator() and CacheStream.spliterator()

Specified by:

parallelDistribution in interface BaseCacheStream<Integer,IntStream>

Specified by:

parallelDistribution in interface IntCacheStream

Returns:

a stream with parallel distribution enabled.

filterKeySegments

public IntCacheStream filterKeySegments(Set<Integer> segments)

Description copied from interface: IntCacheStream

Filters which entries are returned by what segment they are present in. This method can be substantially more efficient than using a regular CacheStream.filter(Predicate) method as this can control what nodes are asked for data and what entries are read from the underlying CacheStore if present.

Specified by:

filterKeySegments in interface BaseCacheStream<Integer,IntStream>

Specified by:

filterKeySegments in interface IntCacheStream

Parameters:

segments - The segments to use for this stream operation. Any segments not in this set will be ignored.

Returns:

a stream with the segments filtered.

filterKeySegments

public IntCacheStream filterKeySegments(org.infinispan.commons.util.IntSet segments)

Description copied from interface: BaseCacheStream

Filters which entries are returned by what segment they are present in. This method can be substantially more efficient than using a regular CacheStream.filter(Predicate) method as this can control what nodes are asked for data and what entries are read from the underlying CacheStore if present.

Specified by:

filterKeySegments in interface BaseCacheStream<Integer,IntStream>

Parameters:

segments - The segments to use for this stream operation. Any segments not in this set will be ignored.

Returns:

a stream with the segments filtered.

filterKeys

public IntCacheStream filterKeys(Set<?> keys)

Description copied from interface: IntCacheStream

Filters which entries are returned by only returning ones that map to the given key. This method will be faster than a regular CacheStream.filter(Predicate) if the filter is holding references to the same keys.

Specified by:

filterKeys in interface BaseCacheStream<Integer,IntStream>

Specified by:

filterKeys in interface IntCacheStream

Parameters:

keys - The keys that this stream will only operate on.

Returns:

a stream with the keys filtered.

distributedBatchSize

public IntCacheStream distributedBatchSize(int batchSize)

Description copied from interface: IntCacheStream

Controls how many keys are returned from a remote node when using a stream terminal operation with a distributed cache to back this stream. This value is ignored when terminal operators that don't track keys are used. Key tracking terminal operators are CacheStream.iterator(), CacheStream.spliterator(), CacheStream.forEach(Consumer). Please see those methods for additional information on how this value may affect them.

This value may be used in the case of a a terminal operator that doesn't track keys if an intermediate operation is performed that requires bringing keys locally to do computations. Examples of such intermediate operations are CacheStream.sorted(), CacheStream.sorted(Comparator), CacheStream.distinct(), CacheStream.limit(long), CacheStream.skip(long)

This value is always ignored when this stream is backed by a cache that is not distributed as all values are already local.

Specified by:

distributedBatchSize in interface BaseCacheStream<Integer,IntStream>

Specified by:

distributedBatchSize in interface IntCacheStream

Parameters:

batchSize - The size of each batch. This defaults to the state transfer chunk size.

Returns:

a stream with the batch size updated

segmentCompletionListener

public IntCacheStream segmentCompletionListener(BaseCacheStream.SegmentCompletionListener listener)

Description copied from interface: IntCacheStream

Allows registration of a segment completion listener that is notified when a segment has completed processing. If the terminal operator has a short circuit this listener may never be called.

This method is designed for the sole purpose of use with the CacheStream.iterator() to allow for a user to track completion of segments as they are returned from the iterator. Behavior of other methods is not specified. Please see CacheStream.iterator() for more information.

Multiple listeners may be registered upon multiple invocations of this method. The ordering of notified listeners is not specified.

This is only used if this stream did not invoke BaseCacheStream.disableRehashAware() and has no flat map based operations. If this is done no segments will be notified.

Specified by:

segmentCompletionListener in interface BaseCacheStream<Integer,IntStream>

Specified by:

segmentCompletionListener in interface IntCacheStream

Parameters:

listener - The listener that will be called back as segments are completed.

Returns:

a stream with the listener registered.

disableRehashAware

public IntCacheStream disableRehashAware()

Description copied from interface: IntCacheStream

Disables tracking of rehash events that could occur to the underlying cache. If a rehash event occurs while a terminal operation is being performed it is possible for some values that are in the cache to not be found. Note that you will never have an entry duplicated when rehash awareness is disabled, only lost values.

Most terminal operations will run faster with rehash awareness disabled even without a rehash occuring. However if a rehash occurs with this disabled be prepared to possibly receive only a subset of values.

Specified by:

disableRehashAware in interface BaseCacheStream<Integer,IntStream>

Specified by:

disableRehashAware in interface IntCacheStream

Returns:

a stream with rehash awareness disabled.

timeout

public IntCacheStream timeout(long timeout,
                              TimeUnit unit)

Description copied from interface: IntCacheStream

Sets a given time to wait for a remote operation to respond by. This timeout does nothing if the terminal operation does not go remote.

If a timeout does occur then a TimeoutException is thrown from the terminal operation invoking thread or on the next call to the Iterator or Spliterator.

Note that if a rehash occurs this timeout value is reset for the subsequent retry if rehash aware is enabled.

Specified by:

timeout in interface BaseCacheStream<Integer,IntStream>

Specified by:

timeout in interface IntCacheStream

Parameters:

timeout - the maximum time to wait

unit - the time unit of the timeout argument

Returns:

a stream with the timeout set

cacheStream

protected <R> DistributedCacheStream<Original,R> cacheStream()

doubleCacheStream

protected DistributedDoubleCacheStream<Original> doubleCacheStream()

longCacheStream

protected DistributedLongCacheStream<Original> longCacheStream()