| Interface | Description |
|---|---|
| JobShuffleContext |
Job level shuffle context which can offer some job information like job ID and through it, the
shuffle plugin notify the job to stop tracking the lost result partitions.
|
| NettyShuffleDescriptor.PartitionConnectionInfo |
Information for connection to partition producer for shuffle exchange.
|
| ShuffleDescriptor |
Interface for shuffle deployment descriptor of result partition resource.
|
| ShuffleEnvironment<P extends ResultPartitionWriter,G extends IndexedInputGate> |
Interface for the implementation of shuffle service local environment.
|
| ShuffleMaster<T extends ShuffleDescriptor> |
Intermediate result partition registry to use in
JobMaster. |
| ShuffleMasterContext |
Shuffle context used to create
ShuffleMaster. |
| ShuffleServiceFactory<SD extends ShuffleDescriptor,P extends ResultPartitionWriter,G extends IndexedInputGate> |
Interface for shuffle service factory implementations.
|
| Class | Description |
|---|---|
| JobShuffleContextImpl |
The default implementation of
JobShuffleContext. |
| NettyShuffleDescriptor |
Default implementation of
ShuffleDescriptor for NettyShuffleMaster. |
| NettyShuffleDescriptor.NetworkPartitionConnectionInfo |
Remote partition connection information with index to query partition.
|
| NettyShuffleMaster |
Default
ShuffleMaster for netty and local file based shuffle implementation. |
| NettyShuffleUtils |
Utils to calculate network memory requirement of a vertex from network configuration and details
of input and output.
|
| PartitionDescriptor |
Partition descriptor for
ShuffleMaster to obtain ShuffleDescriptor. |
| ProducerDescriptor |
Partition producer descriptor for
ShuffleMaster to obtain ShuffleDescriptor. |
| ShuffleEnvironmentContext |
Local context used to create
ShuffleEnvironment. |
| ShuffleIOOwnerContext |
Context of shuffle input/output owner used to create partitions or gates belonging to the owner.
|
| ShuffleMasterContextImpl |
The default implementation of
ShuffleMasterContext. |
| ShuffleServiceOptions |
Options to configure shuffle service.
|
| ShuffleUtils |
Common utility methods for shuffle service.
|
| TaskInputsOutputsDescriptor |
Describes inputs and outputs information of a task.
|
| UnknownShuffleDescriptor |
Unknown
ShuffleDescriptor for which the producer has not been deployed yet. |
| Enum | Description |
|---|---|
| NettyShuffleDescriptor.LocalExecutionPartitionConnectionInfo |
Local partition connection information.
|
| ShuffleServiceLoader |
Utility to load the pluggable
ShuffleServiceFactory implementations. |
Copyright © 2014–2023 The Apache Software Foundation. All rights reserved.