org.apache.flink.runtime.highavailability.zookeeper

Class AbstractZooKeeperHaServices

java.lang.Object

org.apache.flink.runtime.highavailability.AbstractHaServices

org.apache.flink.runtime.highavailability.zookeeper.AbstractZooKeeperHaServices

All Implemented Interfaces:

AutoCloseable, GloballyCleanableResource, ClientHighAvailabilityServices, HighAvailabilityServices

Direct Known Subclasses:

ZooKeeperHaServices, ZooKeeperMultipleComponentLeaderElectionHaServices

public abstract class AbstractZooKeeperHaServices
extends AbstractHaServices

Abstract ZooKeeper based HA services.

Field Summary

Fields inherited from class org.apache.flink.runtime.highavailability.AbstractHaServices

configuration, ioExecutor, logger

Fields inherited from interface org.apache.flink.runtime.highavailability.HighAvailabilityServices

DEFAULT_JOB_ID, DEFAULT_LEADER_ID

Constructor Summary

Constructors

Constructor and Description
AbstractZooKeeperHaServices(CuratorFrameworkWithUnhandledErrorListener curatorFrameworkWrapper, Executor executor, org.apache.flink.configuration.Configuration configuration, BlobStoreService blobStoreService)

Method Summary

Modifier and Type	Method and Description
CheckpointRecoveryFactory	createCheckpointRecoveryFactory() Create the checkpoint recovery factory for the job manager.
JobGraphStore	createJobGraphStore() Create the submitted job graph store for the job manager.
protected void	deleteZNode(String path)
protected org.apache.flink.shaded.curator5.org.apache.curator.framework.CuratorFramework	getCuratorFramework()
protected void	internalCleanup() Clean up the meta data in the distributed system(e.g.
protected void	internalCleanupJobData(org.apache.flink.api.common.JobID jobID) Clean up the meta data in the distributed system(e.g.
protected void	internalClose() Closes the components which is used for external operations(e.g.

Methods inherited from class org.apache.flink.runtime.highavailability.AbstractHaServices

close, closeAndCleanupAllData, createBlobStore, createLeaderElectionService, createLeaderRetrievalService, getCheckpointRecoveryFactory, getClusterRestEndpointLeaderElectionService, getClusterRestEndpointLeaderRetriever, getDispatcherLeaderElectionService, getDispatcherLeaderRetriever, getJobGraphStore, getJobManagerLeaderElectionService, getJobManagerLeaderRetriever, getJobManagerLeaderRetriever, getJobResultStore, getLeaderPathForDispatcher, getLeaderPathForJobManager, getLeaderPathForResourceManager, getLeaderPathForRestServer, getResourceManagerLeaderElectionService, getResourceManagerLeaderRetriever, globalCleanupAsync

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.flink.runtime.highavailability.HighAvailabilityServices

getWebMonitorLeaderElectionService, getWebMonitorLeaderRetriever

Constructor Detail

AbstractZooKeeperHaServices

public AbstractZooKeeperHaServices(CuratorFrameworkWithUnhandledErrorListener curatorFrameworkWrapper,
                                   Executor executor,
                                   org.apache.flink.configuration.Configuration configuration,
                                   BlobStoreService blobStoreService)
                            throws IOException

Throws:

IOException

Method Detail

getCuratorFramework

protected final org.apache.flink.shaded.curator5.org.apache.curator.framework.CuratorFramework getCuratorFramework()

createCheckpointRecoveryFactory

public CheckpointRecoveryFactory createCheckpointRecoveryFactory()
                                                          throws Exception

Description copied from class: AbstractHaServices

Create the checkpoint recovery factory for the job manager.

Specified by:

createCheckpointRecoveryFactory in class AbstractHaServices

Returns:

Checkpoint recovery factory

Throws:

Exception

createJobGraphStore

public JobGraphStore createJobGraphStore()
                                  throws Exception

Description copied from class: AbstractHaServices

Create the submitted job graph store for the job manager.

Specified by:

createJobGraphStore in class AbstractHaServices

Returns:

Submitted job graph store

Throws:

Exception - if the submitted job graph store could not be created

internalClose

protected void internalClose()
                      throws Exception

Description copied from class: AbstractHaServices

Closes the components which is used for external operations(e.g. Zookeeper Client, Kubernetes Client).

Specified by:

internalClose in class AbstractHaServices

Throws:

Exception - if the close operation failed

internalCleanup

protected void internalCleanup()
                        throws Exception

Description copied from class: AbstractHaServices

Clean up the meta data in the distributed system(e.g. Zookeeper, Kubernetes ConfigMap).

If an exception occurs during internal cleanup, we will continue the cleanup in AbstractHaServices.closeAndCleanupAllData() and report exceptions only after all cleanup steps have been attempted.

Specified by:

internalCleanup in class AbstractHaServices

Throws:

Exception - when do the cleanup operation on external storage.

internalCleanupJobData

protected void internalCleanupJobData(org.apache.flink.api.common.JobID jobID)
                               throws Exception

Description copied from class: AbstractHaServices

Clean up the meta data in the distributed system(e.g. Zookeeper, Kubernetes ConfigMap) for the specified Job. Method implementations need to be thread-safe.

Specified by:

internalCleanupJobData in class AbstractHaServices

Parameters:

jobID - The identifier of the job to cleanup.

Throws:

Exception - when do the cleanup operation on external storage.

deleteZNode

protected void deleteZNode(String path)
                    throws Exception

Throws:

Exception