Package io.trino.plugin.raptor.legacy.metadata

Class DatabaseShardManager

java.lang.Object

io.trino.plugin.raptor.legacy.metadata.DatabaseShardManager

All Implemented Interfaces:

ShardManager

public class DatabaseShardManager
extends Object
implements ShardManager

Constructor Summary

Constructors

Constructor	Description
DatabaseShardManager(org.jdbi.v3.core.Jdbi dbi, DaoSupplier<ShardDao> shardDaoSupplier, NodeSupplier nodeSupplier, AssignmentLimiter assignmentLimiter, com.google.common.base.Ticker ticker, io.airlift.units.Duration startupGracePeriod)
DatabaseShardManager(org.jdbi.v3.core.Jdbi dbi, DaoSupplier<ShardDao> shardDaoSupplier, NodeSupplier nodeSupplier, AssignmentLimiter assignmentLimiter, com.google.common.base.Ticker ticker, MetadataConfig config)

Method Summary

Modifier and Type	Method	Description
void	addColumn(long tableId, ColumnInfo column)	Add a column to the end of the table.
long	beginTransaction()	Begin a transaction for creating shards.
void	commitShards(long transactionId, long tableId, List<ColumnInfo> columns, Collection<ShardInfo> shards, Optional<String> externalBatchId, long updateTime)	Commit data for a table.
void	createBuckets(long distributionId, int bucketCount)	Create initial bucket assignments for a distribution.
void	createTable(long tableId, List<ColumnInfo> columns, boolean bucketed, OptionalLong temporalColumnId)	Create a table.
void	dropTable(long tableId)	Drop a table.
List<String>	getBucketAssignments(long distributionId)	Get map of buckets to node identifiers for a distribution.
List<BucketNode>	getBucketNodes(long distibutionId)	Get list of bucket nodes for a distribution.
List<Distribution>	getDistributions()	Get all active distributions.
long	getDistributionSizeInBytes(long distributionId)	Get total physical size of all tables in a distribution.
Set<UUID>	getExistingShardUuids(long tableId, Set<UUID> shardUuids)	Return the subset of shard uuids that exist
Map<String,Long>	getNodeBytes()	Get the number of bytes used by assigned shards per node.
Set<ShardMetadata>	getNodeShards(String nodeIdentifier)	Get shard metadata for shards on a given node.
Set<ShardMetadata>	getNodeShards(String nodeIdentifier, long tableId)	Get shard metadata for shards on a given node.
ShardMetadata	getShard(UUID shardUuid)	Get shard metadata for a shard.
org.jdbi.v3.core.result.ResultIterator<BucketShards>	getShardNodes(long tableId, TupleDomain<RaptorColumnHandle> effectivePredicate)	Return the shard nodes for a non-bucketed table.
org.jdbi.v3.core.result.ResultIterator<BucketShards>	getShardNodesBucketed(long tableId, boolean merged, List<String> bucketToNode, TupleDomain<RaptorColumnHandle> effectivePredicate)	Return the shard nodes for a bucketed table.
static String	maxColumn(long columnId)
static String	minColumn(long columnId)
void	replaceShardAssignment(long tableId, UUID shardUuid, String nodeIdentifier, boolean gracePeriod)	Remove all old shard assignments and assign a shard to a node
void	replaceShardUuids(long transactionId, long tableId, List<ColumnInfo> columns, Set<UUID> oldShardUuids, Collection<ShardInfo> newShards, OptionalLong updateTime)	Replace oldShardsUuids with newShards.
void	rollbackTransaction(long transactionId)	Rollback a transaction.
static String	shardIndexTable(long tableId)
void	updateBucketAssignment(long distributionId, int bucketNumber, String nodeId)	Change the node a bucket is assigned to.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DatabaseShardManager

@Inject
public DatabaseShardManager(org.jdbi.v3.core.Jdbi dbi,
 DaoSupplier<ShardDao> shardDaoSupplier,
 NodeSupplier nodeSupplier,
 AssignmentLimiter assignmentLimiter,
 com.google.common.base.Ticker ticker,
 MetadataConfig config)

DatabaseShardManager

public DatabaseShardManager(org.jdbi.v3.core.Jdbi dbi,
 DaoSupplier<ShardDao> shardDaoSupplier,
 NodeSupplier nodeSupplier,
 AssignmentLimiter assignmentLimiter,
 com.google.common.base.Ticker ticker,
 io.airlift.units.Duration startupGracePeriod)

Method Details

createTable

public void createTable(long tableId,
 List<ColumnInfo> columns,
 boolean bucketed,
 OptionalLong temporalColumnId)

Description copied from interface: ShardManager

Create a table.

Specified by:

createTable in interface ShardManager

dropTable

public void dropTable(long tableId)

Description copied from interface: ShardManager

Drop a table.

Specified by:

dropTable in interface ShardManager

addColumn

public void addColumn(long tableId,
 ColumnInfo column)

Description copied from interface: ShardManager

Add a column to the end of the table.

Specified by:

addColumn in interface ShardManager

commitShards

public void commitShards(long transactionId,
 long tableId,
 List<ColumnInfo> columns,
 Collection<ShardInfo> shards,
 Optional<String> externalBatchId,
 long updateTime)

Description copied from interface: ShardManager

Commit data for a table.

Specified by:

commitShards in interface ShardManager

replaceShardUuids

public void replaceShardUuids(long transactionId,
 long tableId,
 List<ColumnInfo> columns,
 Set<UUID> oldShardUuids,
 Collection<ShardInfo> newShards,
 OptionalLong updateTime)

Description copied from interface: ShardManager

Replace oldShardsUuids with newShards.

Specified by:

replaceShardUuids in interface ShardManager

getShard

public ShardMetadata getShard(UUID shardUuid)

Description copied from interface: ShardManager

Get shard metadata for a shard.

Specified by:

getShard in interface ShardManager

getNodeShards

public Set<ShardMetadata> getNodeShards(String nodeIdentifier)

Description copied from interface: ShardManager

Get shard metadata for shards on a given node.

Specified by:

getNodeShards in interface ShardManager

getNodeShards

public Set<ShardMetadata> getNodeShards(String nodeIdentifier,
 long tableId)

Description copied from interface: ShardManager

Get shard metadata for shards on a given node.

Specified by:

getNodeShards in interface ShardManager

getShardNodes

public org.jdbi.v3.core.result.ResultIterator<BucketShards> getShardNodes(long tableId,
 TupleDomain<RaptorColumnHandle> effectivePredicate)

Description copied from interface: ShardManager

Return the shard nodes for a non-bucketed table.

Specified by:

getShardNodes in interface ShardManager

getShardNodesBucketed

public org.jdbi.v3.core.result.ResultIterator<BucketShards> getShardNodesBucketed(long tableId,
 boolean merged,
 List<String> bucketToNode,
 TupleDomain<RaptorColumnHandle> effectivePredicate)

Description copied from interface: ShardManager

Return the shard nodes for a bucketed table.

Specified by:

getShardNodesBucketed in interface ShardManager

replaceShardAssignment

public void replaceShardAssignment(long tableId,
 UUID shardUuid,
 String nodeIdentifier,
 boolean gracePeriod)

Description copied from interface: ShardManager

Remove all old shard assignments and assign a shard to a node

Specified by:

replaceShardAssignment in interface ShardManager

getNodeBytes

public Map<String,Long> getNodeBytes()

Description copied from interface: ShardManager

Get the number of bytes used by assigned shards per node.

Specified by:

getNodeBytes in interface ShardManager

beginTransaction

public long beginTransaction()

Description copied from interface: ShardManager

Begin a transaction for creating shards.

Specified by:

beginTransaction in interface ShardManager

Returns:

transaction ID

rollbackTransaction

public void rollbackTransaction(long transactionId)

Description copied from interface: ShardManager

Rollback a transaction.

Specified by:

rollbackTransaction in interface ShardManager

createBuckets

public void createBuckets(long distributionId,
 int bucketCount)

Description copied from interface: ShardManager

Create initial bucket assignments for a distribution.

Specified by:

createBuckets in interface ShardManager

getBucketAssignments

public List<String> getBucketAssignments(long distributionId)

Description copied from interface: ShardManager

Get map of buckets to node identifiers for a distribution.

Specified by:

getBucketAssignments in interface ShardManager

updateBucketAssignment

public void updateBucketAssignment(long distributionId,
 int bucketNumber,
 String nodeId)

Description copied from interface: ShardManager

Change the node a bucket is assigned to.

Specified by:

updateBucketAssignment in interface ShardManager

getDistributions

public List<Distribution> getDistributions()

Description copied from interface: ShardManager

Get all active distributions.

Specified by:

getDistributions in interface ShardManager

getDistributionSizeInBytes

public long getDistributionSizeInBytes(long distributionId)

Description copied from interface: ShardManager

Get total physical size of all tables in a distribution.

Specified by:

getDistributionSizeInBytes in interface ShardManager

getBucketNodes

public List<BucketNode> getBucketNodes(long distibutionId)

Description copied from interface: ShardManager

Get list of bucket nodes for a distribution.

Specified by:

getBucketNodes in interface ShardManager

getExistingShardUuids

public Set<UUID> getExistingShardUuids(long tableId,
 Set<UUID> shardUuids)

Description copied from interface: ShardManager

Return the subset of shard uuids that exist

Specified by:

getExistingShardUuids in interface ShardManager

shardIndexTable

public static String shardIndexTable(long tableId)

minColumn

public static String minColumn(long columnId)

maxColumn

public static String maxColumn(long columnId)