Package org.apache.pinot.server.starter.helix

Class OffsetBasedConsumptionStatusChecker

java.lang.Object

org.apache.pinot.server.starter.helix.IngestionBasedConsumptionStatusChecker

org.apache.pinot.server.starter.helix.OffsetBasedConsumptionStatusChecker

public class OffsetBasedConsumptionStatusChecker
extends IngestionBasedConsumptionStatusChecker

This class is used at startup time to have a more accurate estimate of the catchup period in which no query execution happens and consumers try to catch up to the latest messages available in streams. To achieve this, every time status check is called - IngestionBasedConsumptionStatusChecker.getNumConsumingSegmentsNotReachedIngestionCriteria() - for each consuming segment, we check if segment's latest ingested offset has reached the latest stream offset that's fetched once at startup time.

Field Summary

Fields inherited from class org.apache.pinot.server.starter.helix.IngestionBasedConsumptionStatusChecker

_consumingSegments, _instanceDataManager, _logger

Constructor Summary

Constructors

Constructor	Description
OffsetBasedConsumptionStatusChecker(InstanceDataManager instanceDataManager, Set<String> consumingSegments)

Method Summary

Modifier and Type	Method	Description
protected boolean	isSegmentCaughtUp(String segmentName, LLRealtimeSegmentDataManager rtSegmentDataManager)

Methods inherited from class org.apache.pinot.server.starter.helix.IngestionBasedConsumptionStatusChecker

getNumConsumingSegmentsNotReachedIngestionCriteria

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

OffsetBasedConsumptionStatusChecker

public OffsetBasedConsumptionStatusChecker(InstanceDataManager instanceDataManager,
                                           Set<String> consumingSegments)

Method Detail

isSegmentCaughtUp

protected boolean isSegmentCaughtUp(String segmentName,
                                    LLRealtimeSegmentDataManager rtSegmentDataManager)

Specified by:

isSegmentCaughtUp in class IngestionBasedConsumptionStatusChecker