Class OffsetBasedConsumptionStatusChecker
- java.lang.Object
-
- org.apache.pinot.server.starter.helix.IngestionBasedConsumptionStatusChecker
-
- org.apache.pinot.server.starter.helix.OffsetBasedConsumptionStatusChecker
-
public class OffsetBasedConsumptionStatusChecker extends IngestionBasedConsumptionStatusChecker
This class is used at startup time to have a more accurate estimate of the catchup period in which no query execution happens and consumers try to catch up to the latest messages available in streams. To achieve this, every time status check is called -IngestionBasedConsumptionStatusChecker.getNumConsumingSegmentsNotReachedIngestionCriteria()- for each consuming segment, we check if segment's latest ingested offset has reached the latest stream offset that's fetched once at startup time.
-
-
Field Summary
-
Fields inherited from class org.apache.pinot.server.starter.helix.IngestionBasedConsumptionStatusChecker
_consumingSegments, _instanceDataManager, _logger
-
-
Constructor Summary
Constructors Constructor Description OffsetBasedConsumptionStatusChecker(InstanceDataManager instanceDataManager, Set<String> consumingSegments)
-
Method Summary
Modifier and Type Method Description protected booleanisSegmentCaughtUp(String segmentName, LLRealtimeSegmentDataManager rtSegmentDataManager)-
Methods inherited from class org.apache.pinot.server.starter.helix.IngestionBasedConsumptionStatusChecker
getNumConsumingSegmentsNotReachedIngestionCriteria
-
-
-
-
Constructor Detail
-
OffsetBasedConsumptionStatusChecker
public OffsetBasedConsumptionStatusChecker(InstanceDataManager instanceDataManager, Set<String> consumingSegments)
-
-
Method Detail
-
isSegmentCaughtUp
protected boolean isSegmentCaughtUp(String segmentName, LLRealtimeSegmentDataManager rtSegmentDataManager)
- Specified by:
isSegmentCaughtUpin classIngestionBasedConsumptionStatusChecker
-
-