| RealtimeSegmentSelector |
Segment selector for real-time table which handles the following scenarios:
When HLC and LLC segments coexist (during LLC migration), select only HLC segments or LLC segments
For HLC segments, only select segments in one group
For LLC segments, only select the first CONSUMING segment for each partition to avoid duplicate data because in
certain unlikely degenerate scenarios, we can consume overlapping data until segments are flushed (at which point
the overlapping data is discarded during the reconciliation process with the controller).
|