Package org.apache.pinot.plugin.inputformat.parquet

Class ParquetNativeRecordExtractor

java.lang.Object

org.apache.pinot.spi.data.readers.BaseRecordExtractor<org.apache.parquet.example.data.Group>

org.apache.pinot.plugin.inputformat.parquet.ParquetNativeRecordExtractor

All Implemented Interfaces:

Serializable, RecordExtractor<org.apache.parquet.example.data.Group>

public class ParquetNativeRecordExtractor
extends BaseRecordExtractor<org.apache.parquet.example.data.Group>

ParquetNativeRecordExtractor extract values from Parquet Group.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
static long	JULIAN_DAY_NUMBER_FOR_UNIX_EPOCH	Number of days between Julian day epoch (January 1, 4713 BC) and Unix day epoch (January 1, 1970).
static long	NANOS_PER_MILLISECOND

Constructor Summary

Constructors

Constructor	Description
ParquetNativeRecordExtractor()

Method Summary

Modifier and Type	Method	Description
static BigDecimal	binaryToDecimal(org.apache.parquet.io.api.Binary value, int precision, int scale)
Object	convertMap(Object value)
protected Object	convertMultiValue(Object value)
GenericRow	extract(org.apache.parquet.example.data.Group from, GenericRow to)
Object[]	extractList(org.apache.parquet.example.data.Group group)
Map<String,Object>	extractMap(org.apache.parquet.example.data.Group group)
void	init(Set<String> fields, RecordExtractorConfig recordExtractorConfig)
boolean	isMultiValue(Object value)

Methods inherited from class org.apache.pinot.spi.data.readers.BaseRecordExtractor

convert, convertRecord, convertSingleValue, isMap, isRecord

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

JULIAN_DAY_NUMBER_FOR_UNIX_EPOCH

public static final long JULIAN_DAY_NUMBER_FOR_UNIX_EPOCH

Number of days between Julian day epoch (January 1, 4713 BC) and Unix day epoch (January 1, 1970). The value of this constant is 2440588L.

See Also:

Constant Field Values

NANOS_PER_MILLISECOND

public static final long NANOS_PER_MILLISECOND

See Also:

Constant Field Values

Constructor Detail

ParquetNativeRecordExtractor

public ParquetNativeRecordExtractor()

Method Detail

binaryToDecimal

public static BigDecimal binaryToDecimal(org.apache.parquet.io.api.Binary value,
                                         int precision,
                                         int scale)

init

public void init(@Nullable
                 Set<String> fields,
                 RecordExtractorConfig recordExtractorConfig)

extract

public GenericRow extract(org.apache.parquet.example.data.Group from,
                          GenericRow to)

extractList

public Object[] extractList(org.apache.parquet.example.data.Group group)

extractMap

public Map<String,Object> extractMap(org.apache.parquet.example.data.Group group)

convertMap

public Object convertMap(Object value)

Overrides:

convertMap in class BaseRecordExtractor<org.apache.parquet.example.data.Group>

isMultiValue

public boolean isMultiValue(Object value)

Overrides:

isMultiValue in class BaseRecordExtractor<org.apache.parquet.example.data.Group>

convertMultiValue

@Nullable
protected Object convertMultiValue(Object value)

Overrides:

convertMultiValue in class BaseRecordExtractor<org.apache.parquet.example.data.Group>