A C E F G H I N O R S T V
All Classes All Packages

A

applyLogicalType(Schema.Field, Object) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroSchemaUtil

Applies the logical type conversion to the given Avro record field.

AvroIngestionSchemaValidator - Class in org.apache.pinot.plugin.inputformat.avro

Schema validator to validate pinot schema and avro schema

AvroIngestionSchemaValidator() - Constructor for class org.apache.pinot.plugin.inputformat.avro.AvroIngestionSchemaValidator

AvroRecordExtractor - Class in org.apache.pinot.plugin.inputformat.avro

Extractor for Avro Records

AvroRecordExtractor() - Constructor for class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractor

AvroRecordExtractorConfig - Class in org.apache.pinot.plugin.inputformat.avro

Config for AvroRecordExtractor

AvroRecordExtractorConfig() - Constructor for class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractorConfig

AvroRecordReader - Class in org.apache.pinot.plugin.inputformat.avro

Record reader for AVRO file.

AvroRecordReader() - Constructor for class org.apache.pinot.plugin.inputformat.avro.AvroRecordReader

AvroRecordReaderConfig - Class in org.apache.pinot.plugin.inputformat.avro

Config for AvroRecordReader

AvroRecordReaderConfig() - Constructor for class org.apache.pinot.plugin.inputformat.avro.AvroRecordReaderConfig

AvroSchemaUtil - Class in org.apache.pinot.plugin.inputformat.avro

AvroUtils - Class in org.apache.pinot.plugin.inputformat.avro

Utils for handling Avro records

C

close() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordReader

convertRecord(Object) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractor

Handles the conversion of every field of the Avro GenericRecord.

convertSingleValue(Object) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractor

This method convert any Avro logical-type converted (or not) value to a class supported by Pinot GenericRow Note that at the moment BigDecimal is converted to Pinot double which may lead to precision loss or may not be represented at all.

E

extract(GenericRecord, GenericRow) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractor

extractFieldDataType(Schema.Field) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroUtils

Extract the data type stored in Pinot for the given Avro field.

F

findConversionFor(String) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroSchemaUtil

G

getAvroReader(File) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroUtils

Get the Avro file reader for the given file.

getAvroSchemaFromPinotSchema(Schema) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroUtils

Helper method to build Avro schema from Pinot schema.

getDataTypeMismatchResult() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroIngestionSchemaValidator

getInputSchemaType() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroIngestionSchemaValidator

getMissingPinotColumnResult() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroIngestionSchemaValidator

getMultiValueStructureMismatchResult() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroIngestionSchemaValidator

getPinotSchemaFromAvroDataFile(File) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroUtils

Given an Avro data file, count all columns as dimension and return the equivalent Pinot schema.

getPinotSchemaFromAvroDataFile(File, Map<String, FieldSpec.FieldType>, TimeUnit) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroUtils

Given an Avro data file, map from column to field type and time unit, return the equivalent Pinot schema.

getPinotSchemaFromAvroSchema(Schema, Map<String, FieldSpec.FieldType>, TimeUnit) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroUtils

Given an Avro schema, map from column to field type and time unit, return the equivalent Pinot schema.

getPinotSchemaFromAvroSchemaFile(File, Map<String, FieldSpec.FieldType>, TimeUnit, boolean, List<String>, String, ComplexTypeConfig.CollectionNotUnnestedToJson) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroUtils

Given an Avro schema file, map from column to field type and time unit, return the equivalent Pinot schema.

getPinotSchemaFromAvroSchemaWithComplexTypeHandling(Schema, Map<String, FieldSpec.FieldType>, TimeUnit, List<String>, String, ComplexTypeConfig.CollectionNotUnnestedToJson) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroUtils

Given an Avro schema, flatten/unnest the complex types based on the config, and then map from column to field type and time unit, return the equivalent Pinot schema.

getSingleValueMultiValueFieldMismatchResult() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroIngestionSchemaValidator

H

hasNext() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordReader

I

init(File, Set<String>, RecordReaderConfig) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordReader

init(Map<String, String>) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractorConfig

init(Set<String>, RecordExtractorConfig) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractor

init(Schema, String) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroIngestionSchemaValidator

isEnableLogicalTypes() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractorConfig

isEnableLogicalTypes() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordReaderConfig

isPrimitiveType(Schema.Type) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroSchemaUtil

isRecord(Object) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractor

Returns whether the object is an Avro GenericRecord.

isSingleValueField(Schema.Field) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroUtils

Return whether the Avro field is a single-value field.

N

next() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordReader

next(GenericRow) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordReader

O

org.apache.pinot.plugin.inputformat.avro - package org.apache.pinot.plugin.inputformat.avro

R

rewind() - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordReader

S

setEnableLogicalTypes(boolean) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordExtractorConfig

setEnableLogicalTypes(boolean) - Method in class org.apache.pinot.plugin.inputformat.avro.AvroRecordReaderConfig

T

toAvroSchemaJsonObject(FieldSpec) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroSchemaUtil

V

valueOf(Schema.Type) - Static method in class org.apache.pinot.plugin.inputformat.avro.AvroSchemaUtil

Returns the data type stored in Pinot that is associated with the given Avro type.

A C E F G H I N O R S T V
All Classes All Packages