class CobolSchema extends Serializable
This class provides a view on a COBOL schema from the perspective of Spark. When provided with a parsed copybook the class provides the corresponding Spark schema and also other properties for the Spark data source.
- Alphabetic
- By Inheritance
- CobolSchema
- Serializable
- Serializable
- AnyRef
- Any
- Hide All
- Show All
- Public
- All
Instance Constructors
-
new
CobolSchema(copybook: Copybook, policy: SchemaRetentionPolicy, inputFileNameField: String, generateRecordId: Boolean, generateRecordBytes: Boolean, generateSegIdFieldsCnt: Int = 0, segmentIdProvidedPrefix: String = "", metadataPolicy: MetadataPolicy = MetadataPolicy.Basic)
- copybook
A parsed copybook.
- policy
Specifies a policy to transform the input schema. The default policy is to keep the schema exactly as it is in the copybook.
- inputFileNameField
If non-empty, a source file name will be prepended to the beginning of the schema.
- generateRecordId
If true, a record id field will be prepended to the beginning of the schema.
- generateRecordBytes
If true, a record bytes field will be appended to the beginning of the schema.
- generateSegIdFieldsCnt
A number of segment ID levels to generate
- segmentIdProvidedPrefix
A prefix for each segment id levels to make segment ids globally unique (by default the current timestamp will be used)
- metadataPolicy
Specifies a policy to generate metadata fields.
Value Members
-
final
def
!=(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
##(): Int
- Definition Classes
- AnyRef → Any
-
final
def
==(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
final
def
asInstanceOf[T0]: T0
- Definition Classes
- Any
-
def
clone(): AnyRef
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()
- val copybook: Copybook
-
final
def
eq(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
def
equals(arg0: Any): Boolean
- Definition Classes
- AnyRef → Any
-
def
finalize(): Unit
- Attributes
- protected[lang]
- Definition Classes
- AnyRef
- Annotations
- @throws( classOf[java.lang.Throwable] )
- val generateRecordBytes: Boolean
- val generateRecordId: Boolean
- val generateSegIdFieldsCnt: Int
-
final
def
getClass(): Class[_]
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- def getCobolSchema: Copybook
- lazy val getRecordSize: Int
-
def
hashCode(): Int
- Definition Classes
- AnyRef → Any
- Annotations
- @native()
- val inputFileNameField: String
-
final
def
isInstanceOf[T0]: Boolean
- Definition Classes
- Any
- def isRecordFixedSize: Boolean
- val metadataPolicy: MetadataPolicy
-
final
def
ne(arg0: AnyRef): Boolean
- Definition Classes
- AnyRef
-
final
def
notify(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
-
final
def
notifyAll(): Unit
- Definition Classes
- AnyRef
- Annotations
- @native()
- val policy: SchemaRetentionPolicy
- val segmentIdPrefix: String
- val segmentIdProvidedPrefix: String
-
final
def
synchronized[T0](arg0: ⇒ T0): T0
- Definition Classes
- AnyRef
-
def
toString(): String
- Definition Classes
- AnyRef → Any
-
final
def
wait(): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long, arg1: Int): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... )
-
final
def
wait(arg0: Long): Unit
- Definition Classes
- AnyRef
- Annotations
- @throws( ... ) @native()