@Generated(value="software.amazon.awssdk:codegen") public final class DevEndpoint extends Object implements SdkPojo, Serializable, ToCopyableBuilder<DevEndpoint.Builder,DevEndpoint>
A development endpoint where a developer can remotely debug extract, transform, and load (ETL) scripts.
| Modifier and Type | Class and Description |
|---|---|
static interface |
DevEndpoint.Builder |
| Modifier and Type | Method and Description |
|---|---|
Map<String,String> |
arguments()
A map of arguments used to configure the
DevEndpoint. |
String |
availabilityZone()
The Amazon Web Services Availability Zone where this
DevEndpoint is located. |
static DevEndpoint.Builder |
builder() |
Instant |
createdTimestamp()
The point in time at which this DevEndpoint was created.
|
String |
endpointName()
The name of the
DevEndpoint. |
boolean |
equals(Object obj) |
boolean |
equalsBySdkFields(Object obj) |
String |
extraJarsS3Path()
The path to one or more Java
.jar files in an S3 bucket that should be loaded in your
DevEndpoint. |
String |
extraPythonLibsS3Path()
The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your
DevEndpoint. |
String |
failureReason()
The reason for a current failure in this
DevEndpoint. |
<T> Optional<T> |
getValueForField(String fieldName,
Class<T> clazz) |
String |
glueVersion()
Glue version determines the versions of Apache Spark and Python that Glue supports.
|
boolean |
hasArguments()
For responses, this returns true if the service returned a value for the Arguments property.
|
int |
hashCode() |
boolean |
hasPublicKeys()
For responses, this returns true if the service returned a value for the PublicKeys property.
|
boolean |
hasSecurityGroupIds()
For responses, this returns true if the service returned a value for the SecurityGroupIds property.
|
Instant |
lastModifiedTimestamp()
The point in time at which this
DevEndpoint was last modified. |
String |
lastUpdateStatus()
The status of the last update.
|
Integer |
numberOfNodes()
The number of Glue Data Processing Units (DPUs) allocated to this
DevEndpoint. |
Integer |
numberOfWorkers()
The number of workers of a defined
workerType that are allocated to the development endpoint. |
String |
privateAddress()
A private IP address to access the
DevEndpoint within a VPC if the DevEndpoint is
created within one. |
String |
publicAddress()
The public IP address used by this
DevEndpoint. |
String |
publicKey()
The public key to be used by this
DevEndpoint for authentication. |
List<String> |
publicKeys()
A list of public keys to be used by the
DevEndpoints for authentication. |
String |
roleArn()
The Amazon Resource Name (ARN) of the IAM role used in this
DevEndpoint. |
List<SdkField<?>> |
sdkFields() |
String |
securityConfiguration()
The name of the
SecurityConfiguration structure to be used with this DevEndpoint. |
List<String> |
securityGroupIds()
A list of security group identifiers used in this
DevEndpoint. |
static Class<? extends DevEndpoint.Builder> |
serializableBuilderClass() |
String |
status()
The current status of this
DevEndpoint. |
String |
subnetId()
The subnet ID for this
DevEndpoint. |
DevEndpoint.Builder |
toBuilder() |
String |
toString()
Returns a string representation of this object.
|
String |
vpcId()
The ID of the virtual private cloud (VPC) used by this
DevEndpoint. |
WorkerType |
workerType()
The type of predefined worker that is allocated to the development endpoint.
|
String |
workerTypeAsString()
The type of predefined worker that is allocated to the development endpoint.
|
String |
yarnEndpointAddress()
The YARN endpoint address used by this
DevEndpoint. |
Integer |
zeppelinRemoteSparkInterpreterPort()
The Apache Zeppelin port for the remote Apache Spark interpreter.
|
clone, finalize, getClass, notify, notifyAll, wait, wait, waitcopypublic final String endpointName()
The name of the DevEndpoint.
DevEndpoint.public final String roleArn()
The Amazon Resource Name (ARN) of the IAM role used in this DevEndpoint.
DevEndpoint.public final boolean hasSecurityGroupIds()
isEmpty() method on the property).
This is useful because the SDK will never return a null collection or map, but you may need to differentiate
between the service returning nothing (or null) and the service returning an empty collection or map. For
requests, this returns true if a value for the property was specified in the request builder, and false if a
value was not specified.public final List<String> securityGroupIds()
A list of security group identifiers used in this DevEndpoint.
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
This method will never return null. If you would like to know whether the service returned this field (so that
you can differentiate between null and empty), you can use the hasSecurityGroupIds() method.
DevEndpoint.public final String subnetId()
The subnet ID for this DevEndpoint.
DevEndpoint.public final String yarnEndpointAddress()
The YARN endpoint address used by this DevEndpoint.
DevEndpoint.public final String privateAddress()
A private IP address to access the DevEndpoint within a VPC if the DevEndpoint is
created within one. The PrivateAddress field is present only when you create the
DevEndpoint within your VPC.
DevEndpoint within a VPC if the DevEndpoint
is created within one. The PrivateAddress field is present only when you create the
DevEndpoint within your VPC.public final Integer zeppelinRemoteSparkInterpreterPort()
The Apache Zeppelin port for the remote Apache Spark interpreter.
public final String publicAddress()
The public IP address used by this DevEndpoint. The PublicAddress field is present only
when you create a non-virtual private cloud (VPC) DevEndpoint.
DevEndpoint. The PublicAddress field is
present only when you create a non-virtual private cloud (VPC) DevEndpoint.public final String status()
The current status of this DevEndpoint.
DevEndpoint.public final WorkerType workerType()
The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.
For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2
executors per worker.
For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and
provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and
provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB
disk.
If the service returns an enum value that is not available in the current SDK version, workerType will
return WorkerType.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from
workerTypeAsString().
For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk,
and 2 executors per worker.
For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk),
and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk),
and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a
64 GB disk.
WorkerTypepublic final String workerTypeAsString()
The type of predefined worker that is allocated to the development endpoint. Accepts a value of Standard, G.1X, or G.2X.
For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk, and 2
executors per worker.
For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk), and
provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk), and
provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a 64 GB
disk.
If the service returns an enum value that is not available in the current SDK version, workerType will
return WorkerType.UNKNOWN_TO_SDK_VERSION. The raw value returned by the service is available from
workerTypeAsString().
For the Standard worker type, each worker provides 4 vCPU, 16 GB of memory and a 50GB disk,
and 2 executors per worker.
For the G.1X worker type, each worker maps to 1 DPU (4 vCPU, 16 GB of memory, 64 GB disk),
and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
For the G.2X worker type, each worker maps to 2 DPU (8 vCPU, 32 GB of memory, 128 GB disk),
and provides 1 executor per worker. We recommend this worker type for memory-intensive jobs.
Known issue: when a development endpoint is created with the G.2X WorkerType
configuration, the Spark drivers for the development endpoint will run on 4 vCPU, 16 GB of memory, and a
64 GB disk.
WorkerTypepublic final String glueVersion()
Glue version determines the versions of Apache Spark and Python that Glue supports. The Python version indicates the version supported for running your ETL scripts on development endpoints.
For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.
Development endpoints that are created without specifying a Glue version default to Glue 0.9.
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are
provided, the version defaults to Python 2.
For more information about the available Glue versions and corresponding Spark and Python versions, see Glue version in the developer guide.
Development endpoints that are created without specifying a Glue version default to Glue 0.9.
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments
are provided, the version defaults to Python 2.
public final Integer numberOfWorkers()
The number of workers of a defined workerType that are allocated to the development endpoint.
The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.
workerType that are allocated to the development
endpoint.
The maximum number of workers you can define are 299 for G.1X, and 149 for G.2X.
public final Integer numberOfNodes()
The number of Glue Data Processing Units (DPUs) allocated to this DevEndpoint.
DevEndpoint.public final String availabilityZone()
The Amazon Web Services Availability Zone where this DevEndpoint is located.
DevEndpoint is located.public final String vpcId()
The ID of the virtual private cloud (VPC) used by this DevEndpoint.
DevEndpoint.public final String extraPythonLibsS3Path()
The paths to one or more Python libraries in an Amazon S3 bucket that should be loaded in your
DevEndpoint. Multiple values must be complete paths separated by a comma.
You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C extensions, such
as the pandas Python data analysis library, are not currently supported.
DevEndpoint. Multiple values must be complete paths separated by a comma.
You can only use pure Python libraries with a DevEndpoint. Libraries that rely on C
extensions, such as the pandas Python data analysis library, are
not currently supported.
public final String extraJarsS3Path()
The path to one or more Java .jar files in an S3 bucket that should be loaded in your
DevEndpoint.
You can only use pure Java/Scala libraries with a DevEndpoint.
.jar files in an S3 bucket that should be loaded in your
DevEndpoint.
You can only use pure Java/Scala libraries with a DevEndpoint.
public final String failureReason()
The reason for a current failure in this DevEndpoint.
DevEndpoint.public final String lastUpdateStatus()
The status of the last update.
public final Instant createdTimestamp()
The point in time at which this DevEndpoint was created.
public final Instant lastModifiedTimestamp()
The point in time at which this DevEndpoint was last modified.
DevEndpoint was last modified.public final String publicKey()
The public key to be used by this DevEndpoint for authentication. This attribute is provided for
backward compatibility because the recommended attribute to use is public keys.
DevEndpoint for authentication. This attribute is provided
for backward compatibility because the recommended attribute to use is public keys.public final boolean hasPublicKeys()
isEmpty() method on the property). This is
useful because the SDK will never return a null collection or map, but you may need to differentiate between the
service returning nothing (or null) and the service returning an empty collection or map. For requests, this
returns true if a value for the property was specified in the request builder, and false if a value was not
specified.public final List<String> publicKeys()
A list of public keys to be used by the DevEndpoints for authentication. Using this attribute is
preferred over a single public key because the public keys allow you to have a different private key per client.
If you previously created an endpoint with a public key, you must remove that key to be able to set a list of
public keys. Call the UpdateDevEndpoint API operation with the public key content in the
deletePublicKeys attribute, and the list of new keys in the addPublicKeys attribute.
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
This method will never return null. If you would like to know whether the service returned this field (so that
you can differentiate between null and empty), you can use the hasPublicKeys() method.
DevEndpoints for authentication. Using this
attribute is preferred over a single public key because the public keys allow you to have a different
private key per client.
If you previously created an endpoint with a public key, you must remove that key to be able to set a
list of public keys. Call the UpdateDevEndpoint API operation with the public key content in
the deletePublicKeys attribute, and the list of new keys in the addPublicKeys
attribute.
public final String securityConfiguration()
The name of the SecurityConfiguration structure to be used with this DevEndpoint.
SecurityConfiguration structure to be used with this
DevEndpoint.public final boolean hasArguments()
isEmpty() method on the property). This is
useful because the SDK will never return a null collection or map, but you may need to differentiate between the
service returning nothing (or null) and the service returning an empty collection or map. For requests, this
returns true if a value for the property was specified in the request builder, and false if a value was not
specified.public final Map<String,String> arguments()
A map of arguments used to configure the DevEndpoint.
Valid arguments are:
"--enable-glue-datacatalog": ""
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments are
provided, the version defaults to Python 2.
Attempts to modify the collection returned by this method will result in an UnsupportedOperationException.
This method will never return null. If you would like to know whether the service returned this field (so that
you can differentiate between null and empty), you can use the hasArguments() method.
DevEndpoint.
Valid arguments are:
"--enable-glue-datacatalog": ""
You can specify a version of Python support for development endpoints by using the Arguments
parameter in the CreateDevEndpoint or UpdateDevEndpoint APIs. If no arguments
are provided, the version defaults to Python 2.
public DevEndpoint.Builder toBuilder()
toBuilder in interface ToCopyableBuilder<DevEndpoint.Builder,DevEndpoint>public static DevEndpoint.Builder builder()
public static Class<? extends DevEndpoint.Builder> serializableBuilderClass()
public final boolean equalsBySdkFields(Object obj)
equalsBySdkFields in interface SdkPojopublic final String toString()
Copyright © 2023. All rights reserved.