Class

com.krux.hyperion.aws

AdpEmrCluster

Related Doc: package aws

Permalink

class AdpEmrCluster extends AdpDataPipelineAbstractObject with AdpResource

Represents the configuration of an Amazon EMR cluster. This object is used by EmrActivity to launch a cluster.

Source
AdpResources.scala
Linear Supertypes
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. AdpEmrCluster
  2. AdpResource
  3. AdpDataPipelineObject
  4. AdpDataPipelineAbstractObject
  5. AdpObject
  6. AnyRef
  7. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Instance Constructors

  1. new AdpEmrCluster(id: String, name: Option[String], amiVersion: Option[String], supportedProducts: Option[String], bootstrapAction: Seq[String], enableDebugging: Option[String], hadoopSchedulerType: Option[String], keyPair: Option[String], masterInstanceBidPrice: Option[String], masterInstanceType: Option[String], coreInstanceBidPrice: Option[String], coreInstanceCount: Option[String], coreInstanceType: Option[String], taskInstanceBidPrice: Option[String], taskInstanceCount: Option[String], taskInstanceType: Option[String], region: Option[String], availabilityZone: Option[String], resourceRole: Option[String], role: Option[String], subnetId: Option[String], emrManagedMasterSecurityGroupId: Option[String], additionalMasterSecurityGroupIds: Option[Seq[String]], emrManagedSlaveSecurityGroupId: Option[String], additionalSlaveSecurityGroupIds: Option[Seq[String]], useOnDemandOnLastAttempt: Option[String], visibleToAllUsers: Option[String], initTimeout: Option[String], terminateAfter: Option[String], actionOnResourceFailure: Option[String], actionOnTaskFailure: Option[String], httpProxy: Option[AdpRef[AdpHttpProxy]], releaseLabel: Option[String], applications: Option[Seq[String]], configuration: Option[Seq[AdpRef[AdpEmrConfiguration]]], maximumRetries: Option[String])

    Permalink

    amiVersion

    The Amazon Machine Image (AMI) version to use by Amazon EMR to install the cluster nodes.

    supportedProducts

    A parameter that installs third-party software on an Amazon EMR cluster, for example installing a third-party distribution of Hadoop.

    bootstrapAction

    An action to run when the cluster starts. You can specify comma-separated arguments. To specify multiple actions, up to 255, add multiple bootstrapAction fields. The default behavior is to start the cluster without any bootstrap actions.

    enableDebugging

    Enables debugging on the Amazon EMR cluster.

    keyPair

    The Amazon EC2 key pair to use to log onto the master node of the cluster. The default action is not to attach a key pair to the cluster.

    masterInstanceType

    The type of EC2 instance to use for the master node. The default value is m1.small.

    coreInstanceCount

    The number of core nodes to use for the cluster. The default value is 1.

    coreInstanceType

    The type of EC2 instance to use for core nodes. The default value is m1.small.

    taskInstanceBidPrice

    The maximum dollar amount for your Spot Instance bid and is a decimal value between 0 and 20.00 exclusive. Setting this value enables Spot Instances for the EMR cluster task nodes.

    taskInstanceCount

    The number of task nodes to use for the cluster. The default value is 1.

    taskInstanceType

    The type of EC2 instance to use for task nodes.

    region

    A region code to specify that the resource should run in a different region.

    subnetId

    The ID of the subnet to launch the instance into.

    terminateAfter

    The amount of time to wait before terminating the resource.

    maximumRetries

    Maximum number attempt retries on failure.

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  4. val actionOnResourceFailure: Option[String]

    Permalink
  5. val actionOnTaskFailure: Option[String]

    Permalink
  6. val additionalMasterSecurityGroupIds: Option[Seq[String]]

    Permalink
  7. val additionalSlaveSecurityGroupIds: Option[Seq[String]]

    Permalink
  8. val amiVersion: Option[String]

    Permalink

    The Amazon Machine Image (AMI) version to use by Amazon EMR to install the cluster nodes.

  9. val applications: Option[Seq[String]]

    Permalink
  10. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  11. val availabilityZone: Option[String]

    Permalink
  12. val bootstrapAction: Seq[String]

    Permalink

    An action to run when the cluster starts.

    An action to run when the cluster starts. You can specify comma-separated arguments. To specify multiple actions, up to 255, add multiple bootstrapAction fields. The default behavior is to start the cluster without any bootstrap actions.

  13. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  14. val configuration: Option[Seq[AdpRef[AdpEmrConfiguration]]]

    Permalink
  15. val coreInstanceBidPrice: Option[String]

    Permalink
  16. val coreInstanceCount: Option[String]

    Permalink

    The number of core nodes to use for the cluster.

    The number of core nodes to use for the cluster. The default value is 1.

  17. val coreInstanceType: Option[String]

    Permalink

    The type of EC2 instance to use for core nodes.

    The type of EC2 instance to use for core nodes. The default value is m1.small.

  18. val emrManagedMasterSecurityGroupId: Option[String]

    Permalink
  19. val emrManagedSlaveSecurityGroupId: Option[String]

    Permalink
  20. val enableDebugging: Option[String]

    Permalink

    Enables debugging on the Amazon EMR cluster.

  21. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  22. def equals(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  23. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  24. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  25. val hadoopSchedulerType: Option[String]

    Permalink
  26. def hashCode(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  27. val httpProxy: Option[AdpRef[AdpHttpProxy]]

    Permalink
  28. val id: String

    Permalink

    The ID of the object, IDs must be unique within a pipeline definition

    The ID of the object, IDs must be unique within a pipeline definition

    Definition Classes
    AdpEmrClusterAdpDataPipelineObjectAdpObject
  29. val initTimeout: Option[String]

    Permalink
  30. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  31. val keyPair: Option[String]

    Permalink

    The Amazon EC2 key pair to use to log onto the master node of the cluster.

    The Amazon EC2 key pair to use to log onto the master node of the cluster. The default action is not to attach a key pair to the cluster.

    Definition Classes
    AdpEmrClusterAdpResource
  32. val masterInstanceBidPrice: Option[String]

    Permalink
  33. val masterInstanceType: Option[String]

    Permalink

    The type of EC2 instance to use for the master node.

    The type of EC2 instance to use for the master node. The default value is m1.small.

  34. val maximumRetries: Option[String]

    Permalink

    Maximum number attempt retries on failure.

  35. val name: Option[String]

    Permalink

    The optional, user-defined label of the object.

    The optional, user-defined label of the object. If you do not provide a name for an object in a pipeline definition, AWS Data Pipeline automatically duplicates the value of id.

    Definition Classes
    AdpEmrClusterAdpDataPipelineObjectAdpDataPipelineAbstractObject
  36. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  37. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  38. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  39. val region: Option[String]

    Permalink

    A region code to specify that the resource should run in a different region.

    A region code to specify that the resource should run in a different region.

    Definition Classes
    AdpEmrClusterAdpResource
  40. val releaseLabel: Option[String]

    Permalink
  41. val resourceRole: Option[String]

    Permalink
  42. val role: Option[String]

    Permalink
  43. val subnetId: Option[String]

    Permalink

    The ID of the subnet to launch the instance into.

  44. val supportedProducts: Option[String]

    Permalink

    A parameter that installs third-party software on an Amazon EMR cluster, for example installing a third-party distribution of Hadoop.

  45. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  46. val taskInstanceBidPrice: Option[String]

    Permalink

    The maximum dollar amount for your Spot Instance bid and is a decimal value between 0 and 20.00 exclusive.

    The maximum dollar amount for your Spot Instance bid and is a decimal value between 0 and 20.00 exclusive. Setting this value enables Spot Instances for the EMR cluster task nodes.

  47. val taskInstanceCount: Option[String]

    Permalink

    The number of task nodes to use for the cluster.

    The number of task nodes to use for the cluster. The default value is 1.

  48. val taskInstanceType: Option[String]

    Permalink

    The type of EC2 instance to use for task nodes.

  49. val terminateAfter: Option[String]

    Permalink

    The amount of time to wait before terminating the resource.

    The amount of time to wait before terminating the resource.

    Definition Classes
    AdpEmrClusterAdpResource
  50. def toString(): String

    Permalink
    Definition Classes
    AnyRef → Any
  51. val type: String

    Permalink

    The type of object.

    The type of object. Use one of the predefined AWS Data Pipeline object types.

    Definition Classes
    AdpEmrClusterAdpDataPipelineObject
  52. val useOnDemandOnLastAttempt: Option[String]

    Permalink
  53. val visibleToAllUsers: Option[String]

    Permalink
  54. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  55. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  56. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )

Inherited from AdpResource

Inherited from AdpDataPipelineObject

Inherited from AdpObject

Inherited from AnyRef

Inherited from Any

Ungrouped