Class/Object

com.krux.hyperion.resource

SparkCluster

Related Docs: object SparkCluster | package resource

Permalink

case class SparkCluster extends EmrCluster with Product with Serializable

Launch a Spark cluster

Source
SparkCluster.scala
Linear Supertypes
Serializable, Serializable, Product, Equals, EmrCluster, ResourceObject, NamedPipelineObject, PipelineObject, Ordered[PipelineObject], Comparable[PipelineObject], AnyRef, Any
Ordering
  1. Alphabetic
  2. By Inheritance
Inherited
  1. SparkCluster
  2. Serializable
  3. Serializable
  4. Product
  5. Equals
  6. EmrCluster
  7. ResourceObject
  8. NamedPipelineObject
  9. PipelineObject
  10. Ordered
  11. Comparable
  12. AnyRef
  13. Any
  1. Hide All
  2. Show All
Visibility
  1. Public
  2. All

Type Members

  1. type Self = SparkCluster

    Permalink

Value Members

  1. final def !=(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  2. final def ##(): Int

    Permalink
    Definition Classes
    AnyRef → Any
  3. def <(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  4. def <=(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  5. final def ==(arg0: Any): Boolean

    Permalink
    Definition Classes
    AnyRef → Any
  6. def >(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  7. def >=(that: PipelineObject): Boolean

    Permalink
    Definition Classes
    Ordered
  8. def actionOnResourceFailure: Option[ActionOnResourceFailure]

    Permalink
    Definition Classes
    ResourceObject
  9. def actionOnTaskFailure: Option[ActionOnTaskFailure]

    Permalink
    Definition Classes
    ResourceObject
  10. def additionalMasterSecurityGroupIds: Seq[HString]

    Permalink
    Definition Classes
    EmrCluster
  11. def additionalSlaveSecurityGroupIds: Seq[HString]

    Permalink
    Definition Classes
    EmrCluster
  12. def amiVersion: Option[HString]

    Permalink
    Definition Classes
    EmrCluster
  13. def applications: Seq[HString]

    Permalink
    Definition Classes
    SparkClusterEmrCluster
  14. final def asInstanceOf[T0]: T0

    Permalink
    Definition Classes
    Any
  15. def availabilityZone: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  16. val baseFields: BaseFields

    Permalink
    Definition Classes
    SparkClusterNamedPipelineObject
  17. def bootstrapAction: Seq[HString]

    Permalink
    Definition Classes
    EmrCluster
  18. def clone(): AnyRef

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  19. def compare(that: PipelineObject): Int

    Permalink
    Definition Classes
    PipelineObject → Ordered
  20. def compareTo(that: PipelineObject): Int

    Permalink
    Definition Classes
    Ordered → Comparable
  21. def configuration: Seq[EmrConfiguration]

    Permalink
    Definition Classes
    EmrCluster
  22. def coreInstanceBidPrice: Option[HDouble]

    Permalink
    Definition Classes
    EmrCluster
  23. def coreInstanceCount: HInt

    Permalink
    Definition Classes
    EmrCluster
  24. def coreInstanceType: Option[HString]

    Permalink
    Definition Classes
    EmrCluster
  25. val emrClusterFields: EmrClusterFields

    Permalink
    Definition Classes
    SparkClusterEmrCluster
  26. def enableDebugging: Option[HBoolean]

    Permalink
    Definition Classes
    EmrCluster
  27. final def eq(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  28. def finalize(): Unit

    Permalink
    Attributes
    protected[java.lang]
    Definition Classes
    AnyRef
    Annotations
    @throws( classOf[java.lang.Throwable] )
  29. final def getClass(): Class[_]

    Permalink
    Definition Classes
    AnyRef → Any
  30. def groupedBy(group: String): Self

    Permalink

    Postfix the name field

    Postfix the name field

    Definition Classes
    NamedPipelineObject
  31. def hadoopSchedulerType: Option[SchedulerType]

    Permalink
    Definition Classes
    EmrCluster
  32. def httpProxy: Option[HttpProxy]

    Permalink
    Definition Classes
    ResourceObject
  33. def id: PipelineObjectId

    Permalink
    Definition Classes
    NamedPipelineObjectPipelineObject
  34. def idGroupedBy(group: String): Self

    Permalink

    Have a grouping postfix in the id field

    Have a grouping postfix in the id field

    Definition Classes
    NamedPipelineObject
    Note

    Id naming is more restrictive, it is recommended to not changing the id unleass you have a good reason

  35. def idNamed(namePrefix: String): Self

    Permalink

    Id field will be prefixed with name

    Id field will be prefixed with name

    Definition Classes
    NamedPipelineObject
    Note

    Id naming is more restrictive, it is recommended to not changing the id unless you have a good reason

  36. def initTimeout: Option[HDuration]

    Permalink
    Definition Classes
    ResourceObject
  37. lazy val instanceCount: HInt

    Permalink
    Definition Classes
    EmrCluster
  38. final def isInstanceOf[T0]: Boolean

    Permalink
    Definition Classes
    Any
  39. def keyPair: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  40. val logger: Logger

    Permalink
    Definition Classes
    SparkClusterEmrCluster
  41. def masterInstanceBidPrice: Option[HDouble]

    Permalink
    Definition Classes
    EmrCluster
  42. def masterInstanceType: Option[HString]

    Permalink
    Definition Classes
    EmrCluster
  43. def masterSecurityGroupId: Option[HString]

    Permalink
    Definition Classes
    EmrCluster
  44. def maximumRetries: Option[HInt]

    Permalink
    Definition Classes
    ResourceObject
  45. def name: Option[String]

    Permalink

    Name of the pipeline object, if not set, it will defaults to

    Name of the pipeline object, if not set, it will defaults to

    Option(id)
    Definition Classes
    NamedPipelineObject
  46. def named(namePrefix: String): Self

    Permalink

    Give the object a name prefix

    Give the object a name prefix

    Definition Classes
    NamedPipelineObject
  47. final def ne(arg0: AnyRef): Boolean

    Permalink
    Definition Classes
    AnyRef
  48. final def notify(): Unit

    Permalink
    Definition Classes
    AnyRef
  49. final def notifyAll(): Unit

    Permalink
    Definition Classes
    AnyRef
  50. def objects: Iterable[PipelineObject]

    Permalink
    Definition Classes
    EmrClusterResourceObjectPipelineObject
  51. def ref: AdpRef[AdpEmrCluster]

    Permalink
    Definition Classes
    EmrClusterPipelineObject
  52. def region: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  53. def releaseLabel: Option[HString]

    Permalink
    Definition Classes
    EmrCluster
  54. val resourceFields: ResourceFields

    Permalink
    Definition Classes
    SparkClusterResourceObject
  55. def resourceRole: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  56. def role: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  57. implicit def seq2Option[A](anySeq: Seq[A]): Option[Seq[A]]

    Permalink
    Definition Classes
    PipelineObject
  58. def seqToOption[A, B](anySeq: Seq[A])(transform: (A) ⇒ B): Option[Seq[B]]

    Permalink
    Definition Classes
    PipelineObject
  59. lazy val serialize: AdpEmrCluster

    Permalink
    Definition Classes
    EmrClusterPipelineObject
  60. def slaveSecurityGroupId: Option[HString]

    Permalink
    Definition Classes
    EmrCluster
  61. val sparkVersion: Option[HString]

    Permalink
  62. def standardBootstrapAction: Seq[HString]

    Permalink
    Definition Classes
    SparkClusterEmrCluster
  63. def subnetId: Option[HString]

    Permalink
    Definition Classes
    ResourceObject
  64. def supportedProducts: Option[HString]

    Permalink
    Definition Classes
    EmrCluster
  65. final def synchronized[T0](arg0: ⇒ T0): T0

    Permalink
    Definition Classes
    AnyRef
  66. def taskInstanceBidPrice: Option[HDouble]

    Permalink
    Definition Classes
    EmrCluster
  67. def taskInstanceCount: HInt

    Permalink
    Definition Classes
    EmrCluster
  68. def taskInstanceType: Option[HString]

    Permalink
    Definition Classes
    EmrCluster
  69. def terminateAfter(after: HDuration): Self

    Permalink
    Definition Classes
    ResourceObject
  70. def terminateAfter: Option[HDuration]

    Permalink
    Definition Classes
    ResourceObject
  71. implicit def uniquePipelineId2String(id: PipelineObjectId): String

    Permalink
    Definition Classes
    PipelineObject
  72. def updateBaseFields(fields: BaseFields): SparkCluster

    Permalink
    Definition Classes
    SparkClusterNamedPipelineObject
  73. def updateEmrClusterFields(fields: EmrClusterFields): SparkCluster

    Permalink
    Definition Classes
    SparkClusterEmrCluster
  74. def updateResourceFields(fields: ResourceFields): SparkCluster

    Permalink
    Definition Classes
    SparkClusterResourceObject
  75. def useOnDemandOnLastAttempt: Option[HBoolean]

    Permalink
    Definition Classes
    ResourceObject
  76. def visibleToAllUsers: Option[HBoolean]

    Permalink
    Definition Classes
    EmrCluster
  77. final def wait(): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  78. final def wait(arg0: Long, arg1: Int): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  79. final def wait(arg0: Long): Unit

    Permalink
    Definition Classes
    AnyRef
    Annotations
    @throws( ... )
  80. def withActionOnResourceFailure(action: ActionOnResourceFailure): Self

    Permalink
    Definition Classes
    ResourceObject
  81. def withActionOnTaskFailure(action: ActionOnTaskFailure): Self

    Permalink
    Definition Classes
    ResourceObject
  82. def withAdditionalMasterSecurityGroupIds(groupIds: HString*): Self

    Permalink
    Definition Classes
    EmrCluster
  83. def withAdditionalSlaveSecurityGroupIds(groupIds: HString*): Self

    Permalink
    Definition Classes
    EmrCluster
  84. def withAmiVersion(version: HString): Self

    Permalink
    Definition Classes
    EmrCluster
  85. def withApplications(apps: HString*): Self

    Permalink
    Definition Classes
    EmrCluster
  86. def withAvailabilityZone(az: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  87. def withBootstrapAction(actions: HString*): Self

    Permalink
    Definition Classes
    EmrCluster
  88. def withConfiguration(conf: EmrConfiguration*): Self

    Permalink
    Definition Classes
    EmrCluster
  89. def withCoreInstanceBidPrice(price: HDouble): Self

    Permalink
    Definition Classes
    EmrCluster
  90. def withCoreInstanceCount(count: HInt): Self

    Permalink
    Definition Classes
    EmrCluster
  91. def withCoreInstanceType(instanceType: HString): Self

    Permalink
    Definition Classes
    EmrCluster
  92. def withDebuggingEnabled(enabled: HBoolean): Self

    Permalink
    Definition Classes
    EmrCluster
  93. def withHadoopSchedulerType(scheduleType: SchedulerType): Self

    Permalink
    Definition Classes
    EmrCluster
  94. def withHttpProxy(proxy: HttpProxy): Self

    Permalink
    Definition Classes
    ResourceObject
  95. def withInitTimeout(timeout: HDuration): Self

    Permalink
    Definition Classes
    ResourceObject
  96. def withKeyPair(theKeyPair: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  97. def withMasterInstanceBidPrice(price: HDouble): Self

    Permalink
    Definition Classes
    EmrCluster
  98. def withMasterInstanceType(instanceType: HString): Self

    Permalink
    Definition Classes
    EmrCluster
  99. def withMasterSecurityGroupId(groupId: HString): Self

    Permalink
    Definition Classes
    EmrCluster
  100. def withMaximumRetries(retries: HInt): Self

    Permalink
    Definition Classes
    ResourceObject
  101. def withRegion(r: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  102. def withReleaseLabel(label: HString): Self

    Permalink
    Definition Classes
    EmrCluster
  103. def withResourceRole(r: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  104. def withRole(r: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  105. def withSlaveSecurityGroupId(groupId: HString): Self

    Permalink
    Definition Classes
    EmrCluster
  106. def withSparkVersion(sparkVersion: HString): SparkCluster

    Permalink
  107. def withStandardBootstrapAction(actions: HString*): Self

    Permalink
    Definition Classes
    EmrCluster
  108. def withSubnetId(subnet: HString): Self

    Permalink
    Definition Classes
    ResourceObject
  109. def withSupportedProducts(products: HString): Self

    Permalink
    Definition Classes
    EmrCluster
  110. def withTaskInstanceBidPrice(price: HDouble): Self

    Permalink
    Definition Classes
    EmrCluster
  111. def withTaskInstanceCount(count: HInt): Self

    Permalink
    Definition Classes
    EmrCluster
  112. def withTaskInstanceType(instanceType: HString): Self

    Permalink
    Definition Classes
    EmrCluster
  113. def withUseOnDemandOnLastAttempt(use: HBoolean): Self

    Permalink
    Definition Classes
    ResourceObject
  114. def withVisibleToAllUsers(visible: HBoolean): Self

    Permalink
    Definition Classes
    EmrCluster

Inherited from Serializable

Inherited from Serializable

Inherited from Product

Inherited from Equals

Inherited from EmrCluster

Inherited from ResourceObject

Inherited from NamedPipelineObject

Inherited from PipelineObject

Inherited from Ordered[PipelineObject]

Inherited from Comparable[PipelineObject]

Inherited from AnyRef

Inherited from Any

Ungrouped