common

Type Members

1. case class BaseFields(id: PipelineObjectId, name: Option[String] = None) extends Product with Serializable

   

   The base fields of all pipeline objects.

2. trait DefaultObject extends PipelineObject

   

   Defines the overall behaviour of a data pipeline.

3. case class DefaultObjectFields(schedule: Schedule, properties: Map[String, Either[HType, PipelineObject]]) extends Product with Serializable

   

   Fields used by the DefaultObjects.

   Fields used by the DefaultObjects.

   schedule

   The pipeline schedule.

   properties

   Additional custom properties to attach to the default object.

4. trait Escapable extends AnyRef

   

5. case class FixedObjectId(seed: String) extends PipelineObjectId with Product with Serializable

   

6. case class HdfsUri(ref: String) extends Product with Serializable

   

7. trait HdfsUriHelper extends AnyRef

   

8. case class HttpProxy extends NamedPipelineObject with Product with Serializable

   

9. case class Memory(n: Long, unit: String) extends Product with Serializable

   

   Memory is a memory specification including an amount and a unit.

   Memory is a memory specification including an amount and a unit.

   n

   The amount of memory

   unit

   The unit.

10. case class NameGroupObjectId(name: String, group: String, rand: String = UUID.randomUUID.toString) extends PipelineObjectId with Product with Serializable

    

11. trait NamedPipelineObject extends PipelineObject

    

12. trait OptionalOrdered[A] extends AnyRef

    

13. trait PipelineObject extends Ordered[PipelineObject]

    

    The base trait of krux data pipeline objects.

14. trait PipelineObjectId extends Ordered[PipelineObjectId]

    

15. case class RandomizedObjectId(seed: String, rand: String = UUID.randomUUID.toString) extends PipelineObjectId with Product with Serializable

    

16. case class S3Uri(ref: String) extends Product with Serializable

    

    The S3Uri provides a typesafe way of representing S3 URI's.

    The S3Uri provides a typesafe way of representing S3 URI's.

    There are a variety of ways to create S3Uri's. You don't have to create an instance directly. You can create using string interpolation such as s3"hyperion-bucket/some-path" or using a builder such as s3 / "hyperion-bucket" / "some-path".

17. trait S3UriHelper extends AnyRef

    

18. trait SparkCommandRunner extends AnyRef

    

19. case class StandardDefaultObject extends DefaultObject with Product with Serializable

    

    The standard default object.

20. trait StorageClass extends AnyRef