dataformat

Type Members

1. case class CsvDataFormat extends DataFormat with Product with Serializable

   

   A comma-delimited data format where the column separator is a comma and the record separator is a newline character.

2. case class CustomDataFormat extends DataFormat with Product with Serializable

   

   A custom data format defined by a combination of a certain column separator, record separator, and escape character.

3. trait DataFormat extends NamedPipelineObject

   

   The base trait of all data formats

4. case class DataFormatFields(columns: Seq[HString] = Seq.empty) extends Product with Serializable

   

5. case class DynamoDBDataFormat extends DataFormat with Product with Serializable

   

   Applies a schema to a DynamoDB table to make it accessible by a Hive query.

   Applies a schema to a DynamoDB table to make it accessible by a Hive query. DynamoDBDataFormat is used with a HiveActivity object and a DynamoDBDataNode input and output. DynamoDBDataFormat requires that you specify all columns in your Hive query.

6. case class DynamoDBExportDataFormat extends DataFormat with Product with Serializable

   

   Applies a schema to an DynamoDB table to make it accessible by a Hive query.

   Applies a schema to an DynamoDB table to make it accessible by a Hive query. Use DynamoDBExportDataFormat with a HiveCopyActivity object and DynamoDBDataNode or S3DataNode input and output. DynamoDBExportDataFormat has the following benefits:

   • Provides both DynamoDB and Amazon S3 support
   • Allows you to filter data by certain columns in your Hive query
   • Exports all attributes from DynamoDB even if you have a sparse schema

7. case class RegExDataFormat extends DataFormat with Product with Serializable

   

   A custom data format defined by a regular expression.

8. case class TsvDataFormat extends DataFormat with Product with Serializable

   

   A tab-delimited data format where the record separator is a newline character.