Class: Aws::Firehose::Types::Serializer

Inherits:

Struct

Object
Struct
Aws::Firehose::Types::Serializer

show all

Includes:: Structure

Defined in:: lib/aws-sdk-firehose/types.rb

Overview

Note:

When making an API call, you may pass Serializer data as a hash:

{
  parquet_ser_de: {
    block_size_bytes: 1,
    page_size_bytes: 1,
    compression: "UNCOMPRESSED", # accepts UNCOMPRESSED, GZIP, SNAPPY
    enable_dictionary_compression: false,
    max_padding_bytes: 1,
    writer_version: "V1", # accepts V1, V2
  },
  orc_ser_de: {
    stripe_size_bytes: 1,
    block_size_bytes: 1,
    row_index_stride: 1,
    enable_padding: false,
    padding_tolerance: 1.0,
    compression: "NONE", # accepts NONE, ZLIB, SNAPPY
    bloom_filter_columns: ["NonEmptyStringWithoutWhitespace"],
    bloom_filter_false_positive_probability: 1.0,
    dictionary_key_threshold: 1.0,
    format_version: "V0_11", # accepts V0_11, V0_12
  },
}

The serializer that you want Kinesis Data Firehose to use to convert data to the target format before writing it to Amazon S3. Kinesis Data Firehose supports two types of serializers: the [ORC SerDe] and the [Parquet SerDe].

[1]: hive.apache.org/javadocs/r1.2.2/api/org/apache/hadoop/hive/ql/io/orc/OrcSerde.html [2]: hive.apache.org/javadocs/r1.2.2/api/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.html

Instance Attribute Summary collapse

#orc_ser_de ⇒ Types::OrcSerDe

A serializer to use for converting data to the ORC format before storing it in Amazon S3.
#parquet_ser_de ⇒ Types::ParquetSerDe

A serializer to use for converting data to the Parquet format before storing it in Amazon S3.

Instance Attribute Details

#orc_ser_de ⇒ `Types::OrcSerDe`

A serializer to use for converting data to the ORC format before storing it in Amazon S3. For more information, see [Apache ORC].

[1]: orc.apache.org/docs/

Returns:

(Types::OrcSerDe)

# File 'lib/aws-sdk-firehose/types.rb', line 3491

class Serializer < Struct.new(
  :parquet_ser_de,
  :orc_ser_de)
  include Aws::Structure
end

#parquet_ser_de ⇒ `Types::ParquetSerDe`

A serializer to use for converting data to the Parquet format before storing it in Amazon S3. For more information, see [Apache Parquet].

[1]: parquet.apache.org/documentation/latest/