Class: Aws::Firehose::Types::Serializer

Inherits:
Struct
  • Object
show all
Includes:
Structure
Defined in:
lib/aws-sdk-firehose/types.rb

Overview

Note:

When making an API call, you may pass Serializer data as a hash:

{
  parquet_ser_de: {
    block_size_bytes: 1,
    page_size_bytes: 1,
    compression: "UNCOMPRESSED", # accepts UNCOMPRESSED, GZIP, SNAPPY
    enable_dictionary_compression: false,
    max_padding_bytes: 1,
    writer_version: "V1", # accepts V1, V2
  },
  orc_ser_de: {
    stripe_size_bytes: 1,
    block_size_bytes: 1,
    row_index_stride: 1,
    enable_padding: false,
    padding_tolerance: 1.0,
    compression: "NONE", # accepts NONE, ZLIB, SNAPPY
    bloom_filter_columns: ["NonEmptyStringWithoutWhitespace"],
    bloom_filter_false_positive_probability: 1.0,
    dictionary_key_threshold: 1.0,
    format_version: "V0_11", # accepts V0_11, V0_12
  },
}

The serializer that you want Kinesis Data Firehose to use to convert data to the target format before writing it to Amazon S3. Kinesis Data Firehose supports two types of serializers: the [ORC SerDe] and the [Parquet SerDe].

[1]: hive.apache.org/javadocs/r1.2.2/api/org/apache/hadoop/hive/ql/io/orc/OrcSerde.html [2]: hive.apache.org/javadocs/r1.2.2/api/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.html

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#orc_ser_deTypes::OrcSerDe

A serializer to use for converting data to the ORC format before storing it in Amazon S3. For more information, see [Apache ORC].

[1]: orc.apache.org/docs/

Returns:


5058
5059
5060
5061
5062
5063
# File 'lib/aws-sdk-firehose/types.rb', line 5058

class Serializer < Struct.new(
  :parquet_ser_de,
  :orc_ser_de)
  SENSITIVE = []
  include Aws::Structure
end

#parquet_ser_deTypes::ParquetSerDe

A serializer to use for converting data to the Parquet format before storing it in Amazon S3. For more information, see [Apache Parquet].

[1]: parquet.apache.org/documentation/latest/

Returns:


5058
5059
5060
5061
5062
5063
# File 'lib/aws-sdk-firehose/types.rb', line 5058

class Serializer < Struct.new(
  :parquet_ser_de,
  :orc_ser_de)
  SENSITIVE = []
  include Aws::Structure
end