Class: Aws::Firehose::Types::Deserializer

Inherits:
Struct
  • Object
show all
Includes:
Structure
Defined in:
lib/aws-sdk-firehose/types.rb

Overview

Note:

When making an API call, you may pass Deserializer data as a hash:

{
  open_x_json_ser_de: {
    convert_dots_in_json_keys_to_underscores: false,
    case_insensitive: false,
    column_to_json_key_mappings: {
      "NonEmptyStringWithoutWhitespace" => "NonEmptyString",
    },
  },
  hive_json_ser_de: {
    timestamp_formats: ["NonEmptyString"],
  },
}

The deserializer you want Kinesis Data Firehose to use for converting the input data from JSON. Kinesis Data Firehose then serializes the data to its final format using the Serializer. Kinesis Data Firehose supports two types of deserializers: the [Apache Hive JSON SerDe] and the [OpenX JSON SerDe].

[1]: cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-JSON [2]: github.com/rcongiu/Hive-JSON-Serde

Constant Summary collapse

SENSITIVE =
[]

Instance Attribute Summary collapse

Instance Attribute Details

#hive_json_ser_deTypes::HiveJsonSerDe

The native Hive / HCatalog JsonSerDe. Used by Kinesis Data Firehose for deserializing data, which means converting it from the JSON format in preparation for serializing it to the Parquet or ORC format. This is one of two deserializers you can choose, depending on which one offers the functionality you need. The other option is the OpenX SerDe.


1535
1536
1537
1538
1539
1540
# File 'lib/aws-sdk-firehose/types.rb', line 1535

class Deserializer < Struct.new(
  :open_x_json_ser_de,
  :hive_json_ser_de)
  SENSITIVE = []
  include Aws::Structure
end

#open_x_json_ser_deTypes::OpenXJsonSerDe

The OpenX SerDe. Used by Kinesis Data Firehose for deserializing data, which means converting it from the JSON format in preparation for serializing it to the Parquet or ORC format. This is one of two deserializers you can choose, depending on which one offers the functionality you need. The other option is the native Hive / HCatalog JsonSerDe.


1535
1536
1537
1538
1539
1540
# File 'lib/aws-sdk-firehose/types.rb', line 1535

class Deserializer < Struct.new(
  :open_x_json_ser_de,
  :hive_json_ser_de)
  SENSITIVE = []
  include Aws::Structure
end