Module: Kafka

Defined in:
lib/fluent/plugin/kafka_producer_ext.rb,
lib/fluent/plugin/kafka_producer_ext.rb

Overview

for out_kafka2 Majority (if not all) of this code is lifted from github.com/zendesk/ruby-kafka/blob/master/lib/kafka/producer.rb with the main difference where we have removed any checks regarding max_buffer_bytesize and max_buffer_size The reason for doing this is to provide a better UX for our users where they only need to set those bounds in the Buffer section using ‘chunk_limit_size` and `chunk_limit_records`.

We should reconsider this in the future in case the ‘ruby-kafka` library drastically changes its internal.

Defined Under Namespace

Classes: Client, CustomProducer, Producer

Constant Summary collapse

EMPTY_HEADER =
{}