fluent-plugin-bigobject

Fluentd output plugin for inserting data to BigObject using AVRO

Installation

Add this line to your application's Gemfile:

gem 'fluent-plugin-bigobject_avro'

And then execute:

$ bundle

Or install it yourself as:

$ gem install fluent-plugin-bigobject_avro

Usage

Configure BigObject URL and the table/column to be mapped in BigObject


# send data to BigObject using avro by providing schema_file in each table
# BigObject will create the table if it does not already exist.

<match bo.insert_avro.*>
  type bigobject

  log_level info

  # specify the bigobject host/port to connect to
  bigobject_hostname 192.168.59.103
  bigobject_port 9091

  remove_tag_prefix bo.insert_avro.
  flush_interval 60s

  <table>
      pattern customer
      schema_file /fluentd/input/avsc/Customer_binary.avsc
  </table>
</match>

License

The gem is available as open source under the terms of the MIT License.