fluent-plugin-aliyunoss

Fluentd output plugin to do something.

aliyunoss output plugin buffers event logs in local file and upload it to aliyun oss periodically. it is support fluentd>=v0.14.0.

Installation

RubyGems

$ gem install fluent-plugin-aliyunoss

Bundler

Add following line to your Gemfile:

gem "fluent-plugin-aliyunoss"

And then execute:

$ bundle

Configuration

You can generate configuration template:

$ fluent-plugin-config-format output aliyunoss

ex:

<system>
  workers 2
  root_dir /var/log/fluentd
</system>

<source>
  @type http
  @id http_input

  port 8888
  <parse>
    @type json
    keep_time_key true
  </parse>
</source>

<match debug.*>
  @type aliyunoss
  oss_key_id xxx_id
  oss_key_secret xxx_secret
  oss_bucket xxx_bucket
  oss_endpoint xxx_endpoint

  oss_path "project/${tag}/date=%Y-%m-%d/%{host}-worker#{ENV['SERVERENGINE_WORKER_ID']}-%Y%m%d%H%M%S-%{uuid}.gz"
  <buffer tag,time>
    @type file
    path xxx
    timekey 10
    timekey_wait 10
    timekey_use_utc true
  </buffer>
  <inject>
    time_key fluentd_time
    time_type string
    time_format '%Y-%m-%d %H:%M:%S'
    tag_key fluentd_tag
  </inject>
</match>

Copyright

• Copyright(c) 2019- junjie
• License
  • Apache License, Version 2.0