fluent-plugin-mixpanel

CAUTION This plugin does not support Ruby < 2.0, and fluentd >= 0.14.

Component

MixpanelOutput

Fluentd plugin to send event track data to mixpanel.

HttpMixpanelInput

Fluentd plugin to integrate mixpanel javascript libraries.

Installation

Install with gem or fluent-gem command as:

# for fluentd
$ gem install fluent-plugin-mixpanel

# for td-agent
$ sudo /usr/lib64/fluent/ruby/bin/fluent-gem install fluent-plugin-mixpanel

Configuration

MixpanelOutput

MixpanelOutput needs mixpanel's project_token, that can get from your mixpanel project settings.

Use distinct_id_key and event_key

You should also specify property key name by distinct_id_key and event_key.

<match output.mixpanel.*>
  type mixpanel
  project_token YOUR_PROJECT_TOKEN
  distinct_id_key user_id
  event_key event_name
</match>

If record like this:

{ user_id: "123", event_name: "event1", key1: "value1", key2: "value2" }

above settings send to the following data to mixpanel, using mixpanel-ruby gem.

tracker = Mixpanel::Tracker.new(YOUR_PROJECT_TOKEN)
tracker.track("123", "event1", { key1: "value1", key2: "value2" })

Use distinct_id_key and event_map_tag

You can use tag name as event name like this. (see additional tag manipulations options below)

Discarding mixpanel errors

When delivering events to Mixpanel, Fluent creates a chunk of messages to send. By default, if one event fails to send to Mixpanel, all messages in that chunk are requeued for delivery. Enabling discard_event_on_send_error allows you to ignore single delivery failures. The event is logged via info, including the record being dropped.

<match output.mixpanel.*>
  ...
  discard_event_on_send_error true
  ...
</match>

PLEASE NOTE (breaking api change in a future release)

The api for remove_tag_prefix will be changing in a future release. There is currently a boolean option, use_legacy_prefix_behavior, which will ensure legacy behavior is maintained until that time. Eventually this option will go away as well and the new behavior will be the only way. The difference is pretty simple, the '.' in the prefix needs to be specified. This change allows this plugin to use Fluet's mixin and unifies syntax across plugins. Currently, use_legacy_prefix_behavior defaults to true, which will work either way, but eventually you will need to specify the '.' in your prefix. Again, use_legacy_prefix_behavior simply removes any '.' along with the specified prefix and will behave properly even after you change your configs to be current as seen below. You do not need to set this option.

<match output.mixpanel.*>
  type mixpanel
  project_token YOUR_PROJECT_TOKEN
  distinct_id_key user_id
  remove_tag_prefix output.mixpanel.
  event_map_tag true
</match>

If tag name is output.mixpanel.event1 and record like this:

{ user_id: "123", key1: "value1", key2: "value2" }

above settings send to the following data to mixpanel, using mixpanel-ruby gem.

tracker = Mixpanel::Tracker.new(YOUR_PROJECT_TOKEN)
tracker.track("123", "event1", { key1: "value1", key2: "value2" })

Use the import method to post instead of track

You can use tag name as event name like this.

<match output.mixpanel.*>
  type mixpanel
  project_token YOUR_PROJECT_TOKEN
  distinct_id_key user_id
  remove_tag_prefix output.mixpanel.
  event_map_tag true
  use_import true
  api_key YOUR_API_KEY
</match>

If tag name is output.mixpanel.event1 and record like this:

{ user_id: "123", key1: "value1", key2: "value2" }

above settings send to the following data to mixpanel, using mixpanel-ruby gem.

tracker = Mixpanel::Tracker.new(YOUR_PROJECT_TOKEN)
tracker.import(api_key, "123", "event1", { key1: "value1", key2: "value2" })

fluentd-plugin-mixpanel also includes the HandleTagNameMixin mixin which allows the following additional options:

remove_tag_prefix <tag_prefix_to_remove_including_the_dot>
remove_tag_suffix <tag_suffix_to_remove_including_the_dot>
add_tag_prefix <tag_prefix_to_add_including_the_dot>
add_tag_suffix <tag_suffix_to_add_including_the_dot>

HttpMixpanelInput

HttpMixpanelInput has same configuration as http Input Plugin.

<source>
  type http_mixpanel
  bind 127.0.0.1
  port 8888
  body_size_limit 10m
  keepalive_timeout 5
  add_http_headers true
</source>

In example folder, you can see example configuration and HTML.

Contributing

Fork it ( http://github.com/hakobera/fluent-plugin-mixpanel/fork )
Create your feature branch (git checkout -b my-new-feature)
Commit your changes (git commit -am 'Add some feature')
Push to the branch (git push origin my-new-feature)
Create new Pull Request