Bucketer

This is a generic EventMachine library for putting arbitrary objects into buckets and setting callbacks to be called when any bucket exceeds a specific threshold size. Although the Bucketer::InMemory is synchronous (it's just using a ruby hash) the interface is still what would be expected for an asynchronous API for consistency with other Bucketers to be implemented in future.

Currently an in memory bucketer is supported, however it is intended that a redis backed bucketer will be added later and it will be using em-hiredis gem for redis interaction and it will actually be asynchronous.

Installation

Add this line to your application's Gemfile:

gem 'bucketer'

And then execute:

$ bundle

Or install it yourself as:

$ gem install bucketer

Usage

require 'bucketer'
EM.run do
  bucketer = Bucketer::InMemory.new(:bucket_threshold_size => 5)

  bucketer.on_bucket_full do |bucket_id|
    p "yay bucket #{bucket_id} filled up!"

    bucketer.get_and_empty_bucket(bucket_id) do |items|
      EM.stop
      items.each do |item|
        p "got back #{item}"
      end
    end
  end

  bucketer.add_item("1", "1", {:foo => :bar}) {EM.stop}
  bucketer.add_item("1", "2", {:foo => :bar}) {}
  bucketer.add_item("1", "3", {:foo => :bar}) {}
  bucketer.add_item("1", "4", {:bar => :foo}) {}
  bucketer.add_item("1", "5", {:bar => :foo}) {}
end

Contributing

1. Fork it ( https://github.com/dgvz/bucketer/fork )
2. Create your feature branch (git checkout -b my-new-feature)
3. Commit your changes (git commit -am 'Add some feature')
4. Push to the branch (git push origin my-new-feature)
5. Create a new Pull Request