The rdkafka gem is a modern Kafka client library for Ruby based on librdkafka. It wraps the production-ready C client using the ffi gem and targets Kafka 0.10+ and Ruby 2.1+.

This gem only provides a high-level Kafka consumer. If you are running an older version of Kafka and/or need the legacy simple consumer we suggest using the Hermann gem.


Run bundle and cd ext && bundle exec rake compile && cd ... Then create the topics as expected in the specs: bundle exec rake create_topics.

You can then run bundle exec rspec to run the tests. To see rdkafka debug output:

DEBUG_PRODUCER=true bundle exec rspec
DEBUG_CONSUMER=true bundle exec rspec

To see everything working run these in separate tabs:

bundle exec rake consume_messages
bundle exec rake produce_messages