Class: Karafka::Fetcher
- Inherits:
-
Object
- Object
- Karafka::Fetcher
- Defined in:
- lib/karafka/fetcher.rb
Overview
Note:
Creating multiple fetchers will result in having multiple connections to the same topics, which means that if there are no partitions, it won’t use them.
Class used to run the Karafka consumer and handle shutting down, restarting etc
Instance Method Summary collapse
-
#fetch_loop ⇒ Object
Starts listening on all the listeners asynchronously Fetch loop should never end, which means that we won’t create more actor clusters so we don’t have to terminate them.
Instance Method Details
#fetch_loop ⇒ Object
Starts listening on all the listeners asynchronously Fetch loop should never end, which means that we won’t create more actor clusters so we don’t have to terminate them
9 10 11 12 13 14 15 16 17 18 19 20 21 |
# File 'lib/karafka/fetcher.rb', line 9 def fetch_loop futures = listeners.map do |listener| listener.future.public_send(:fetch_loop, consumer) end futures.map(&:value) # If anything crashes here, we need to raise the error and crush the runner because it means # that something really bad happened rescue => e Karafka.monitor.notice_error(self.class, e) Karafka::App.stop! raise e end |