A fluffy corded and threaded pool. The smallest thread pool available on the market to date. The Puli is enumerable, mappable, parallel and also tiny.
To execute lots of things in parallel:
puli = .(num_threads: 4, tasks: uris) response_bodies = puli.map do |uri_task| Patron::Session.new.get(uri_task).body end
You can spool tasks one by one as well
puli = .(num_threads: 4) database.each_row do |row| puli << row end puli.each do |database_row| output.write(database_row) end
If an exception is raised during the execution of a task, Puli will make sure other threads stop before starting their next iteration:
puli = .(num_threads: 4, tasks: five_thousand_heavy_items) puli.each do |item| #..... raise TimeoutError end # Will not have executed all the five thousand heavy items, just some, # and will also raise TimeoutError up into the caller, regardless of whether # Thread.abort_on_exception is set to true.
Contributing to puli
- Check out the latest master to make sure the feature hasn't been implemented or the bug hasn't been fixed yet.
- Check out the issue tracker to make sure someone already hasn't requested it and/or contributed it.
- Fork the project.
- Start a feature/bugfix branch.
- Commit and push until you are happy with your contribution.
- Make sure to add tests for it. This is important so I don't break it in a future version unintentionally.
- Please try not to mess with the Rakefile, version, or history. If you want to have your own version, or is otherwise necessary, that is fine, but please isolate to its own commit so I can cherry-pick around it.
Copyright (c) 2016 Julik Tarkhanov. See LICENSE.txt for further details.