Http-Utilities =====

Http-Utilities is a wrapper for common HTTP-libraries (Net::Http, Open Uri, Curb) using a unified API.

I personally use this in quite a few projects and decided to extract it into a separate gem.

Features:

  • Support for Net:Http, Open Uri, Curb

  • Proxy support (adds a proxy model). Enables you to randomly use different proxies on every request.

  • Proxy checker (comes with Resque jobs for scheduling)

  • Yaml-file containing a few thousand User Agents that are randomly used on every request.

There are some specs but the gem needs more test/spec coverage. Working on it though.

This is primarily intended for private use, but get back to me if you use it and run into issues.