GoGetter

Easily send get requests, with a little more sophistication than Net::HTTP.get

Unlike HTTParty, which is a great gem if your class works against a specific website, GoGetter fits the use case where you need to send a bunch of HTTP GETs to several domains, and don’t want to wrap each one in its own class.

Think of it as an alternative to open-uri that doesn’t create any temporary files.

It handles proxies, basic authentication, and HTTP redirects.

Before releasing this code I used it extensively in a proprietary web crawler that sent around a billion GET requests so far, so you could say that it’s quite robust :)

Contributing to gogetter

Check out the latest master to make sure the feature hasn’t been implemented or the bug hasn’t been fixed yet
Check out the issue tracker to make sure someone already hasn’t requested it and/or contributed it
Fork the project
Start a feature/bugfix branch
Commit and push until you are happy with your contribution
Make sure to add tests for it. This is important so I don’t break it in a future version unintentionally.
Please try not to mess with the Rakefile, version, or history. If you want to have your own version, or is otherwise

necessary, that is fine, but please isolate to its own commit so I can cherry-pick around it.

GoGetter

Contributing to gogetter

Copyright