HTTPX: A Ruby HTTP library for tomorrow... and beyond!
HTTPX is an HTTP client library for the Ruby programming language.
Among its features, it supports:
- HTTP/2 and HTTP/1.x protocol versions
- Concurrent requests by default
- Simple and chainable API
- Proxy Support (HTTP(S), Socks4/4a/5)
- Simple Timeout System
- Lightweight by default (require what you need)
And also:
- Compression (gzip, deflate, brotli)
- Streaming Requests
- Auth (Basic Auth, Digest Auth, NTLM)
- Expect 100-continue
- Multipart Requests
- Advanced Cookie handling
- HTTP/2 Server Push
- HTTP/1.1 Upgrade (support for "h2c", "h2")
- Automatic follow redirects
- GRPC
- WebDAV
- Circuit Breaker
- HTTP-based response cache
- International Domain Names
How
Here are some simple examples:
HTTPX.get("https://nghttp2.org").to_s #=> "<!DOCT...."
And that's the simplest one there is. But you can also do:
HTTPX.post("http://example.com", form: { user: "john", password: "pass" })
http = HTTPX.with(headers: { "x-my-name" => "joe" })
http.patch("http://example.com/file", body: File.open("path/to/file")) # request body is streamed
If you want to do some more things with the response, you can get an HTTPX::Response:
response = HTTPX.get("https://nghttp2.org")
puts response.status #=> 200
body = response.body
puts body #=> #<HTTPX::Response ...
You can also send as many requests as you want simultaneously:
page1, page2, page3 = HTTPX.get("https://news.ycombinator.com/news", "https://news.ycombinator.com/news?p=2", "https://news.ycombinator.com/news?p=3")
Installation
Add this line to your Gemfile:
gem "httpx"
or install it in your system:
> gem install httpx
and then just require it in your program:
require "httpx"
What makes it the best ruby HTTP client
Concurrency, HTTP/2 support
httpx supports HTTP/2 (for "https" requests, it'll automatically do ALPN negotiation). However if the server supports HTTP/1.1, it will use HTTP pipelining, falling back to 1 request at a time if the server doesn't support it either (and it'll use Keep-Alive connections, unless the server does not support).
If you passed multiple URIs, it'll perform all of the requests concurrently, by mulitplexing on the necessary sockets (and it'll batch requests to the same socket when the origin is the same):
HTTPX.get(
"https://news.ycombinator.com/news",
"https://news.ycombinator.com/news?p=2",
"https://google.com/q=me"
) # first two requests will be multiplexed on the same socket.
Clean API
httpx builds all functions around the HTTPX module, so that all calls can compose of each other. Here are a few examples:
response = HTTPX.get("https://www.google.com", params: { q: "me" })
response = HTTPX.post("https://www.nghttp2.org/httpbin/post", form: { name: "John", age: "22" })
response = HTTPX.plugin(:basic_auth)
.basic_auth("user", "pass")
.get("https://www.google.com")
# more complex client objects can be cached, and are thread-safe
http = HTTPX.plugin(:expect).with(headers: { "x-pvt-token" => "TOKEN" })
http.get("https://example.com") # the above options will apply
http.post("https://example2.com", form: { name: "John", age: "22" }) # same, plus the form POST body
Lightweight
It ships with most features published as a plugin, making vanilla httpx lightweight and dependency-free, while allowing you to "pay for what you use"
The plugin system is similar to the ones used by sequel, roda or shrine.
Advanced DNS features
HTTPX ships with custom DNS resolver implementations, including a native Happy Eyeballs resolver implementation, and a DNS-over-HTTPS resolver.
User-driven test suite
The test suite runs against httpbin proxied over nghttp2, so actual requests are performed during tests.
Supported Rubies
All Rubies greater or equal to 2.7, and always latest JRuby and Truffleruby.
Note: This gem is tested against all latest patch versions, i.e. if you're using 3.3.0 and you experience some issue, please test it against 3.3.$latest before creating an issue.
Resources
Caveats
Versioning Policy
httpx follows Semantic Versioning.
Contributing
- Discuss your contribution in an issue
- Fork it
- Make your changes, add some tests
- Ensure all tests pass (
docker-compose -f docker-compose.yml -f docker-compose-ruby-{RUBY_VERSION}.yml run httpx bundle exec rake test) - Open a Merge Request (that's Pull Request in Github-ish)
- Wait for feedback