Class: Zenrows::Backends::HttpRb

Inherits:
Base
  • Object
show all
Defined in:
lib/zenrows/backends/http_rb.rb

Overview

HTTP.rb backend adapter

Uses the http.rb gem to build configured HTTP clients that route through the ZenRows proxy.

Examples:

Basic usage

backend = Zenrows::Backends::HttpRb.new(proxy: proxy, config: config)
http = backend.build_client(js_render: true)
response = http.get(url)  # SSL context is auto-configured

Author:

  • Ernest Bursa

Since:

  • 0.1.0

Instance Attribute Summary

Attributes inherited from Base

#config, #hooks, #proxy

Instance Method Summary collapse

Methods inherited from Base

#calculate_timeouts, #initialize, #ssl_context, #wrap_client

Constructor Details

This class inherits a constructor from Zenrows::Backends::Base

Instance Method Details

#backend_name ⇒ Symbol

Returns Backend identifier.

Returns:

  • (Symbol) —

    Backend identifier

Since:

  • 0.1.0



61
62
63
 
# File 'lib/zenrows/backends/http_rb.rb', line 61

def backend_name
  :http_rb
end

#build_client(options = {}) ⇒ HTTP::Client, InstrumentedClient

Build a configured HTTP client

Parameters:

  • options (Hash) (defaults to: {}) —

    Request options

Options Hash (options):

  • :js_render (Boolean) —

    Enable JavaScript rendering

  • :premium_proxy (Boolean) —

    Use residential proxies

  • :proxy_country (String) —

    Country code

  • :wait (Boolean, Integer) —

    Wait time

  • :wait_for (String) —

    CSS selector to wait for

  • :headers (Hash) —

    Custom HTTP headers

Returns:

  • (HTTP::Client, InstrumentedClient) —

    Configured HTTP client (instrumented if hooks registered)

Since:

  • 0.1.0



31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
 
# File 'lib/zenrows/backends/http_rb.rb', line 31

def build_client(options = {})
  opts = options.dup
  headers = opts.delete(:headers) || {}

  # Enable custom_headers if we have headers
  opts[:custom_headers] = true if headers.any?

  # Get proxy configuration
  proxy_config = proxy.build(opts)

  # Calculate timeouts
  timeouts = calculate_timeouts(opts)

  # Build HTTP client with SSL context and proxy
  client = HTTP
    .timeout(connect: timeouts[:connect], read: timeouts[:read])
    .headers(headers)
    .via(
      proxy_config[:host],
      proxy_config[:port],
      proxy_config[:username],
      proxy_config[:password],
      ssl_context: ssl_context
    )

  # Wrap with instrumentation if hooks registered
  wrap_client(client, opts)
end