Class: Aws::Plugins::Retries::ClientRateLimiter Private

Inherits:
Object
  • Object
show all
Defined in:
lib/aws-sdk-core/plugins/retries/client_rate_limiter.rb

Overview

This class is part of a private API. You should avoid using this class if possible, as it may be removed or be changed in the future.

Used only in ‘adaptive’ retry mode

API:

  • private

Constant Summary collapse

MIN_CAPACITY =

This constant is part of a private API. You should avoid using this constant if possible, as it may be removed or be changed in the future.

API:

  • private

1
MIN_FILL_RATE =

This constant is part of a private API. You should avoid using this constant if possible, as it may be removed or be changed in the future.

API:

  • private

0.5
SMOOTH =

This constant is part of a private API. You should avoid using this constant if possible, as it may be removed or be changed in the future.

API:

  • private

0.8
BETA =

This constant is part of a private API. You should avoid using this constant if possible, as it may be removed or be changed in the future.

How much to scale back after a throttling response

API:

  • private

0.7
SCALE_CONSTANT =

This constant is part of a private API. You should avoid using this constant if possible, as it may be removed or be changed in the future.

Controls how aggressively we scale up after being throttled

API:

  • private

0.4

Instance Method Summary collapse

Constructor Details

#initialize ⇒ ClientRateLimiter

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.

Returns a new instance of ClientRateLimiter.

API:

  • private



17
18
19
20
21
22
23
24
25
26
27
28
29
30
 
# File 'lib/aws-sdk-core/plugins/retries/client_rate_limiter.rb', line 17

def initialize
  @mutex                = Mutex.new
  @fill_rate            = nil
  @max_capacity         = nil
  @current_capacity     = 0
  @last_timestamp       = nil
  @enabled              = false
  @measured_tx_rate     = 0
  @last_tx_rate_bucket  = Aws::Util.monotonic_seconds
  @request_count        = 0
  @last_max_rate        = 0
  @last_throttle_time   = Aws::Util.monotonic_seconds
  @calculated_rate      = nil
end

Instance Method Details

#token_bucket_acquire(amount, wait_to_fill = true) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.

API:

  • private



32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
 
# File 'lib/aws-sdk-core/plugins/retries/client_rate_limiter.rb', line 32

def token_bucket_acquire(amount, wait_to_fill = true)
  # Client side throttling is not enabled until we see a
  # throttling error
  return unless @enabled

  @mutex.synchronize do
    token_bucket_refill

    # Next see if we have enough capacity for the requested amount
    while @current_capacity < amount
      raise Aws::Errors::RetryCapacityNotAvailableError unless wait_to_fill
      @mutex.sleep((amount - @current_capacity) / @fill_rate)
      token_bucket_refill
    end
    @current_capacity -= amount
  end
end

#update_sending_rate(is_throttling_error) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.

API:

  • private



50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
 
# File 'lib/aws-sdk-core/plugins/retries/client_rate_limiter.rb', line 50

def update_sending_rate(is_throttling_error)
  @mutex.synchronize do
    update_measured_rate

    if is_throttling_error
      rate_to_use = if @enabled
                      [@measured_tx_rate, @fill_rate].min
                    else
                      @measured_tx_rate
                    end

      # The fill_rate is from the token bucket
      @last_max_rate = rate_to_use
      calculate_time_window
      @last_throttle_time = Aws::Util.monotonic_seconds
      @calculated_rate = cubic_throttle(rate_to_use)
      enable_token_bucket
    else
      calculate_time_window
      @calculated_rate = cubic_success(Aws::Util.monotonic_seconds)
    end

    new_rate = [@calculated_rate, 2 * @measured_tx_rate].min
    token_bucket_update_rate(new_rate)
  end
end