Class: RightScale::CloudApi::RetryManager

Inherits:
Routine show all
Defined in:
lib/base/routines/retry_manager.rb

Overview

The routine is responsible for retries/reiterations.

If retries are enabled then a singe API call may perform upto DEFAULT_RETRY_COUNT request attempts who may take upto DEFAULT_REITERATION_TIME secsons.

Defined Under Namespace

Classes: Error

Constant Summary collapse

DEFAULT_RETRY_COUNT = 
2
DEFAULT_REITERATION_TIME = 
10
DEFAULT_SLEEP_TIME = 
0.2

Instance Attribute Summary

Attributes inherited from Routine

#data

Instance Method Summary collapse

Methods inherited from Routine

#cloud_api_logger, #execute, #invoke_callback_method, #options, #reset, #with_timer

Instance Method Details

#process ⇒ Object

Retries manager.

The manager usually takes the very first position in routines chain. It just increments its counters if we did not reach a possible count of retries or complains if there are no attempts left or if API request time is over.

There are 2 possible reasons for a retry to be performed:

1. There was a redirect request (HTTP 3xx code)
2. There was an error (HTTP 5xx, 4xx) and



50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
 
# File 'lib/base/routines/retry_manager.rb', line 50

def process
  retry_options    = data[:options][:retry]           || {}
  max_retry_count  = retry_options[:count]            || DEFAULT_RETRY_COUNT
  reiteration_time = retry_options[:reiteration_time] || DEFAULT_REITERATION_TIME
  sleep_time       = retry_options[:sleep_time]       || DEFAULT_SLEEP_TIME
  
  # Initialize things on the first run for the current request.
  unless data[:vars][:retry]
    data[:vars][:retry]              = {}
    data[:vars][:retry][:count]      = 0
    data[:vars][:retry][:sleep_time] = 0
    # if body is a IO object - remember its initial position in a file
    data[:vars][:retry][:orig_body_stream_pos] = data[:request][:body].is_a?(IO) && data[:request][:body].pos
  else
    # Increment retry attempts count
    data[:vars][:retry][:count] += 1
  end
  
  # Complain on any issue
  if max_retry_count < @data[:vars][:retry][:count]
    error_message = "RetryManager: No more retries left."
  elsif Time.now > @data[:vars][:system][:started_at] + reiteration_time
    error_message = "RetryManager: Retry timeout of #{reiteration_time} seconds has been reached."
  end

  # Raise exception if request runs out-of-time or attempts.
  if error_message
    http_data     = @data[:vars][:retry][:http]
    http_code     = http_data && http_data[:code]
    http_message  = http_data && http_data[:message]
    error_message = "#{http_message}\n#{error_message}" if http_message
    raise Error::new(http_code, error_message)
  end

  # Continue (with a delay when needed)
  if data[:vars][:retry][:sleep_time] > 0
    cloud_api_logger.log("Sleeping for #{data[:vars][:retry][:sleep_time]} seconds before retry attempt ##{data[:vars][:retry][:count]}", :retry_manager)
    sleep data[:vars][:retry][:sleep_time]
    data[:vars][:retry][:sleep_time] *= 2
  else
    data[:vars][:retry][:sleep_time] = sleep_time
  end
  
  # Restore file pointer in IO body case.
  if data[:request][:instance]                          &&
     data[:request][:instance].is_io?                   &&
     data[:request][:instance].body.respond_to?('pos')  &&
     data[:request][:instance].body.respond_to?('pos=') &&
     data[:request][:instance].body.pos != data[:vars][:retry][:orig_body_stream_pos]
    cloud_api_logger.log("Restoring file position to #{data[:vars][:retry][:orig_body_stream_pos]}", :retry_manager)
    data[:request][:instance].body.pos = data[:vars][:retry][:orig_body_stream_pos]
  end
end