Class: Gitlab::ExclusiveLease

Inherits:
Object
  • Object
show all
Defined in:
lib/gitlab/exclusive_lease.rb

Overview

This class implements an ‘exclusive lease’. We call it a ‘lease’ because it has a set expiry time. We call it ‘exclusive’ because only one caller may obtain a lease for a given key at a time. The implementation is intended to work across GitLab processes and across servers. It is a cheap alternative to using SQL queries and updates: you do not need to change the SQL schema to start using ExclusiveLease.

Constant Summary collapse

PREFIX = 
'gitlab:exclusive_lease'
NoKey = 
Class.new(ArgumentError)
LUA_CANCEL_SCRIPT = 
<<~EOS
  local key, uuid = KEYS[1], ARGV[1]
  if redis.call("get", key) == uuid then
    redis.call("del", key)
  end
EOS
LUA_RENEW_SCRIPT = 
<<~EOS
  local key, uuid, ttl = KEYS[1], ARGV[1], ARGV[2]
  if redis.call("get", key) == uuid then
    redis.call("expire", key, ttl)
    return uuid
  end
EOS

Class Method Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(key, uuid: nil, timeout:) ⇒ ExclusiveLease

Returns a new instance of ExclusiveLease.



89
90
91
92
93
 
# File 'lib/gitlab/exclusive_lease.rb', line 89

def initialize(key, uuid: nil, timeout:)
  @redis_shared_state_key = self.class.redis_shared_state_key(key)
  @timeout = timeout
  @uuid = uuid || SecureRandom.uuid
end

Class Method Details

.cancel(key, uuid) ⇒ Object 



61
62
63
64
65
66
67
 
# File 'lib/gitlab/exclusive_lease.rb', line 61

def self.cancel(key, uuid)
  return unless key.present?

  Gitlab::Redis::SharedState.with do |redis|
    redis.eval(LUA_CANCEL_SCRIPT, keys: [ensure_prefixed_key(key)], argv: [uuid])
  end
end

.ensure_prefixed_key(key) ⇒ Object

Raises:



73
74
75
76
77
 
# File 'lib/gitlab/exclusive_lease.rb', line 73

def self.ensure_prefixed_key(key)
  raise NoKey unless key.present?

  key.start_with?(PREFIX) ? key : redis_shared_state_key(key)
end

.get_uuid(key) ⇒ Object 



33
34
35
36
37
 
# File 'lib/gitlab/exclusive_lease.rb', line 33

def self.get_uuid(key)
  Gitlab::Redis::SharedState.with do |redis|
    redis.get(redis_shared_state_key(key)) || false
  end
end

.redis_shared_state_key(key) ⇒ Object 



69
70
71
 
# File 'lib/gitlab/exclusive_lease.rb', line 69

def self.redis_shared_state_key(key)
  "#{PREFIX}:#{key}"
end

.reset_all!(scope = '*') ⇒ Object

Removes any existing exclusive_lease from redis Don’t run this in a live system without making sure no one is using the leases



81
82
83
84
85
86
87
 
# File 'lib/gitlab/exclusive_lease.rb', line 81

def self.reset_all!(scope = '*')
  Gitlab::Redis::SharedState.with do |redis|
    redis.scan_each(match: redis_shared_state_key(scope)).each do |key|
      redis.del(key)
    end
  end
end

.throttle(key, group: nil, period: 1.hour, count: 1, &block) ⇒ Object

yield to the block at most count times per period

Defaults to once per hour.

For example:

# toot the train horn at most every 20min:
throttle(locomotive.id, count: 3, period: 1.hour) { toot_train_horn }
# Brake suddenly at most once every minute:
throttle(locomotive.id, period: 1.minute) { brake_suddenly }
# Specify a uniqueness group:
throttle(locomotive.id, group: :locomotive_brake) { brake_suddenly }

If a group is not specified, each block will get a separate group to itself.



53
54
55
56
57
58
59
 
# File 'lib/gitlab/exclusive_lease.rb', line 53

def self.throttle(key, group: nil, period: 1.hour, count: 1, &block)
  group ||= block.source_location.join(':')

  return if new("el:throttle:#{group}:#{key}", timeout: period.to_i / count).waiting?

  yield
end

Instance Method Details

#cancel ⇒ Object

Gives up this lease, allowing it to be obtained by others.



137
138
139
 
# File 'lib/gitlab/exclusive_lease.rb', line 137

def cancel
  self.class.cancel(@redis_shared_state_key, @uuid)
end

#exists? ⇒ Boolean

Returns true if the key for this lease is set.

Returns:

  • (Boolean) 


119
120
121
122
123
 
# File 'lib/gitlab/exclusive_lease.rb', line 119

def exists?
  Gitlab::Redis::SharedState.with do |redis|
    redis.exists?(@redis_shared_state_key) # rubocop:disable CodeReuse/ActiveRecord
  end
end

#renew ⇒ Object

Try to renew an existing lease. Return lease UUID on success, false if the lease is taken by a different UUID or inexistent.



111
112
113
114
115
116
 
# File 'lib/gitlab/exclusive_lease.rb', line 111

def renew
  Gitlab::Redis::SharedState.with do |redis|
    result = redis.eval(LUA_RENEW_SCRIPT, keys: [@redis_shared_state_key], argv: [@uuid, @timeout])
    result == @uuid
  end
end

#try_obtain ⇒ Object

Try to obtain the lease. Return lease UUID on success, false if the lease is already taken.



97
98
99
100
101
102
 
# File 'lib/gitlab/exclusive_lease.rb', line 97

def try_obtain
  # Performing a single SET is atomic
  Gitlab::Redis::SharedState.with do |redis|
    redis.set(@redis_shared_state_key, @uuid, nx: true, ex: @timeout) && @uuid
  end
end

#ttl ⇒ Object

Returns the TTL of the Redis key.

This method will return ‘nil` if no TTL could be obtained.



128
129
130
131
132
133
134
 
# File 'lib/gitlab/exclusive_lease.rb', line 128

def ttl
  Gitlab::Redis::SharedState.with do |redis|
    ttl = redis.ttl(@redis_shared_state_key)

    ttl if ttl > 0
  end
end

#waiting? ⇒ Boolean

This lease is waiting to obtain

Returns:

  • (Boolean) 


105
106
107
 
# File 'lib/gitlab/exclusive_lease.rb', line 105

def waiting?
  !try_obtain
end