Class: Vanity::Playground

Inherits:
Object
  • Object
show all
Defined in:
lib/vanity/playground.rb

Overview

Playground catalogs all your experiments, holds the Vanity configuration.

Examples:

Vanity.playground.logger = my_logger
puts Vanity.playground.map(&:name)

Constant Summary

DEFAULTS =
{ :collecting => true, :load_path=>"experiments" }
DEFAULT_ADD_PARTICIPANT_PATH =
'/vanity/add_participant'

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(*args) ⇒ Playground

Created new Playground. Unless you need to, use the global Vanity.playground.

First argument is connection specification (see #redis=), last argument is a set of options, both are optional. Supported options are:

  • connection – Connection specification

  • load_path – Path to load experiments/metrics from

  • logger – Logger to use

  • redis – A Redis object that will be used for the connection



24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
# File 'lib/vanity/playground.rb', line 24

def initialize(*args)
  options = Hash === args.last ? args.pop : {}
  # In the case of Rails, use the Rails logger and collect only for
  # production environment by default.
  defaults = options[:rails] ? DEFAULTS.merge(:collecting => true, :logger => ::Rails.logger) : DEFAULTS
  if config_file_exists?
    env = ENV["RACK_ENV"] || ENV["RAILS_ENV"] || "development"
    config = load_config_file[env]
    if Hash === config
      config = config.inject({}) { |h,kv| h[kv.first.to_sym] = kv.last ; h }
    else
      config = { :connection=>config }
    end
  else
    config = {}
  end

  @options = defaults.merge(config).merge(options)

  @load_path = @options[:load_path] || DEFAULTS[:load_path]

  I18n.load_path += locale_file_paths
  unless @logger = @options[:logger]
    @logger = Logger.new(STDOUT)
    @logger.level = Logger::ERROR
  end

  autoconnect(@options, args) if Vanity::Autoconnect.playground_should_autoconnect?

  @loading = []
  @use_js = false
  @failover_on_datastore_error = false
  self.add_participant_path = DEFAULT_ADD_PARTICIPANT_PATH
  @collecting = !!@options[:collecting]
end

Instance Attribute Details

#add_participant_pathObject

Path to the add_participant action.



67
68
69
# File 'lib/vanity/playground.rb', line 67

def add_participant_path
  @add_participant_path
end

#custom_templates_pathObject



75
76
77
# File 'lib/vanity/playground.rb', line 75

def custom_templates_path
  @custom_templates_path ||= (File.expand_path(File.join(::Rails.root, 'app', 'views', 'vanity')) if defined?(::Rails))
end

#load_pathObject

Path to load experiment files from.



61
62
63
# File 'lib/vanity/playground.rb', line 61

def load_path
  @load_path
end

#loggerObject

Logger.



64
65
66
# File 'lib/vanity/playground.rb', line 64

def logger
  @logger
end

#on_datastore_errorObject

Must return a Proc that accepts as parameters: the thrown error, the calling Class, the calling method, and an array of arguments passed to the calling method. The return value is ignored.

Proc.new do |error, klass, method, arguments|
  ...
end

The default implementation logs this information to Playground#logger.

Set a custom action by calling Vanity.playground.on_datastore_error = Proc.new { … }.

Since:

  • 1.9.0



166
167
168
# File 'lib/vanity/playground.rb', line 166

def on_datastore_error
  @on_datastore_error
end

#request_filterObject

Must return a Proc that accepts as a parameter the request object, if made available by the implement framework. The return value should be a boolean whether to ignore the request. This is called only for the JS callback action.

Proc.new do |request|
  ...
end

The default implementation does a simple test of whether the request's HTTP_USER_AGENT header contains a URI, since well behaved bots typically include a reference URI in their user agent strings. (Original idea: stackoverflow.com/a/9285889.)

Alternatively, one could filter an explicit list of IPs, add additional user agent strings to filter, or any custom test. Set a custom filter by calling Vanity.playground.request_filter = Proc.new { … }.

Since:

  • 1.9.0



204
205
206
# File 'lib/vanity/playground.rb', line 204

def request_filter
  @request_filter
end

Instance Method Details

#collecting=(enabled) ⇒ Object

Turns data collection on and off.

Since:

  • 1.4.0



272
273
274
# File 'lib/vanity/playground.rb', line 272

def collecting=(enabled)
  @collecting = !!enabled
end

#collecting?Boolean

True if collection data (metrics and experiments). You only want to collect data in production environment, everywhere else run with collection off.

Returns:

  • (Boolean)

Since:

  • 1.4.0



265
266
267
# File 'lib/vanity/playground.rb', line 265

def collecting?
  @collecting
end

#config_file_exists?(basename = "vanity.yml") ⇒ Boolean

Returns:

  • (Boolean)


371
372
373
# File 'lib/vanity/playground.rb', line 371

def config_file_exists?(basename = "vanity.yml")
  File.exists?(config_file_root + basename)
end

#config_file_rootObject



367
368
369
# File 'lib/vanity/playground.rb', line 367

def config_file_root
  (defined?(::Rails) ? ::Rails.root : Pathname.new(".")) + "config"
end

#connected?Boolean

Returns true if connection is open.

Returns:

  • (Boolean)

Since:

  • 1.4.0



394
395
396
# File 'lib/vanity/playground.rb', line 394

def connected?
  @adapter && @adapter.active?
end

#connectionObject

Returns the current connection. Establishes new connection is necessary.

Since:

  • 1.4.0



387
388
389
# File 'lib/vanity/playground.rb', line 387

def connection
  @adapter || establish_connection
end

#disconnect!Object

Closes the current connection.

Since:

  • 1.4.0



401
402
403
# File 'lib/vanity/playground.rb', line 401

def disconnect!
  @adapter.disconnect! if @adapter
end

#establish_connection(spec = nil) ⇒ Object

This is the preferred way to programmatically create a new connection (or switch to a new connection). If no connection was established, the playground will create a new one by calling this method with no arguments.

With no argument, uses the connection specified in config/vanity.yml file for the current environment (RACK_ENV, RAILS_ENV or development). If there is no config/vanity.yml file, picks the configuration from config/redis.yml, or defaults to Redis on localhost, port 6379.

If the argument is a symbol, uses the connection specified in config/vanity.yml for that environment. For example:

Vanity.playground.establish_connection :production

If the argument is a string, it is processed as a URL. For example:

Vanity.playground.establish_connection "redis://redis.local/5"

Otherwise, the argument is a hash and specifies the adapter name and any additional options understood by that adapter (as with config/vanity.yml). For example:

Vanity.playground.establish_connection :adapter=>:redis,
                                       :host=>"redis.local"

Since:

  • 1.4.0



335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
# File 'lib/vanity/playground.rb', line 335

def establish_connection(spec = nil)
  @spec = spec
  disconnect! if @adapter
  case spec
  when nil
    if config_file_exists?
      env = ENV["RACK_ENV"] || ENV["RAILS_ENV"] || "development"
      spec = load_config_file[env]
      fail "No configuration for #{env}" unless spec
      establish_connection spec
    elsif config_file_exists?("redis.yml")
      env = ENV["RACK_ENV"] || ENV["RAILS_ENV"] || "development"
      redis = load_config_file("redis.yml")[env]
      fail "No configuration for #{env}" unless redis
      establish_connection "redis://" + redis
    else
      establish_connection :adapter=>"redis"
    end
  when Symbol
    spec = load_config_file[spec.to_s]
    establish_connection spec
  when String
    uri = URI.parse(spec)
    params = CGI.parse(uri.query) if uri.query
    establish_connection :adapter=>uri.scheme, :username=>uri.user, :password=>uri.password,
      :host=>uri.host, :port=>uri.port, :path=>uri.path, :params=>params
  else
    spec = spec.inject({}) { |hash,(k,v)| hash[k.to_sym] = v ; hash }
    @adapter = Adapters.establish_connection(spec)
  end
end

#experiment(name) ⇒ Object

Returns the experiment. You may not have guessed, but this method raises an exception if it cannot load the experiment's definition.

See Also:



83
84
85
86
87
# File 'lib/vanity/playground.rb', line 83

def experiment(name)
  id = name.to_s.downcase.gsub(/\W/, "_").to_sym
  warn "Deprecated: please call experiment method with experiment identifier (a Ruby symbol)" unless id == name
  experiments[id.to_sym] or raise NoExperimentError, "No experiment #{id}"
end

#experimentsObject

Returns hash of experiments (key is experiment id). This create the Experiment and persists it to the datastore.

See Also:



222
223
224
225
226
227
228
229
230
231
# File 'lib/vanity/playground.rb', line 222

def experiments
  return @experiments if @experiments

  @experiments = {}
  @logger.info "Vanity: loading experiments from #{load_path}"
  Dir[File.join(load_path, "*.rb")].each do |file|
    Experiment::Base.load(self, @loading, file)
  end
  @experiments
end

#experiments_persisted?Boolean

Returns:

  • (Boolean)


233
234
235
# File 'lib/vanity/playground.rb', line 233

def experiments_persisted?
  experiments.keys.all? { |id| connection.experiment_persisted?(id) }
end

#failover_on_datastore_error!Object

Turns on passing of errors to the Proc returned by #on_datastore_error. Call Vanity.playground.failover_on_datastore_error! to turn this on.

Since:

  • 1.9.0



141
142
143
# File 'lib/vanity/playground.rb', line 141

def failover_on_datastore_error!
  @failover_on_datastore_error = true
end

#failover_on_datastore_error?Boolean

Returns whether to failover on an error raise by the datastore adapter.

Returns:

  • (Boolean)

Since:

  • 1.9.0



148
149
150
# File 'lib/vanity/playground.rb', line 148

def failover_on_datastore_error?
  @failover_on_datastore_error
end

#load!Object

Loads all metrics and experiments. Rails calls this during initialization.



247
248
249
250
# File 'lib/vanity/playground.rb', line 247

def load!
  experiments
  metrics
end

#load_config_file(basename = "vanity.yml") ⇒ Object



375
376
377
# File 'lib/vanity/playground.rb', line 375

def load_config_file(basename = "vanity.yml")
  YAML.load(ERB.new(File.read(config_file_root + basename)).result)
end

#locale_file_pathsObject



379
380
381
382
# File 'lib/vanity/playground.rb', line 379

def locale_file_paths
  locale_files_dir = File.expand_path('../../config/locales/', File.dirname(__FILE__))
  Dir[locale_files_dir+'/*.{rb,yml}']
end

#metric(id) ⇒ Object

Returns a metric (raises NameError if no metric with that identifier).

See Also:

Since:

  • 1.1.0



256
257
258
# File 'lib/vanity/playground.rb', line 256

def metric(id)
  metrics[id.to_sym] or raise NameError, "No metric #{id}"
end

#metricsObject

Returns hash of metrics (key is metric id).

See Also:

Since:

  • 1.1.0



280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
# File 'lib/vanity/playground.rb', line 280

def metrics
  unless @metrics
    @metrics = {}
    @logger.info "Vanity: loading metrics from #{load_path}/metrics"
    Dir[File.join(load_path, "metrics/*.rb")].each do |file|
      Metric.load self, @loading, file
    end
    if config_file_exists? && remote = load_config_file["metrics"]
      remote.each do |id, url|
        fail "Metric #{id} already defined in playground" if metrics[id.to_sym]
        metric = Metric.new(self, id)
        metric.remote url
        metrics[id.to_sym] = metric
      end
    end
  end
  @metrics
end

#participant_info(participant_id) ⇒ Object

Returns an array of all experiments this participant is involved in, with their assignment.

This is done as an array of arrays [[<experiment_1>, <assignment_1>], [<experiment_2>, <assignment_2>]], sorted by experiment name, so that it will give a consistent string
when converted to_s (so could be used for caching, for example)


95
96
97
98
99
100
101
102
103
104
# File 'lib/vanity/playground.rb', line 95

def participant_info(participant_id)
  participant_array = []
  experiments.values.sort_by(&:name).each do |e|
    index = connection.ab_assigned(e.id, participant_id)
    if index
      participant_array << [e, e.alternatives[index.to_i]]
    end
  end
  participant_array
end

#reconnect!Object

Closes the current connection and establishes a new one.

Since:

  • 1.3.0



408
409
410
# File 'lib/vanity/playground.rb', line 408

def reconnect!
  establish_connection(@spec)
end

#reload!Object

Reloads all metrics and experiments. Rails calls this for each request in development mode.



239
240
241
242
243
# File 'lib/vanity/playground.rb', line 239

def reload!
  @experiments = nil
  @metrics = nil
  load!
end

#track!(id, count = 1) ⇒ Object

Tracks an action associated with a metric.

Examples:

Vanity.playground.track! :uploaded_video

Since:

  • 1.1.0



305
306
307
# File 'lib/vanity/playground.rb', line 305

def track!(id, count = 1)
  metric(id).track! count
end

#use_js!Object

Call to indicate that participants should be added via js. This helps keep robots from participating in the A/B test and skewing results.

If you want to use this:

  • Add <%= vanity_js %> to any page that needs uses an ab_test. vanity_js needs to be included after your call to ab_test so that it knows which version of the experiment the participant is a member of. The helper will render nothing if the there are no ab_tests running on the current page, so adding vanity_js to the bottom of your layouts is a good option. Keep in mind that if you call use_js! and don't include vanity_js in your view no participants will be recorded.

Note that a custom JS callback path can be set using:

  • Set Vanity.playground.add_participant_path = '/path/to/vanity/action', this should point to the add_participant path that is added with Vanity::Rails::Dashboard, make sure that this action is available to all users.



126
127
128
# File 'lib/vanity/playground.rb', line 126

def use_js!
  @use_js = true
end

#using_js?Boolean

Returns:

  • (Boolean)


130
131
132
# File 'lib/vanity/playground.rb', line 130

def using_js?
  @use_js
end