Class: Puppet::Transaction::Report

Inherits:
Object
  • Object
show all
Extended by:
Indirector
Includes:
Util::PsychSupport
Defined in:
lib/puppet/transaction/report.rb

Overview

This class is used to report what happens on a client. There are two types of data in a report; Logs and Metrics.

  • Logs - are the output that each change produces.

  • Metrics - are all of the numerical data involved in the transaction.

Use Reports class to create a new custom report type. This class is indirectly used as a source of data to report in such a registered report.

##Metrics There are three types of metrics in each report, and each type of metric has one or more values.

  • Time: Keeps track of how long things took.

    • Total: Total time for the configuration run

    • File:

    • Exec:

    • User:

    • Group:

    • Config Retrieval: How long the configuration took to retrieve

    • Service:

    • Package:

  • Resources: Keeps track of the following stats:

    • Total: The total number of resources being managed

    • Skipped: How many resources were skipped, because of either tagging or scheduling restrictions

    • Scheduled: How many resources met any scheduling restrictions

    • Out of Sync: How many resources were out of sync

    • Applied: How many resources were attempted to be fixed

    • Failed: How many resources were not successfully fixed

    • Restarted: How many resources were restarted because their dependencies changed

    • Failed Restarts: How many resources could not be restarted

  • Changes: The total number of changes in the transaction.

Defined Under Namespace

Classes: Json, Msgpack, Processor, Rest, Yaml

Constant Summary collapse

STATES_FOR_EXCLUSION_FROM_REPORT = 
[:failed, :failed_to_restart, :out_of_sync, :skipped].freeze
TOTAL = 
"total".freeze

Constants included from Indirector

Indirector::BadNameRegexp

Instance Attribute Summary collapse

Class Method Summary collapse

Instance Method Summary collapse

Methods included from Indirector

configure_routes, indirects

Methods included from Util::PsychSupport

#encode_with, #init_with

Constructor Details

#initialize(configuration_version = nil, environment = nil, transaction_uuid = nil, job_id = nil, start_time = Time.now) ⇒ Report

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.

Returns a new instance of Report.



225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
 
# File 'lib/puppet/transaction/report.rb', line 225

def initialize(configuration_version=nil, environment=nil, transaction_uuid=nil, job_id=nil, start_time=Time.now)
  @metrics = {}
  @logs = []
  @resource_statuses = {}
  @external_times ||= {}
  @host = Puppet[:node_name_value]
  @time = start_time
  @report_format = 12
  @puppet_version = Puppet.version
  @configuration_version = configuration_version
  @transaction_uuid = transaction_uuid
  @code_id = nil
  @job_id = job_id
  @catalog_uuid = nil
  @cached_catalog_status = nil
  @server_used = nil
  @environment = environment
  @status = 'failed' # assume failed until the report is finalized
  @noop = Puppet[:noop]
  @noop_pending = false
  @corrective_change = false
  @transaction_completed = false
end

Instance Attribute Details

#cached_catalog_status ⇒ String

Whether a cached catalog was used in the run, and if so, the reason that it was used. or ‘on_failure’

Returns:

  • (String) —

    One of the values: ‘not_used’, ‘explicitly_requested’,



65
66
67
 
# File 'lib/puppet/transaction/report.rb', line 65

def cached_catalog_status
  @cached_catalog_status
end

#catalog_uuid ⇒ Object

A master generated catalog uuid, useful for connecting a single catalog to multiple reports.



60
61
62
 
# File 'lib/puppet/transaction/report.rb', line 60

def catalog_uuid
  @catalog_uuid
end

#code_id ⇒ Object

The id of the code input to the compiler.



54
55
56
 
# File 'lib/puppet/transaction/report.rb', line 54

def code_id
  @code_id
end

#configuration_version ⇒ ???

TODO:

Uncertain what this is?

The version of the configuration

Returns:

  • (???) —

    the configuration version



47
48
49
 
# File 'lib/puppet/transaction/report.rb', line 47

def configuration_version
  @configuration_version
end

#corrective_change ⇒ Object (readonly) 



131
132
133
 
# File 'lib/puppet/transaction/report.rb', line 131

def corrective_change
  @corrective_change
end

#environment ⇒ String

The name of the environment the host is in

Returns:

  • (String) —

    the environment name



77
78
79
 
# File 'lib/puppet/transaction/report.rb', line 77

def environment
  @environment
end

#host ⇒ String

The host name for which the report is generated

Returns:

  • (String) —

    the host name



73
74
75
 
# File 'lib/puppet/transaction/report.rb', line 73

def host
  @host
end

#initial_environment ⇒ String

The name of the environment the agent initially started in

Returns:

  • (String) —

    the environment name



81
82
83
 
# File 'lib/puppet/transaction/report.rb', line 81

def initial_environment
  @initial_environment
end

#job_id ⇒ Object

The id of the job responsible for this run.



57
58
59
 
# File 'lib/puppet/transaction/report.rb', line 57

def job_id
  @job_id
end

#logs ⇒ Array<Puppet::Util::Log> (readonly)

A list of log messages.

Returns:



94
95
96
 
# File 'lib/puppet/transaction/report.rb', line 94

def logs
  @logs
end

#metrics ⇒ Hash<{String => Object}> (readonly)

TODO:

Uncertain if all values are numbers - now marked as Object.

A hash of metric name to metric value.

Returns:

  • (Hash<{String => Object}>) —

    A map of metric name to value.



100
101
102
 
# File 'lib/puppet/transaction/report.rb', line 100

def metrics
  @metrics
end

#noop ⇒ Boolean (readonly)

Whether the puppet run was started in noop mode

Returns:

  • (Boolean) 


126
127
128
 
# File 'lib/puppet/transaction/report.rb', line 126

def noop
  @noop
end

#noop_pending ⇒ Boolean

Whether there are changes that we decided not to apply because of noop

Returns:

  • (Boolean) 


86
87
88
 
# File 'lib/puppet/transaction/report.rb', line 86

def noop_pending
  @noop_pending
end

#puppet_version ⇒ String (readonly)

Returns The Puppet version in String form.

Returns:

  • (String) —

    The Puppet version in String form.

See Also:

  • version()


115
116
117
 
# File 'lib/puppet/transaction/report.rb', line 115

def puppet_version
  @puppet_version
end

#report_format ⇒ Integer (readonly)

Returns report format version number. This value is constant for a given version of Puppet; it is incremented when a new release of Puppet changes the API for the various objects that make up a report.

Returns:

  • (Integer) —

    report format version number. This value is constant for a given version of Puppet; it is incremented when a new release of Puppet changes the API for the various objects that make up a report.



121
122
123
 
# File 'lib/puppet/transaction/report.rb', line 121

def report_format
  @report_format
end

#resource_statuses ⇒ Hash{String => Puppet::Resource::Status} (readonly)

A hash with a map from resource to status

Returns:



90
91
92
 
# File 'lib/puppet/transaction/report.rb', line 90

def resource_statuses
  @resource_statuses
end

#resources_failed_to_generate ⇒ Boolean

Returns true if one or more resources attempted to generate resources and failed.

Returns:

  • (Boolean) —

    true if one or more resources attempted to generate resources and failed



136
137
138
 
# File 'lib/puppet/transaction/report.rb', line 136

def resources_failed_to_generate
  @resources_failed_to_generate
end

#server_used ⇒ String

Contains the name and port of the server that was successfully contacted

Returns:

  • (String) —

    a string of the format ‘servername:port’



69
70
71
 
# File 'lib/puppet/transaction/report.rb', line 69

def server_used
  @server_used
end

#status ⇒ String (readonly)

The status of the client run is an enumeration: ‘failed’, ‘changed’ or ‘unchanged’

Returns:

  • (String) —

    the status of the run - one of the values ‘failed’, ‘changed’, or ‘unchanged’



110
111
112
 
# File 'lib/puppet/transaction/report.rb', line 110

def status
  @status
end

#time ⇒ Time (readonly)

The time when the report data was generated.

Returns:

  • (Time) —

    A time object indicating when the report data was generated



105
106
107
 
# File 'lib/puppet/transaction/report.rb', line 105

def time
  @time
end

#transaction_completed ⇒ Boolean

Returns true if the transaction completed it’s evaluate.

Returns:

  • (Boolean) —

    true if the transaction completed it’s evaluate



140
141
142
 
# File 'lib/puppet/transaction/report.rb', line 140

def transaction_completed
  @transaction_completed
end

#transaction_uuid ⇒ String

An agent generated transaction uuid, useful for connecting catalog and report

Returns:

  • (String) —

    uuid



51
52
53
 
# File 'lib/puppet/transaction/report.rb', line 51

def transaction_uuid
  @transaction_uuid
end

Class Method Details

.from_data_hash(data) ⇒ Object 



144
145
146
147
148
 
# File 'lib/puppet/transaction/report.rb', line 144

def self.from_data_hash(data)
  obj = self.allocate
  obj.initialize_from_hash(data)
  obj
end

Instance Method Details

#<<(msg) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



155
156
157
158
 
# File 'lib/puppet/transaction/report.rb', line 155

def <<(msg)
  @logs << msg
  self
end

#add_metric(name, hash) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



170
171
172
173
174
175
176
177
178
179
 
# File 'lib/puppet/transaction/report.rb', line 170

def add_metric(name, hash)
  metric = Puppet::Util::Metric.new(name)

  hash.each do |metric_name, value|
    metric.newvalue(metric_name, value)
  end

  @metrics[metric.name] = metric
  metric
end

#add_resource_status(status) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



182
183
184
 
# File 'lib/puppet/transaction/report.rb', line 182

def add_resource_status(status)
  @resource_statuses[status.resource] = status
end

#add_times(name, value, accumulate = true) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



161
162
163
164
165
166
167
 
# File 'lib/puppet/transaction/report.rb', line 161

def add_times(name, value, accumulate = true)
  if @external_times[name] && accumulate
    @external_times[name] += value
  else
    @external_times[name] = value
  end
end

#as_logging_destination(&block) ⇒ Object 



150
151
152
 
# File 'lib/puppet/transaction/report.rb', line 150

def as_logging_destination(&block)
  Puppet::Util::Log.with_destination(self, &block)
end

#calculate_resource_statuses ⇒ Object 



319
320
321
322
323
324
325
326
 
# File 'lib/puppet/transaction/report.rb', line 319

def calculate_resource_statuses
  resource_statuses = if Puppet[:exclude_unchanged_resources]
                        @resource_statuses.reject { |_key, rs| resource_unchanged?(rs) }
                      else
                        @resource_statuses
                      end
  Hash[resource_statuses.map { |key, rs| [key, rs.nil? ? nil : rs.to_data_hash] }]
end

#compute_status(resource_metrics, change_metric) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



187
188
189
190
191
192
193
194
195
196
197
198
 
# File 'lib/puppet/transaction/report.rb', line 187

def compute_status(resource_metrics, change_metric)
  if resources_failed_to_generate ||
     !transaction_completed ||
     (resource_metrics["failed"] || 0) > 0 ||
     (resource_metrics["failed_to_restart"] || 0) > 0
    'failed'
  elsif change_metric > 0
    'changed'
  else
    'unchanged'
  end
end

#exit_status ⇒ Integer

Computes a single number that represents the report’s status. The computation is based on the contents of this report’s metrics. The resulting number is a bitmask where individual bits represent the presence of different metrics.

  • 0x2 set if there are changes

  • 0x4 set if there are resource failures or resources that failed to restart

Returns:

  • (Integer) —

    A bitmask where 0x2 is set if there are changes, and 0x4 is set of there are failures.



433
434
435
436
437
438
439
440
441
442
443
444
445
 
# File 'lib/puppet/transaction/report.rb', line 433

def exit_status
  status = 0
  if @metrics["changes"] && @metrics["changes"][TOTAL] &&
      @metrics["resources"] && @metrics["resources"]["failed"] &&
      @metrics["resources"]["failed_to_restart"]
    status |= 2 if @metrics["changes"][TOTAL] > 0
    status |= 4 if @metrics["resources"]["failed"] > 0
    status |= 4 if @metrics["resources"]["failed_to_restart"] > 0
  else
    status = -1
  end
  status
end

#finalize_report ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



211
212
213
214
215
216
217
218
219
220
221
222
 
# File 'lib/puppet/transaction/report.rb', line 211

def finalize_report
  prune_internal_data
  calculate_report_corrective_change

  resource_metrics = add_metric(:resources, calculate_resource_metrics)
  add_metric(:time, calculate_time_metrics)
  change_metric = calculate_change_metric
  add_metric(:changes, {TOTAL => change_metric})
  add_metric(:events, calculate_event_metrics)
  @status = compute_status(resource_metrics, change_metric)
  @noop_pending = @resource_statuses.any? { |name,res| has_noop_events?(res) }
end

#has_noop_events?(resource) ⇒ Boolean

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.

Returns:

  • (Boolean) 


201
202
203
 
# File 'lib/puppet/transaction/report.rb', line 201

def has_noop_events?(resource)
  resource.events.any? { |event| event.status == 'noop' }
end

#initialize_from_hash(data) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
 
# File 'lib/puppet/transaction/report.rb', line 250

def initialize_from_hash(data)
  @puppet_version = data['puppet_version']
  @report_format = data['report_format']
  @configuration_version = data['configuration_version']
  @transaction_uuid = data['transaction_uuid']
  @environment = data['environment']
  @status = data['status']
  @transaction_completed = data['transaction_completed']
  @noop = data['noop']
  @noop_pending = data['noop_pending']
  @host = data['host']
  @time = data['time']
  @corrective_change = data['corrective_change']

  if data['server_used']
    @server_used = data['server_used']
  elsif data['master_used']
    @server_used = data['master_used']
  end

  if data['catalog_uuid']
    @catalog_uuid = data['catalog_uuid']
  end

  if data['job_id']
    @job_id = data['job_id']
  end

  if data['code_id']
    @code_id = data['code_id']
  end

  if data['cached_catalog_status']
    @cached_catalog_status = data['cached_catalog_status']
  end

  if @time.is_a? String
    @time = Time.parse(@time)
  end

  @metrics = {}
  data['metrics'].each do |name, hash|
    # Older versions contain tags that causes Psych to create instances directly
    @metrics[name] = hash.is_a?(Puppet::Util::Metric) ? hash : Puppet::Util::Metric.from_data_hash(hash)
  end

  @logs = data['logs'].map do |record|
    # Older versions contain tags that causes Psych to create instances directly
    record.is_a?(Puppet::Util::Log) ? record : Puppet::Util::Log.from_data_hash(record)
  end

  @resource_statuses = {}
  data['resource_statuses'].map do |key, rs|
    @resource_statuses[key] = if rs == Puppet::Resource::EMPTY_HASH
      nil
    else
      # Older versions contain tags that causes Psych to create instances directly
      rs.is_a?(Puppet::Resource::Status) ? rs : Puppet::Resource::Status.from_data_hash(rs)
    end
  end
end

#name ⇒ String

Returns the host name.

Returns:

  • (String) —

    the host name



359
360
361
 
# File 'lib/puppet/transaction/report.rb', line 359

def name
  host
end

#prune_internal_data ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future. 



206
207
208
 
# File 'lib/puppet/transaction/report.rb', line 206

def prune_internal_data
  resource_statuses.delete_if {|name,res| res.resource_type == 'Whit'}
end

#raw_summary ⇒ Hash<{String => Object}>

Provides a raw hash summary of this report.

Returns:

  • (Hash<{String => Object}>) —

    A hash with metrics key to value map



398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
 
# File 'lib/puppet/transaction/report.rb', line 398

def raw_summary
  report = {
    "version" => {
      "config" => configuration_version,
      "puppet" => Puppet.version
    },
    "application" => {
      "run_mode" => Puppet.run_mode.name.to_s,
      "initial_environment" => initial_environment,
      "converged_environment" => environment
    }
  }

  @metrics.each do |name, metric|
    key = metric.name.to_s
    report[key] = {}
    metric.values.each do |metric_name, label, value|
      report[key][metric_name.to_s] = value
    end
    report[key][TOTAL] = 0 unless key == "time" or report[key].include?(TOTAL)
  end
  (report["time"] ||= {})["last_run"] = Time.now.tv_sec
  report
end

#resource_unchanged?(rs) ⇒ Boolean

Returns:

  • (Boolean) 


312
313
314
315
316
317
 
# File 'lib/puppet/transaction/report.rb', line 312

def resource_unchanged?(rs)
  STATES_FOR_EXCLUSION_FROM_REPORT.each do |state|
    return false if rs.send(state)
  end
  true
end

#summary ⇒ String

Note:

This is intended for debugging purposes

Provide a human readable textual summary of this report.

Returns:

  • (String) —

    A string with a textual summary of this report.



368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
 
# File 'lib/puppet/transaction/report.rb', line 368

def summary
  report = raw_summary

  ret = ""
  report.keys.sort_by(&:to_s).each do |key|
    ret += "#{Puppet::Util::Metric.labelize(key)}:\n"

    report[key].keys.sort { |a,b|
      # sort by label
      if a == TOTAL
        1
      elsif b == TOTAL
        -1
      else
        report[key][a].to_s <=> report[key][b].to_s
      end
    }.each do |label|
      value = report[key][label]
      next if value == 0
      value = "%0.2f" % value if value.is_a?(Float)
      ret += "   %15s %s\n" % [Puppet::Util::Metric.labelize(label) + ":", value]
    end
  end
  ret
end

#to_data_hash ⇒ Object 



328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
 
# File 'lib/puppet/transaction/report.rb', line 328

def to_data_hash
  hash = {
    'host' => @host,
    'time' => @time.iso8601(9),
    'configuration_version' => @configuration_version,
    'transaction_uuid' => @transaction_uuid,
    'report_format' => @report_format,
    'puppet_version' => @puppet_version,
    'status' => @status,
    'transaction_completed' => @transaction_completed,
    'noop' => @noop,
    'noop_pending' => @noop_pending,
    'environment' => @environment,
    'logs' => @logs.map { |log| log.to_data_hash },
    'metrics' => Hash[@metrics.map { |key, metric| [key, metric.to_data_hash] }],
    'resource_statuses' => calculate_resource_statuses,
    'corrective_change' => @corrective_change,
  }

  # The following is include only when set
  hash['server_used'] = @server_used unless @server_used.nil?
  hash['catalog_uuid'] = @catalog_uuid unless @catalog_uuid.nil?
  hash['code_id'] = @code_id unless @code_id.nil?
  hash['job_id'] = @job_id unless @job_id.nil?
  hash['cached_catalog_status'] = @cached_catalog_status unless @cached_catalog_status.nil?
  hash
end