Class: Puppet::Transaction::Report

Inherits:
Object
  • Object
show all
Extended by:
Indirector
Includes:
Util::PsychSupport
Defined in:
lib/puppet/transaction/report.rb

Overview

This class is used to report what happens on a client. There are two types of data in a report; Logs and Metrics.

  • *Logs* - are the output that each change produces.

  • *Metrics* - are all of the numerical data involved in the transaction.

Use Reports class to create a new custom report type. This class is indirectly used as a source of data to report in such a registered report.

##Metrics There are three types of metrics in each report, and each type of metric has one or more values.

  • Time: Keeps track of how long things took.

    • Total: Total time for the configuration run

    • File:

    • Exec:

    • User:

    • Group:

    • Config Retrieval: How long the configuration took to retrieve

    • Service:

    • Package:

  • Resources: Keeps track of the following stats:

    • Total: The total number of resources being managed

    • Skipped: How many resources were skipped, because of either tagging or scheduling restrictions

    • Scheduled: How many resources met any scheduling restrictions

    • Out of Sync: How many resources were out of sync

    • Applied: How many resources were attempted to be fixed

    • Failed: How many resources were not successfully fixed

    • Restarted: How many resources were restarted because their dependencies changed

    • Failed Restarts: How many resources could not be restarted

  • Changes: The total number of changes in the transaction.

Defined Under Namespace

Classes: Msgpack, Processor, Rest, Yaml

Constant Summary collapse

TOTAL =
"total".freeze

Constants included from Indirector

Indirector::BadNameRegexp

Instance Attribute Summary collapse

Class Method Summary collapse

Instance Method Summary collapse

Methods included from Indirector

configure_routes, indirects

Methods included from Util::PsychSupport

#encode_with, #init_with

Constructor Details

#initialize(configuration_version = nil, environment = nil, transaction_uuid = nil, job_id = nil) ⇒ Report

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.

Returns a new instance of Report


220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
# File 'lib/puppet/transaction/report.rb', line 220

def initialize(configuration_version=nil, environment=nil, transaction_uuid=nil, job_id=nil)
  @metrics = {}
  @logs = []
  @resource_statuses = {}
  @external_times ||= {}
  @host = Puppet[:node_name_value]
  @time = Time.now
  @report_format = 10
  @puppet_version = Puppet.version
  @configuration_version = configuration_version
  @transaction_uuid = transaction_uuid
  @code_id = nil
  @job_id = job_id
  @catalog_uuid = nil
  @cached_catalog_status = nil
  @master_used = nil
  @environment = environment
  @status = 'failed' # assume failed until the report is finalized
  @noop = Puppet[:noop]
  @noop_pending = false
  @corrective_change = false
  @transaction_completed = false
end

Instance Attribute Details

#cached_catalog_statusString

Whether a cached catalog was used in the run, and if so, the reason that it was used. or 'on_failure'


64
65
66
# File 'lib/puppet/transaction/report.rb', line 64

def cached_catalog_status
  @cached_catalog_status
end

#catalog_uuidObject

A master generated catalog uuid, useful for connecting a single catalog to multiple reports.


59
60
61
# File 'lib/puppet/transaction/report.rb', line 59

def catalog_uuid
  @catalog_uuid
end

#code_idObject

The id of the code input to the compiler.


53
54
55
# File 'lib/puppet/transaction/report.rb', line 53

def code_id
  @code_id
end

#configuration_version???

TODO:

Uncertain what this is?

The version of the configuration


46
47
48
# File 'lib/puppet/transaction/report.rb', line 46

def configuration_version
  @configuration_version
end

#corrective_changeObject (readonly)


126
127
128
# File 'lib/puppet/transaction/report.rb', line 126

def corrective_change
  @corrective_change
end

#environmentString

The name of the environment the host is in


76
77
78
# File 'lib/puppet/transaction/report.rb', line 76

def environment
  @environment
end

#hostString

The host name for which the report is generated


72
73
74
# File 'lib/puppet/transaction/report.rb', line 72

def host
  @host
end

#job_idObject

The id of the job responsible for this run.


56
57
58
# File 'lib/puppet/transaction/report.rb', line 56

def job_id
  @job_id
end

#logsArray<Puppet::Util::Log> (readonly)

A list of log messages.


89
90
91
# File 'lib/puppet/transaction/report.rb', line 89

def logs
  @logs
end

#master_usedString

Contains the name and port of the master that was successfully contacted


68
69
70
# File 'lib/puppet/transaction/report.rb', line 68

def master_used
  @master_used
end

#metricsHash<{String => Object}> (readonly)

TODO:

Uncertain if all values are numbers - now marked as Object.

A hash of metric name to metric value.


95
96
97
# File 'lib/puppet/transaction/report.rb', line 95

def metrics
  @metrics
end

#noopBoolean (readonly)

Whether the puppet run was started in noop mode


121
122
123
# File 'lib/puppet/transaction/report.rb', line 121

def noop
  @noop
end

#noop_pendingBoolean

Whether there are changes that we decided not to apply because of noop


81
82
83
# File 'lib/puppet/transaction/report.rb', line 81

def noop_pending
  @noop_pending
end

#puppet_versionString (readonly)

Returns The Puppet version in String form.

See Also:

  • version()

110
111
112
# File 'lib/puppet/transaction/report.rb', line 110

def puppet_version
  @puppet_version
end

#report_formatInteger (readonly)

Returns report format version number. This value is constant for a given version of Puppet; it is incremented when a new release of Puppet changes the API for the various objects that make up a report.


116
117
118
# File 'lib/puppet/transaction/report.rb', line 116

def report_format
  @report_format
end

#resource_statusesHash{String => Puppet::Resource::Status} (readonly)

A hash with a map from resource to status


85
86
87
# File 'lib/puppet/transaction/report.rb', line 85

def resource_statuses
  @resource_statuses
end

#resources_failed_to_generateBoolean

Returns true if one or more resources attempted to generate resources and failed


131
132
133
# File 'lib/puppet/transaction/report.rb', line 131

def resources_failed_to_generate
  @resources_failed_to_generate
end

#statusString (readonly)

The status of the client run is an enumeration: 'failed', 'changed' or 'unchanged'


105
106
107
# File 'lib/puppet/transaction/report.rb', line 105

def status
  @status
end

#timeTime (readonly)

The time when the report data was generated.


100
101
102
# File 'lib/puppet/transaction/report.rb', line 100

def time
  @time
end

#transaction_completedBoolean

Returns true if the transaction completed it's evaluate


135
136
137
# File 'lib/puppet/transaction/report.rb', line 135

def transaction_completed
  @transaction_completed
end

#transaction_uuidString

An agent generated transaction uuid, useful for connecting catalog and report


50
51
52
# File 'lib/puppet/transaction/report.rb', line 50

def transaction_uuid
  @transaction_uuid
end

Class Method Details

.from_data_hash(data) ⇒ Object


139
140
141
142
143
# File 'lib/puppet/transaction/report.rb', line 139

def self.from_data_hash(data)
  obj = self.allocate
  obj.initialize_from_hash(data)
  obj
end

Instance Method Details

#<<(msg) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.


150
151
152
153
# File 'lib/puppet/transaction/report.rb', line 150

def <<(msg)
  @logs << msg
  self
end

#add_metric(name, hash) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.


165
166
167
168
169
170
171
172
173
174
# File 'lib/puppet/transaction/report.rb', line 165

def add_metric(name, hash)
  metric = Puppet::Util::Metric.new(name)

  hash.each do |metric_name, value|
    metric.newvalue(metric_name, value)
  end

  @metrics[metric.name] = metric
  metric
end

#add_resource_status(status) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.


177
178
179
# File 'lib/puppet/transaction/report.rb', line 177

def add_resource_status(status)
  @resource_statuses[status.resource] = status
end

#add_times(name, value, accumulate = true) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.


156
157
158
159
160
161
162
# File 'lib/puppet/transaction/report.rb', line 156

def add_times(name, value, accumulate = true)
  if @external_times[name] && accumulate
    @external_times[name] += value
  else
    @external_times[name] = value
  end
end

#as_logging_destination(&block) ⇒ Object


145
146
147
# File 'lib/puppet/transaction/report.rb', line 145

def as_logging_destination(&block)
  Puppet::Util::Log.with_destination(self, &block)
end

#compute_status(resource_metrics, change_metric) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.


182
183
184
185
186
187
188
189
190
191
192
193
# File 'lib/puppet/transaction/report.rb', line 182

def compute_status(resource_metrics, change_metric)
  if resources_failed_to_generate ||
     !transaction_completed ||
     (resource_metrics["failed"] || 0) > 0 ||
     (resource_metrics["failed_to_restart"] || 0) > 0
    'failed'
  elsif change_metric > 0
    'changed'
  else
    'unchanged'
  end
end

#exit_statusInteger

Computes a single number that represents the report's status. The computation is based on the contents of this report's metrics. The resulting number is a bitmask where individual bits represent the presence of different metrics.

  • 0x2 set if there are changes

  • 0x4 set if there are resource failures or resources that failed to restart


400
401
402
403
404
405
406
407
408
409
410
411
412
# File 'lib/puppet/transaction/report.rb', line 400

def exit_status
  status = 0
  if @metrics["changes"] && @metrics["changes"][TOTAL] &&
      @metrics["resources"] && @metrics["resources"]["failed"] &&
      @metrics["resources"]["failed_to_restart"]
    status |= 2 if @metrics["changes"][TOTAL] > 0
    status |= 4 if @metrics["resources"]["failed"] > 0
    status |= 4 if @metrics["resources"]["failed_to_restart"] > 0
  else
    status = -1
  end
  status
end

#finalize_reportObject

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.


206
207
208
209
210
211
212
213
214
215
216
217
# File 'lib/puppet/transaction/report.rb', line 206

def finalize_report
  prune_internal_data
  calculate_report_corrective_change

  resource_metrics = add_metric(:resources, calculate_resource_metrics)
  add_metric(:time, calculate_time_metrics)
  change_metric = calculate_change_metric
  add_metric(:changes, {TOTAL => change_metric})
  add_metric(:events, calculate_event_metrics)
  @status = compute_status(resource_metrics, change_metric)
  @noop_pending = @resource_statuses.any? { |name,res| has_noop_events?(res) }
end

#has_noop_events?(resource) ⇒ Boolean

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.


196
197
198
# File 'lib/puppet/transaction/report.rb', line 196

def has_noop_events?(resource)
  resource.events.any? { |event| event.status == 'noop' }
end

#initialize_from_hash(data) ⇒ Object

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.


245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
# File 'lib/puppet/transaction/report.rb', line 245

def initialize_from_hash(data)
  @puppet_version = data['puppet_version']
  @report_format = data['report_format']
  @configuration_version = data['configuration_version']
  @transaction_uuid = data['transaction_uuid']
  @environment = data['environment']
  @status = data['status']
  @transaction_completed = data['transaction_completed']
  @noop = data['noop']
  @noop_pending = data['noop_pending']
  @host = data['host']
  @time = data['time']
  @corrective_change = data['corrective_change']

  if data['master_used']
    @master_used = data['master_used']
  end

  if data['catalog_uuid']
    @catalog_uuid = data['catalog_uuid']
  end

  if data['job_id']
    @job_id = data['job_id']
  end

  if data['code_id']
    @code_id = data['code_id']
  end

  if data['cached_catalog_status']
    @cached_catalog_status = data['cached_catalog_status']
  end

  if @time.is_a? String
    @time = Time.parse(@time)
  end

  @metrics = {}
  data['metrics'].each do |name, hash|
    # Older versions contain tags that causes Psych to create instances directly
    @metrics[name] = hash.is_a?(Puppet::Util::Metric) ? hash : Puppet::Util::Metric.from_data_hash(hash)
  end

  @logs = data['logs'].map do |record|
    # Older versions contain tags that causes Psych to create instances directly
    record.is_a?(Puppet::Util::Log) ? record : Puppet::Util::Log.from_data_hash(record)
  end

  @resource_statuses = {}
  data['resource_statuses'].map do |key, rs|
    @resource_statuses[key] = if rs == Puppet::Resource::EMPTY_HASH
      nil
    else
      # Older versions contain tags that causes Psych to create instances directly
      rs.is_a?(Puppet::Resource::Status) ? rs : Puppet::Resource::Status.from_data_hash(rs)
    end
  end
end

#nameString

Returns the host name


336
337
338
# File 'lib/puppet/transaction/report.rb', line 336

def name
  host
end

#prune_internal_dataObject

This method is part of a private API. You should avoid using this method if possible, as it may be removed or be changed in the future.


201
202
203
# File 'lib/puppet/transaction/report.rb', line 201

def prune_internal_data
  resource_statuses.delete_if {|name,res| res.resource_type == 'Whit'}
end

#raw_summaryHash<{String => Object}>

Provides a raw hash summary of this report.


375
376
377
378
379
380
381
382
383
384
385
386
387
388
# File 'lib/puppet/transaction/report.rb', line 375

def raw_summary
  report = { "version" => { "config" => configuration_version, "puppet" => Puppet.version  } }

  @metrics.each do |name, metric|
    key = metric.name.to_s
    report[key] = {}
    metric.values.each do |metric_name, label, value|
      report[key][metric_name.to_s] = value
    end
    report[key][TOTAL] = 0 unless key == "time" or report[key].include?(TOTAL)
  end
  (report["time"] ||= {})["last_run"] = Time.now.tv_sec
  report
end

#summaryString

Note:

This is intended for debugging purposes

Provide a human readable textual summary of this report.


345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
# File 'lib/puppet/transaction/report.rb', line 345

def summary
  report = raw_summary

  ret = ""
  report.keys.sort_by(&:to_s).each do |key|
    ret += "#{Puppet::Util::Metric.labelize(key)}:\n"

    report[key].keys.sort { |a,b|
      # sort by label
      if a == TOTAL
        1
      elsif b == TOTAL
        -1
      else
        report[key][a].to_s <=> report[key][b].to_s
      end
    }.each do |label|
      value = report[key][label]
      next if value == 0
      value = "%0.2f" % value if value.is_a?(Float)
      ret += "   %15s %s\n" % [Puppet::Util::Metric.labelize(label) + ":", value]
    end
  end
  ret
end

#to_data_hashObject


305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
# File 'lib/puppet/transaction/report.rb', line 305

def to_data_hash
  hash = {
    'host' => @host,
    'time' => @time.iso8601(9),
    'configuration_version' => @configuration_version,
    'transaction_uuid' => @transaction_uuid,
    'report_format' => @report_format,
    'puppet_version' => @puppet_version,
    'status' => @status,
    'transaction_completed' => @transaction_completed,
    'noop' => @noop,
    'noop_pending' => @noop_pending,
    'environment' => @environment,
    'logs' => @logs.map { |log| log.to_data_hash },
    'metrics' => Hash[@metrics.map { |key, metric| [key, metric.to_data_hash] }],
    'resource_statuses' => Hash[@resource_statuses.map { |key, rs| [key, rs.nil? ? nil : rs.to_data_hash] }],
    'corrective_change' => @corrective_change,
  }

  # The following is include only when set
  hash['master_used'] = @master_used unless @master_used.nil?
  hash['catalog_uuid'] = @catalog_uuid unless @catalog_uuid.nil?
  hash['code_id'] = @code_id unless @code_id.nil?
  hash['job_id'] = @job_id unless @job_id.nil?
  hash['cached_catalog_status'] = @cached_catalog_status unless @cached_catalog_status.nil?
  hash
end