Method: Enumerable#entropy

Defined in:
lib/nano/enumerable/entropy.rb

#entropy ⇒ Object

Shannon’s entropy for an array - returns the average bits per symbol required to encode the array. Lower values mean less “entropy” - i.e. less unique information in the array.

%w{ a b c d e e e }.entropy  #=>



15
16
17
18
19
20
21
22
23
 
# File 'lib/nano/enumerable/entropy.rb', line 15

def entropy
  arr = self.to_a
  probHash = arr.probability
  # h is the Shannon entropy of the array
  h = -1.to_f * probHash.keys.inject(0.to_f) do |sum, i|
    sum + (probHash[i] * (Math.log(probHash[i])/Math.log(2.to_f)))
  end
  h
end