Module: TwitterCldr::Normalization

Defined in:: lib/twitter_cldr/normalization/nfkd.rb,
lib/twitter_cldr/normalization.rb,
lib/twitter_cldr/normalization/nfc.rb,
lib/twitter_cldr/normalization/nfd.rb,
lib/twitter_cldr/normalization/base.rb,
lib/twitter_cldr/normalization/nfkc.rb,
lib/twitter_cldr/normalization/hangul.rb

Overview

Normalization module includes algorithm for Unicode normalization. Basic information on this topic can be found in the Unicode Standard Annex #15 “Unicode Normalization Forms” at www.unicode.org/reports/tr15/. More detailed description is given in the section “3.11 Normalization Forms” of the Unicode Standard core specification. The latest version at the moment (for Unicode 6.1) is available at www.unicode.org/versions/Unicode6.1.0/ch03.pdf.

Defined Under Namespace

Modules: Hangul Classes: Base, NFC, NFD, NFKC, NFKD

Constant Summary collapse

VALID_NORMALIZERS =

[:NFD, :NFKD, :NFC, :NFKC]

DEFAULT_NORMALIZER =

:NFD

Class Method Summary collapse

.normalize(string, options = {}) ⇒ Object

Class Method Details

.normalize(string, options = {}) ⇒ `Object`



20
21
22

# File 'lib/twitter_cldr/normalization.rb', line 20

def normalize(string, options = {})
  normalizer(options[:using] || DEFAULT_NORMALIZER).normalize(string)
end