ActiveSupport::Multibyte::Unicode (original) (raw)

Methods

C

D

T

Constants

UNICODE_VERSION = RbConfig::CONFIG["UNICODE_VERSION"]
The Unicode version that is supported by the implementation

Instance Public methods

Compose decomposed characters to the composed form.

Source: show | on GitHub

def compose(codepoints) codepoints.pack("U*").unicode_normalize(:nfc).codepoints end

Decompose composed characters to the decomposed form.

Source: show | on GitHub

def decompose(type, codepoints) if type == :compatibility codepoints.pack("U*").unicode_normalize(:nfkd).codepoints else codepoints.pack("U*").unicode_normalize(:nfd).codepoints end end

tidy_bytes(string, force = false)Link

Replaces all ISO-8859-1 or CP1252 characters by their UTF-8 equivalent resulting in a valid UTF-8 string.

Passing true will forcibly tidy all bytes, assuming that the string’s encoding is entirely CP1252 or ISO-8859-1.

Source: show | on GitHub

def tidy_bytes(string, force = false) return string if string.empty? || string.ascii_only? return recode_windows1252_chars(string) if force string.scrub { |bad| recode_windows1252_chars(bad) } end