unicode_segmentation - Rust (original) (raw)
Crate unicode_segmentation [−] [src]
Iterators which split strings on Grapheme Cluster or Word boundaries, according to the Unicode Standard Annex #29 rules.
extern crate unicode_segmentation;
use unicode_segmentation::UnicodeSegmentation;
fn main() { let s = "a̐éö̲\r\n"; let g = UnicodeSegmentation::graphemes(s, true).collect::<Vec<&str>>(); let b: &[_] = &["a̐", "é", "ö̲", "\r\n"]; assert_eq!(g, b);
let s = "The quick (\"brown\") fox can't jump 32.3 feet, right?";
let w = s.unicode_words().collect::<Vec<&str>>();
let b: &[_] = &["The", "quick", "brown", "fox", "can't", "jump", "32.3", "feet", "right"];
assert_eq!(w, b);
let s = "The quick (\"brown\") fox";
let w = s.split_word_bounds().collect::<Vec<&str>>();
let b: &[_] = &["The", " ", "quick", " ", "(", "\"", "brown", "\"", ")", " ", " ", "fox"];
assert_eq!(w, b);
}
unicode-segmentation does not depend on libstd, so it can be used in crates with the #![no_std]
attribute.
You can use this package in your project by adding the following to your Cargo.toml
:
[dependencies]
unicode-segmentation = "1.1.0"
GraphemeCursor | Cursor-based segmenter for grapheme clusters. |
---|---|
GraphemeIndices | External iterator for grapheme clusters and byte offsets. |
Graphemes | External iterator for a string'sgrapheme clusters. |
UWordBoundIndices | External iterator for word boundaries and byte offsets. |
UWordBounds | External iterator for a string'sword boundaries. |
UnicodeWords | An iterator over the substrings of a string which, after splitting the string onword boundaries, contain any characters with theAlphabeticproperty, or withGeneral_Category=Number. |
GraphemeIncomplete | An error return indicating that not enough content was available in the provided chunk to satisfy the query, and that more content must be provided. |
---|