commit | 87f6302b3494986adc8e8155f36abfb907cf7e02 | [log] [tgz] |
---|---|---|
author | Xin Li <delphij@google.com> | Thu Oct 08 17:21:40 2020 -0700 |
committer | Xin Li <delphij@google.com> | Thu Oct 08 17:21:40 2020 -0700 |
tree | 51c30ee8b17b5b8dfd5ce2ef127bb529c758f7f8 | |
parent | 72f3d586e1b079dcc8dd1ec56db629a976e4f4d9 [diff] | |
parent | c9ad523be5b682c6a973ec40d4abd160ca131d85 [diff] |
Skip ab/6749736 in stage. Merged-In: Ia588a8565b4d0d8f9be211a22e28c5482011804e Change-Id: I68b344dc7bde2ef734ffbea2b56175ef7c408fc7
Iterators which split strings on Grapheme Cluster or Word boundaries, according to the Unicode Standard Annex #29 rules.
use unicode_segmentation::UnicodeSegmentation; fn main() { let s = "a̐éö̲\r\n"; let g = UnicodeSegmentation::graphemes(s, true).collect::<Vec<&str>>(); let b: &[_] = &["a̐", "é", "ö̲", "\r\n"]; assert_eq!(g, b); let s = "The quick (\"brown\") fox can't jump 32.3 feet, right?"; let w = s.unicode_words().collect::<Vec<&str>>(); let b: &[_] = &["The", "quick", "brown", "fox", "can't", "jump", "32.3", "feet", "right"]; assert_eq!(w, b); let s = "The quick (\"brown\") fox"; let w = s.split_word_bounds().collect::<Vec<&str>>(); let b: &[_] = &["The", " ", "quick", " ", "(", "\"", "brown", "\"", ")", " ", " ", "fox"]; assert_eq!(w, b); }
unicode-segmentation does not depend on libstd, so it can be used in crates with the #![no_std]
attribute.
You can use this package in your project by adding the following to your Cargo.toml
:
[dependencies] unicode-segmentation = "1.3.0"
GraphemeCursor
API allows random access and bidirectional iteration.as_str
methods to the iterator types.