commit | dec147c2c96b54ca198f618f4fd19ad7231ff221 | [log] [tgz] |
---|---|---|
author | Matthew Maurer <mmaurer@google.com> | Fri Jun 05 16:02:23 2020 +0000 |
committer | Automerger Merge Worker <android-build-automerger-merge-worker@system.gserviceaccount.com> | Fri Jun 05 16:02:23 2020 +0000 |
tree | 7e7ab7d79cfec368026e58e86bdf2fc8515eb784 | |
parent | 4173dec4d2935c5475d6b11197d47292ec3b3827 [diff] | |
parent | 9c8af749c2f8fcc0077f41d43f422f952b86b560 [diff] |
Import unicode-segmentation-1.6.0 am: 5016934c17 am: 6e4713729f am: 19571db68d am: 9c8af749c2 Original change: https://android-review.googlesource.com/c/platform/external/rust/crates/unicode-segmentation/+/1321871 Change-Id: Iebbd6a15f83ab36b54b33fc0d820f9cba16a8602
Iterators which split strings on Grapheme Cluster or Word boundaries, according to the Unicode Standard Annex #29 rules.
use unicode_segmentation::UnicodeSegmentation; fn main() { let s = "a̐éö̲\r\n"; let g = UnicodeSegmentation::graphemes(s, true).collect::<Vec<&str>>(); let b: &[_] = &["a̐", "é", "ö̲", "\r\n"]; assert_eq!(g, b); let s = "The quick (\"brown\") fox can't jump 32.3 feet, right?"; let w = s.unicode_words().collect::<Vec<&str>>(); let b: &[_] = &["The", "quick", "brown", "fox", "can't", "jump", "32.3", "feet", "right"]; assert_eq!(w, b); let s = "The quick (\"brown\") fox"; let w = s.split_word_bounds().collect::<Vec<&str>>(); let b: &[_] = &["The", " ", "quick", " ", "(", "\"", "brown", "\"", ")", " ", " ", "fox"]; assert_eq!(w, b); }
unicode-segmentation does not depend on libstd, so it can be used in crates with the #![no_std]
attribute.
You can use this package in your project by adding the following to your Cargo.toml
:
[dependencies] unicode-segmentation = "1.3.0"
GraphemeCursor
API allows random access and bidirectional iteration.as_str
methods to the iterator types.