Skip to main content
tokenize_sentences
use_
text
0.2.0
In use_
text::
prelude
use_text
::
prelude
Function
tokenize_
sentences
Copy item path
pub fn tokenize_sentences(input: &
str
) ->
Vec
<
Token
>
Expand description
Extracts conservative sentence tokens.