Skip to main content

tokenize_whitespace

use_text::prelude

Function tokenize_whitespace 

pub fn tokenize_whitespace(input: &str) -> Vec<Token>
Expand description

Splits input on contiguous whitespace.