Skip to main content

tokenize_whitespace

use_token

Function tokenize_whitespace 

Source 
pub fn tokenize_whitespace(input: &str) -> Vec<Token>
Expand description

Splits input on contiguous whitespace.