Skip to content
RustUse

use-token

0.1.0 Versioned crate with live registry and docs.rs links.

use-token belongs to the use-text facade.

Package links

Facade placement

Use use-token directly when you want a narrower dependency surface than the use-text facade. It remains part of the current crate inventory for this facade.

RustDocs

This crate uses a stable RustUse RustDocs route alongside the workspace Rustdocs bundle.

Copyable source

Copy use-token into your codebase

Copy the current use-token source bundle or inspect the files behind the stable RustUse docs surface for this crate.

Cargo.toml

2 files TOML

Browse crate files 
            [package]
name = "use-token"
publish = true
version.workspace = true
authors.workspace = true
edition.workspace = true
license.workspace = true
repository.workspace = true
homepage.workspace = true
readme = "README.md"
rust-version.workspace = true
description = "Composable tokenization primitives for RustUse."
documentation = "https://docs.rs/use-token"
keywords = ["text", "token", "tokenize", "string", "parser"]
categories = ["text-processing"]

[lints]
workspace = true

[package.metadata.docs.rs]
all-features = true

Tags

  • text
  • token
  • tokenize