llmx-rs/utils/tokenizer/Cargo.toml

[package]
edition.workspace = true
name = "llmx-utils-tokenizer"
version.workspace = true

[lints]
workspace = true

[dependencies]
anyhow = { workspace = true }
thiserror = { workspace = true }
tiktoken-rs = "0.7"

[dev-dependencies]
pretty_assertions = { workspace = true }
feat: local tokenizer (#5508) 2025-10-22 16:01:02 +01:00			`[package]`
			`edition.workspace = true`
Phase 2: Rust Workspace Transformation (Part 1) - Renamed directory: codex-backend-openapi-models -> llmx-backend-openapi-models - Updated all Cargo.toml files: - Package names: codex-* -> llmx-* - Library names: codex_* -> llmx_* - Workspace dependencies updated - Renamed Rust source files: - codex.rs -> llmx.rs (all modules) - codex_conversation -> llmx_conversation - codex_delegate -> llmx_delegate - codex_message_processor -> llmx_message_processor - codex_tool_* -> llmx_tool_* - Updated all Rust imports: - use codex_* -> use llmx_* - mod codex* -> mod llmx* - Updated environment variables in code: - CODEX_HOME -> LLMX_HOME - .codex -> .llmx paths - Updated protocol crate lib name for proper linking Note: Some compilation errors remain (type inference issues) but all renaming is complete. Will fix compilation in next phase. 🤖 Generated with Claude Code 2025-11-11 14:29:57 +01:00			`name = "llmx-utils-tokenizer"`
feat: local tokenizer (#5508) 2025-10-22 16:01:02 +01:00			`version.workspace = true`

			`[lints]`
			`workspace = true`

			`[dependencies]`
			`anyhow = { workspace = true }`
			`thiserror = { workspace = true }`
			`tiktoken-rs = "0.7"`

			`[dev-dependencies]`
			`pretty_assertions = { workspace = true }`