feat: Complete LLMX v0.1.0 - Rebrand from Codex with LiteLLM Integration
This release represents a comprehensive transformation of the codebase from Codex to LLMX, enhanced with LiteLLM integration to support 100+ LLM providers through a unified API. ## Major Changes ### Phase 1: Repository & Infrastructure Setup - Established new repository structure and branching strategy - Created comprehensive project documentation (CLAUDE.md, LITELLM-SETUP.md) - Set up development environment and tooling configuration ### Phase 2: Rust Workspace Transformation - Renamed all Rust crates from `codex-*` to `llmx-*` (30+ crates) - Updated package names, binary names, and workspace members - Renamed core modules: codex.rs → llmx.rs, codex_delegate.rs → llmx_delegate.rs - Updated all internal references, imports, and type names - Renamed directories: codex-rs/ → llmx-rs/, codex-backend-openapi-models/ → llmx-backend-openapi-models/ - Fixed all Rust compilation errors after mass rename ### Phase 3: LiteLLM Integration - Integrated LiteLLM for multi-provider LLM support (Anthropic, OpenAI, Azure, Google AI, AWS Bedrock, etc.) - Implemented OpenAI-compatible Chat Completions API support - Added model family detection and provider-specific handling - Updated authentication to support LiteLLM API keys - Renamed environment variables: OPENAI_BASE_URL → LLMX_BASE_URL - Added LLMX_API_KEY for unified authentication - Enhanced error handling for Chat Completions API responses - Implemented fallback mechanisms between Responses API and Chat Completions API ### Phase 4: TypeScript/Node.js Components - Renamed npm package: @codex/codex-cli → @valknar/llmx - Updated TypeScript SDK to use new LLMX APIs and endpoints - Fixed all TypeScript compilation and linting errors - Updated SDK tests to support both API backends - Enhanced mock server to handle multiple API formats - Updated build scripts for cross-platform packaging ### Phase 5: Configuration & Documentation - Updated all configuration files to use LLMX naming - Rewrote README and documentation for LLMX branding - Updated config paths: ~/.codex/ → ~/.llmx/ - Added comprehensive LiteLLM setup guide - Updated all user-facing strings and help text - Created release plan and migration documentation ### Phase 6: Testing & Validation - Fixed all Rust tests for new naming scheme - Updated snapshot tests in TUI (36 frame files) - Fixed authentication storage tests - Updated Chat Completions payload and SSE tests - Fixed SDK tests for new API endpoints - Ensured compatibility with Claude Sonnet 4.5 model - Fixed test environment variables (LLMX_API_KEY, LLMX_BASE_URL) ### Phase 7: Build & Release Pipeline - Updated GitHub Actions workflows for LLMX binary names - Fixed rust-release.yml to reference llmx-rs/ instead of codex-rs/ - Updated CI/CD pipelines for new package names - Made Apple code signing optional in release workflow - Enhanced npm packaging resilience for partial platform builds - Added Windows sandbox support to workspace - Updated dotslash configuration for new binary names ### Phase 8: Final Polish - Renamed all assets (.github images, labels, templates) - Updated VSCode and DevContainer configurations - Fixed all clippy warnings and formatting issues - Applied cargo fmt and prettier formatting across codebase - Updated issue templates and pull request templates - Fixed all remaining UI text references ## Technical Details **Breaking Changes:** - Binary name changed from `codex` to `llmx` - Config directory changed from `~/.codex/` to `~/.llmx/` - Environment variables renamed (CODEX_* → LLMX_*) - npm package renamed to `@valknar/llmx` **New Features:** - Support for 100+ LLM providers via LiteLLM - Unified authentication with LLMX_API_KEY - Enhanced model provider detection and handling - Improved error handling and fallback mechanisms **Files Changed:** - 578 files modified across Rust, TypeScript, and documentation - 30+ Rust crates renamed and updated - Complete rebrand of UI, CLI, and documentation - All tests updated and passing **Dependencies:** - Updated Cargo.lock with new package names - Updated npm dependencies in llmx-cli - Enhanced OpenAPI models for LLMX backend This release establishes LLMX as a standalone project with comprehensive LiteLLM integration, maintaining full backward compatibility with existing functionality while opening support for a wide ecosystem of LLM providers. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> Co-Authored-By: Sebastian Krüger <support@pivoine.art>
This commit is contained in:
13
llmx-rs/mcp-types/Cargo.toml
Normal file
13
llmx-rs/mcp-types/Cargo.toml
Normal file
@@ -0,0 +1,13 @@
|
||||
[package]
|
||||
edition = "2024"
|
||||
name = "mcp-types"
|
||||
version = { workspace = true }
|
||||
|
||||
[lints]
|
||||
workspace = true
|
||||
|
||||
[dependencies]
|
||||
serde = { workspace = true, features = ["derive"] }
|
||||
serde_json = { workspace = true }
|
||||
ts-rs = { workspace = true, features = ["serde-json-impl", "no-serde-warnings"] }
|
||||
schemars = { workspace = true }
|
||||
8
llmx-rs/mcp-types/README.md
Normal file
8
llmx-rs/mcp-types/README.md
Normal file
@@ -0,0 +1,8 @@
|
||||
# mcp-types
|
||||
|
||||
Types for Model Context Protocol. Inspired by https://crates.io/crates/lsp-types.
|
||||
|
||||
As documented on https://modelcontextprotocol.io/specification/2025-06-18/basic:
|
||||
|
||||
- TypeScript schema is the source of truth: https://github.com/modelcontextprotocol/modelcontextprotocol/blob/main/schema/2025-06-18/schema.ts
|
||||
- JSON schema is amenable to automated tooling: https://github.com/modelcontextprotocol/modelcontextprotocol/blob/main/schema/2025-06-18/schema.json
|
||||
21
llmx-rs/mcp-types/check_lib_rs.py
Executable file
21
llmx-rs/mcp-types/check_lib_rs.py
Executable file
@@ -0,0 +1,21 @@
|
||||
#!/usr/bin/env python3
|
||||
|
||||
import subprocess
|
||||
import sys
|
||||
from pathlib import Path
|
||||
|
||||
|
||||
def main() -> int:
|
||||
crate_dir = Path(__file__).resolve().parent
|
||||
generator = crate_dir / "generate_mcp_types.py"
|
||||
|
||||
result = subprocess.run(
|
||||
[sys.executable, str(generator), "--check"],
|
||||
cwd=crate_dir,
|
||||
check=False,
|
||||
)
|
||||
return result.returncode
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
raise SystemExit(main())
|
||||
753
llmx-rs/mcp-types/generate_mcp_types.py
Executable file
753
llmx-rs/mcp-types/generate_mcp_types.py
Executable file
@@ -0,0 +1,753 @@
|
||||
#!/usr/bin/env python3
|
||||
# flake8: noqa: E501
|
||||
|
||||
import argparse
|
||||
import json
|
||||
import subprocess
|
||||
import sys
|
||||
import tempfile
|
||||
|
||||
from dataclasses import (
|
||||
dataclass,
|
||||
)
|
||||
from difflib import unified_diff
|
||||
from pathlib import Path
|
||||
from shutil import copy2
|
||||
|
||||
# Helper first so it is defined when other functions call it.
|
||||
from typing import Any, Literal
|
||||
|
||||
|
||||
SCHEMA_VERSION = "2025-06-18"
|
||||
JSONRPC_VERSION = "2.0"
|
||||
|
||||
STANDARD_DERIVE = "#[derive(Debug, Clone, PartialEq, Deserialize, Serialize, JsonSchema, TS)]\n"
|
||||
STANDARD_HASHABLE_DERIVE = (
|
||||
"#[derive(Debug, Clone, PartialEq, Deserialize, Serialize, Hash, Eq, JsonSchema, TS)]\n"
|
||||
)
|
||||
|
||||
# Will be populated with the schema's `definitions` map in `main()` so that
|
||||
# helper functions (for example `define_any_of`) can perform look-ups while
|
||||
# generating code.
|
||||
DEFINITIONS: dict[str, Any] = {}
|
||||
# Names of the concrete *Request types that make up the ClientRequest enum.
|
||||
CLIENT_REQUEST_TYPE_NAMES: list[str] = []
|
||||
# Concrete *Notification types that make up the ServerNotification enum.
|
||||
SERVER_NOTIFICATION_TYPE_NAMES: list[str] = []
|
||||
# Enum types that will need a `allow(clippy::large_enum_variant)` annotation in
|
||||
# order to compile without warnings.
|
||||
LARGE_ENUMS = {"ServerResult"}
|
||||
|
||||
|
||||
def main() -> int:
|
||||
parser = argparse.ArgumentParser(
|
||||
description="Embed, cluster and analyse text prompts via the OpenAI API.",
|
||||
)
|
||||
|
||||
default_schema_file = (
|
||||
Path(__file__).resolve().parent / "schema" / SCHEMA_VERSION / "schema.json"
|
||||
)
|
||||
default_lib_rs = Path(__file__).resolve().parent / "src/lib.rs"
|
||||
parser.add_argument(
|
||||
"schema_file",
|
||||
nargs="?",
|
||||
default=default_schema_file,
|
||||
help="schema.json file to process",
|
||||
)
|
||||
parser.add_argument(
|
||||
"--check",
|
||||
action="store_true",
|
||||
help="Regenerate lib.rs in a sandbox and ensure the checked-in file matches",
|
||||
)
|
||||
args = parser.parse_args()
|
||||
schema_file = Path(args.schema_file)
|
||||
crate_dir = Path(__file__).resolve().parent
|
||||
|
||||
if args.check:
|
||||
return run_check(schema_file, crate_dir, default_lib_rs)
|
||||
|
||||
generate_lib_rs(schema_file, default_lib_rs, fmt=True)
|
||||
return 0
|
||||
|
||||
|
||||
def generate_lib_rs(schema_file: Path, lib_rs: Path, fmt: bool) -> None:
|
||||
lib_rs.parent.mkdir(parents=True, exist_ok=True)
|
||||
|
||||
global DEFINITIONS # Allow helper functions to access the schema.
|
||||
|
||||
with schema_file.open(encoding="utf-8") as f:
|
||||
schema_json = json.load(f)
|
||||
|
||||
DEFINITIONS = schema_json["definitions"]
|
||||
|
||||
out = [
|
||||
f"""
|
||||
// @generated
|
||||
// DO NOT EDIT THIS FILE DIRECTLY.
|
||||
// Run the following in the crate root to regenerate this file:
|
||||
//
|
||||
// ```shell
|
||||
// ./generate_mcp_types.py
|
||||
// ```
|
||||
use serde::Deserialize;
|
||||
use serde::Serialize;
|
||||
use serde::de::DeserializeOwned;
|
||||
use std::convert::TryFrom;
|
||||
|
||||
use schemars::JsonSchema;
|
||||
use ts_rs::TS;
|
||||
|
||||
pub const MCP_SCHEMA_VERSION: &str = "{SCHEMA_VERSION}";
|
||||
pub const JSONRPC_VERSION: &str = "{JSONRPC_VERSION}";
|
||||
|
||||
/// Paired request/response types for the Model Context Protocol (MCP).
|
||||
pub trait ModelContextProtocolRequest {{
|
||||
const METHOD: &'static str;
|
||||
type Params: DeserializeOwned + Serialize + Send + Sync + 'static;
|
||||
type Result: DeserializeOwned + Serialize + Send + Sync + 'static;
|
||||
}}
|
||||
|
||||
/// One-way message in the Model Context Protocol (MCP).
|
||||
pub trait ModelContextProtocolNotification {{
|
||||
const METHOD: &'static str;
|
||||
type Params: DeserializeOwned + Serialize + Send + Sync + 'static;
|
||||
}}
|
||||
|
||||
fn default_jsonrpc() -> String {{ JSONRPC_VERSION.to_owned() }}
|
||||
|
||||
"""
|
||||
]
|
||||
definitions = schema_json["definitions"]
|
||||
# Keep track of every *Request type so we can generate the TryFrom impl at
|
||||
# the end.
|
||||
# The concrete *Request types referenced by the ClientRequest enum will be
|
||||
# captured dynamically while we are processing that definition.
|
||||
for name, definition in definitions.items():
|
||||
add_definition(name, definition, out)
|
||||
# No-op: list collected via define_any_of("ClientRequest").
|
||||
|
||||
# Generate TryFrom impl string and append to out before writing to file.
|
||||
try_from_impl_lines: list[str] = []
|
||||
try_from_impl_lines.append("impl TryFrom<JSONRPCRequest> for ClientRequest {\n")
|
||||
try_from_impl_lines.append(" type Error = serde_json::Error;\n")
|
||||
try_from_impl_lines.append(
|
||||
" fn try_from(req: JSONRPCRequest) -> std::result::Result<Self, Self::Error> {\n"
|
||||
)
|
||||
try_from_impl_lines.append(" match req.method.as_str() {\n")
|
||||
|
||||
for req_name in CLIENT_REQUEST_TYPE_NAMES:
|
||||
defn = definitions[req_name]
|
||||
method_const = defn.get("properties", {}).get("method", {}).get("const", req_name)
|
||||
payload_type = f"<{req_name} as ModelContextProtocolRequest>::Params"
|
||||
try_from_impl_lines.append(f' "{method_const}" => {{\n')
|
||||
try_from_impl_lines.append(
|
||||
" let params_json = req.params.unwrap_or(serde_json::Value::Null);\n"
|
||||
)
|
||||
try_from_impl_lines.append(
|
||||
f" let params: {payload_type} = serde_json::from_value(params_json)?;\n"
|
||||
)
|
||||
try_from_impl_lines.append(f" Ok(ClientRequest::{req_name}(params))\n")
|
||||
try_from_impl_lines.append(" },\n")
|
||||
|
||||
try_from_impl_lines.append(
|
||||
' _ => Err(serde_json::Error::io(std::io::Error::new(std::io::ErrorKind::InvalidData, format!("Unknown method: {}", req.method)))),\n'
|
||||
)
|
||||
try_from_impl_lines.append(" }\n")
|
||||
try_from_impl_lines.append(" }\n")
|
||||
try_from_impl_lines.append("}\n\n")
|
||||
|
||||
out.extend(try_from_impl_lines)
|
||||
|
||||
# Generate TryFrom for ServerNotification
|
||||
notif_impl_lines: list[str] = []
|
||||
notif_impl_lines.append("impl TryFrom<JSONRPCNotification> for ServerNotification {\n")
|
||||
notif_impl_lines.append(" type Error = serde_json::Error;\n")
|
||||
notif_impl_lines.append(
|
||||
" fn try_from(n: JSONRPCNotification) -> std::result::Result<Self, Self::Error> {\n"
|
||||
)
|
||||
notif_impl_lines.append(" match n.method.as_str() {\n")
|
||||
|
||||
for notif_name in SERVER_NOTIFICATION_TYPE_NAMES:
|
||||
n_def = definitions[notif_name]
|
||||
method_const = n_def.get("properties", {}).get("method", {}).get("const", notif_name)
|
||||
payload_type = f"<{notif_name} as ModelContextProtocolNotification>::Params"
|
||||
notif_impl_lines.append(f' "{method_const}" => {{\n')
|
||||
# params may be optional
|
||||
notif_impl_lines.append(
|
||||
" let params_json = n.params.unwrap_or(serde_json::Value::Null);\n"
|
||||
)
|
||||
notif_impl_lines.append(
|
||||
f" let params: {payload_type} = serde_json::from_value(params_json)?;\n"
|
||||
)
|
||||
notif_impl_lines.append(f" Ok(ServerNotification::{notif_name}(params))\n")
|
||||
notif_impl_lines.append(" },\n")
|
||||
|
||||
notif_impl_lines.append(
|
||||
' _ => Err(serde_json::Error::io(std::io::Error::new(std::io::ErrorKind::InvalidData, format!("Unknown method: {}", n.method)))),\n'
|
||||
)
|
||||
notif_impl_lines.append(" }\n")
|
||||
notif_impl_lines.append(" }\n")
|
||||
notif_impl_lines.append("}\n")
|
||||
|
||||
out.extend(notif_impl_lines)
|
||||
|
||||
with open(lib_rs, "w", encoding="utf-8") as f:
|
||||
for chunk in out:
|
||||
f.write(chunk)
|
||||
|
||||
if fmt:
|
||||
subprocess.check_call(
|
||||
["cargo", "fmt", "--", "--config", "imports_granularity=Item"],
|
||||
cwd=lib_rs.parent.parent,
|
||||
stderr=subprocess.DEVNULL,
|
||||
)
|
||||
|
||||
|
||||
def run_check(schema_file: Path, crate_dir: Path, checked_in_lib: Path) -> int:
|
||||
config_path = crate_dir.parent / "rustfmt.toml"
|
||||
eprint(f"Running --check with schema {schema_file}")
|
||||
|
||||
with tempfile.TemporaryDirectory() as tmp_dir:
|
||||
tmp_path = Path(tmp_dir)
|
||||
eprint(f"Created temporary workspace at {tmp_path}")
|
||||
manifest_path = tmp_path / "Cargo.toml"
|
||||
eprint(f"Copying Cargo.toml into {manifest_path}")
|
||||
copy2(crate_dir / "Cargo.toml", manifest_path)
|
||||
manifest_text = manifest_path.read_text(encoding="utf-8")
|
||||
manifest_text = manifest_text.replace(
|
||||
"version = { workspace = true }",
|
||||
'version = "0.0.0"',
|
||||
)
|
||||
manifest_text = manifest_text.replace("\n[lints]\nworkspace = true\n", "\n")
|
||||
manifest_path.write_text(manifest_text, encoding="utf-8")
|
||||
src_dir = tmp_path / "src"
|
||||
src_dir.mkdir(parents=True, exist_ok=True)
|
||||
eprint(f"Generating lib.rs into {src_dir}")
|
||||
generated_lib = src_dir / "lib.rs"
|
||||
|
||||
generate_lib_rs(schema_file, generated_lib, fmt=False)
|
||||
|
||||
eprint("Formatting generated lib.rs with rustfmt")
|
||||
subprocess.check_call(
|
||||
[
|
||||
"rustfmt",
|
||||
"--config-path",
|
||||
str(config_path),
|
||||
str(generated_lib),
|
||||
],
|
||||
cwd=tmp_path,
|
||||
stderr=subprocess.DEVNULL,
|
||||
)
|
||||
|
||||
eprint("Comparing generated lib.rs with checked-in version")
|
||||
checked_in_contents = checked_in_lib.read_text(encoding="utf-8")
|
||||
generated_contents = generated_lib.read_text(encoding="utf-8")
|
||||
|
||||
if checked_in_contents == generated_contents:
|
||||
eprint("lib.rs matches checked-in version")
|
||||
return 0
|
||||
|
||||
diff = unified_diff(
|
||||
checked_in_contents.splitlines(keepends=True),
|
||||
generated_contents.splitlines(keepends=True),
|
||||
fromfile=str(checked_in_lib),
|
||||
tofile=str(generated_lib),
|
||||
)
|
||||
diff_text = "".join(diff)
|
||||
eprint("Generated lib.rs does not match the checked-in version. Diff:")
|
||||
if diff_text:
|
||||
eprint(diff_text, end="")
|
||||
eprint("Re-run generate_mcp_types.py without --check to update src/lib.rs.")
|
||||
return 1
|
||||
|
||||
|
||||
def add_definition(name: str, definition: dict[str, Any], out: list[str]) -> None:
|
||||
if name == "Result":
|
||||
out.append("pub type Result = serde_json::Value;\n\n")
|
||||
return
|
||||
|
||||
# Capture description
|
||||
description = definition.get("description")
|
||||
|
||||
properties = definition.get("properties", {})
|
||||
if properties:
|
||||
required_props = set(definition.get("required", []))
|
||||
out.extend(define_struct(name, properties, required_props, description))
|
||||
|
||||
# Special carve-out for Result types:
|
||||
if name.endswith("Result"):
|
||||
out.extend(f"impl From<{name}> for serde_json::Value {{\n")
|
||||
out.append(f" fn from(value: {name}) -> Self {{\n")
|
||||
out.append(" // Leave this as it should never fail\n")
|
||||
out.append(" #[expect(clippy::unwrap_used)]\n")
|
||||
out.append(" serde_json::to_value(value).unwrap()\n")
|
||||
out.append(" }\n")
|
||||
out.append("}\n\n")
|
||||
return
|
||||
|
||||
enum_values = definition.get("enum", [])
|
||||
if enum_values:
|
||||
assert definition.get("type") == "string"
|
||||
define_string_enum(name, enum_values, out, description)
|
||||
return
|
||||
|
||||
any_of = definition.get("anyOf", [])
|
||||
if any_of:
|
||||
assert isinstance(any_of, list)
|
||||
out.extend(define_any_of(name, any_of, description))
|
||||
return
|
||||
|
||||
type_prop = definition.get("type", None)
|
||||
if type_prop:
|
||||
if type_prop == "string":
|
||||
# Newtype pattern
|
||||
out.append(STANDARD_DERIVE)
|
||||
out.append(f"pub struct {name}(String);\n\n")
|
||||
return
|
||||
elif types := check_string_list(type_prop):
|
||||
define_untagged_enum(name, types, out)
|
||||
return
|
||||
elif type_prop == "array":
|
||||
item_name = name + "Item"
|
||||
out.extend(define_any_of(item_name, definition["items"]["anyOf"]))
|
||||
out.append(f"pub type {name} = Vec<{item_name}>;\n\n")
|
||||
return
|
||||
raise ValueError(f"Unknown type: {type_prop} in {name}")
|
||||
|
||||
ref_prop = definition.get("$ref", None)
|
||||
if ref_prop:
|
||||
ref = type_from_ref(ref_prop)
|
||||
out.extend(f"pub type {name} = {ref};\n\n")
|
||||
return
|
||||
|
||||
raise ValueError(f"Definition for {name} could not be processed.")
|
||||
|
||||
|
||||
extra_defs = []
|
||||
|
||||
|
||||
@dataclass
|
||||
class StructField:
|
||||
viz: Literal["pub"] | Literal["const"]
|
||||
name: str
|
||||
type_name: str
|
||||
serde: str | None = None
|
||||
ts: str | None = None
|
||||
comment: str | None = None
|
||||
|
||||
def append(self, out: list[str], supports_const: bool) -> None:
|
||||
if self.comment:
|
||||
out.append(f" // {self.comment}\n")
|
||||
if self.serde:
|
||||
out.append(f" {self.serde}\n")
|
||||
if self.ts:
|
||||
out.append(f" {self.ts}\n")
|
||||
if self.viz == "const":
|
||||
if supports_const:
|
||||
out.append(f" const {self.name}: {self.type_name};\n")
|
||||
else:
|
||||
out.append(f" pub {self.name}: String, // {self.type_name}\n")
|
||||
else:
|
||||
out.append(f" pub {self.name}: {self.type_name},\n")
|
||||
|
||||
|
||||
def define_struct(
|
||||
name: str,
|
||||
properties: dict[str, Any],
|
||||
required_props: set[str],
|
||||
description: str | None,
|
||||
) -> list[str]:
|
||||
out: list[str] = []
|
||||
|
||||
fields: list[StructField] = []
|
||||
for prop_name, prop in properties.items():
|
||||
if prop_name == "_meta":
|
||||
# TODO?
|
||||
continue
|
||||
elif prop_name == "jsonrpc":
|
||||
fields.append(
|
||||
StructField(
|
||||
"pub",
|
||||
"jsonrpc",
|
||||
"String", # cannot use `&'static str` because of Deserialize
|
||||
'#[serde(rename = "jsonrpc", default = "default_jsonrpc")]',
|
||||
)
|
||||
)
|
||||
continue
|
||||
|
||||
prop_type = map_type(prop, prop_name, name)
|
||||
is_optional = prop_name not in required_props
|
||||
if is_optional:
|
||||
prop_type = f"Option<{prop_type}>"
|
||||
rs_prop = rust_prop_name(prop_name, is_optional)
|
||||
if prop_type.startswith("&'static str"):
|
||||
fields.append(StructField("const", rs_prop.name, prop_type, rs_prop.serde, rs_prop.ts))
|
||||
else:
|
||||
fields.append(StructField("pub", rs_prop.name, prop_type, rs_prop.serde, rs_prop.ts))
|
||||
|
||||
# Special-case: add LLMX-specific user_agent to Implementation
|
||||
if name == "Implementation":
|
||||
fields.append(
|
||||
StructField(
|
||||
"pub",
|
||||
"user_agent",
|
||||
"Option<String>",
|
||||
'#[serde(default, skip_serializing_if = "Option::is_none")]',
|
||||
'#[ts(optional)]',
|
||||
"This is an extra field that the LLMX MCP server sends as part of InitializeResult.",
|
||||
)
|
||||
)
|
||||
|
||||
if implements_request_trait(name):
|
||||
add_trait_impl(name, "ModelContextProtocolRequest", fields, out)
|
||||
elif implements_notification_trait(name):
|
||||
add_trait_impl(name, "ModelContextProtocolNotification", fields, out)
|
||||
else:
|
||||
# Add doc comment if available.
|
||||
emit_doc_comment(description, out)
|
||||
out.append(STANDARD_DERIVE)
|
||||
out.append(f"pub struct {name} {{\n")
|
||||
for field in fields:
|
||||
field.append(out, supports_const=False)
|
||||
out.append("}\n\n")
|
||||
|
||||
# Declare any extra structs after the main struct.
|
||||
if extra_defs:
|
||||
out.extend(extra_defs)
|
||||
# Clear the extra structs for the next definition.
|
||||
extra_defs.clear()
|
||||
return out
|
||||
|
||||
|
||||
def infer_result_type(request_type_name: str) -> str:
|
||||
"""Return the corresponding Result type name for a given *Request name."""
|
||||
if not request_type_name.endswith("Request"):
|
||||
return "Result" # fallback
|
||||
candidate = request_type_name[:-7] + "Result"
|
||||
if candidate in DEFINITIONS:
|
||||
return candidate
|
||||
# Fallback to generic Result if specific one missing.
|
||||
return "Result"
|
||||
|
||||
|
||||
def implements_request_trait(name: str) -> bool:
|
||||
return name.endswith("Request") and name not in (
|
||||
"Request",
|
||||
"JSONRPCRequest",
|
||||
"PaginatedRequest",
|
||||
)
|
||||
|
||||
|
||||
def implements_notification_trait(name: str) -> bool:
|
||||
return name.endswith("Notification") and name not in (
|
||||
"Notification",
|
||||
"JSONRPCNotification",
|
||||
)
|
||||
|
||||
|
||||
def add_trait_impl(
|
||||
type_name: str, trait_name: str, fields: list[StructField], out: list[str]
|
||||
) -> None:
|
||||
out.append(STANDARD_DERIVE)
|
||||
out.append(f"pub enum {type_name} {{}}\n\n")
|
||||
|
||||
out.append(f"impl {trait_name} for {type_name} {{\n")
|
||||
for field in fields:
|
||||
if field.name == "method":
|
||||
field.name = "METHOD"
|
||||
field.append(out, supports_const=True)
|
||||
elif field.name == "params":
|
||||
out.append(f" type Params = {field.type_name};\n")
|
||||
else:
|
||||
print(f"Warning: {type_name} has unexpected field {field.name}.")
|
||||
if trait_name == "ModelContextProtocolRequest":
|
||||
result_type = infer_result_type(type_name)
|
||||
out.append(f" type Result = {result_type};\n")
|
||||
out.append("}\n\n")
|
||||
|
||||
|
||||
def define_string_enum(
|
||||
name: str, enum_values: Any, out: list[str], description: str | None
|
||||
) -> None:
|
||||
emit_doc_comment(description, out)
|
||||
out.append(STANDARD_DERIVE)
|
||||
out.append(f"pub enum {name} {{\n")
|
||||
for value in enum_values:
|
||||
assert isinstance(value, str)
|
||||
out.append(f' #[serde(rename = "{value}")]\n')
|
||||
out.append(f" {capitalize(value)},\n")
|
||||
|
||||
out.append("}\n\n")
|
||||
|
||||
|
||||
def define_untagged_enum(name: str, type_list: list[str], out: list[str]) -> None:
|
||||
out.append(STANDARD_HASHABLE_DERIVE)
|
||||
out.append("#[serde(untagged)]\n")
|
||||
out.append(f"pub enum {name} {{\n")
|
||||
for simple_type in type_list:
|
||||
match simple_type:
|
||||
case "string":
|
||||
out.append(" String(String),\n")
|
||||
case "integer":
|
||||
out.append(" Integer(i64),\n")
|
||||
case _:
|
||||
raise ValueError(f"Unknown type in untagged enum: {simple_type} in {name}")
|
||||
out.append("}\n\n")
|
||||
|
||||
|
||||
def define_any_of(name: str, list_of_refs: list[Any], description: str | None = None) -> list[str]:
|
||||
"""Generate a Rust enum for a JSON-Schema `anyOf` union.
|
||||
|
||||
For most types we simply map each `$ref` inside the `anyOf` list to a
|
||||
similarly named enum variant that holds the referenced type as its
|
||||
payload. For certain well-known composite types (currently only
|
||||
`ClientRequest`) we need a little bit of extra intelligence:
|
||||
|
||||
* The JSON shape of a request is `{ "method": <string>, "params": <object?> }`.
|
||||
* We want to deserialize directly into `ClientRequest` using Serde's
|
||||
`#[serde(tag = "method", content = "params")]` representation so that
|
||||
the enum payload is **only** the request's `params` object.
|
||||
* Therefore each enum variant needs to carry the dedicated `…Params` type
|
||||
(wrapped in `Option<…>` if the `params` field is not required), not the
|
||||
full `…Request` struct from the schema definition.
|
||||
"""
|
||||
|
||||
# Verify each item in list_of_refs is a dict with a $ref key.
|
||||
refs = [item["$ref"] for item in list_of_refs if isinstance(item, dict)]
|
||||
|
||||
out: list[str] = []
|
||||
if description:
|
||||
emit_doc_comment(description, out)
|
||||
out.append(STANDARD_DERIVE)
|
||||
|
||||
if serde := get_serde_annotation_for_anyof_type(name):
|
||||
out.append(serde + "\n")
|
||||
|
||||
if name in LARGE_ENUMS:
|
||||
out.append("#[allow(clippy::large_enum_variant)]\n")
|
||||
out.append(f"pub enum {name} {{\n")
|
||||
|
||||
if name == "ClientRequest":
|
||||
# Record the set of request type names so we can later generate a
|
||||
# `TryFrom<JSONRPCRequest>` implementation.
|
||||
global CLIENT_REQUEST_TYPE_NAMES
|
||||
CLIENT_REQUEST_TYPE_NAMES = [type_from_ref(r) for r in refs]
|
||||
|
||||
if name == "ServerNotification":
|
||||
global SERVER_NOTIFICATION_TYPE_NAMES
|
||||
SERVER_NOTIFICATION_TYPE_NAMES = [type_from_ref(r) for r in refs]
|
||||
|
||||
for ref in refs:
|
||||
ref_name = type_from_ref(ref)
|
||||
|
||||
# For JSONRPCMessage variants, drop the common "JSONRPC" prefix to
|
||||
# make the enum easier to read (e.g. `Request` instead of
|
||||
# `JSONRPCRequest`). The payload type remains unchanged.
|
||||
variant_name = (
|
||||
ref_name[len("JSONRPC") :]
|
||||
if name == "JSONRPCMessage" and ref_name.startswith("JSONRPC")
|
||||
else ref_name
|
||||
)
|
||||
|
||||
# Special-case for `ClientRequest` and `ServerNotification` so the enum
|
||||
# variant's payload is the *Params type rather than the full *Request /
|
||||
# *Notification marker type.
|
||||
if name in ("ClientRequest", "ServerNotification"):
|
||||
# Rely on the trait implementation to tell us the exact Rust type
|
||||
# of the `params` payload. This guarantees we stay in sync with any
|
||||
# special-case logic used elsewhere (e.g. objects with
|
||||
# `additionalProperties` mapping to `serde_json::Value`).
|
||||
if name == "ClientRequest":
|
||||
payload_type = f"<{ref_name} as ModelContextProtocolRequest>::Params"
|
||||
else:
|
||||
payload_type = f"<{ref_name} as ModelContextProtocolNotification>::Params"
|
||||
|
||||
# Determine the wire value for `method` so we can annotate the
|
||||
# variant appropriately. If for some reason the schema does not
|
||||
# specify a constant we fall back to the type name, which will at
|
||||
# least compile (although deserialization will likely fail).
|
||||
request_def = DEFINITIONS.get(ref_name, {})
|
||||
method_const = (
|
||||
request_def.get("properties", {}).get("method", {}).get("const", ref_name)
|
||||
)
|
||||
|
||||
out.append(f' #[serde(rename = "{method_const}")]\n')
|
||||
out.append(f" {variant_name}({payload_type}),\n")
|
||||
else:
|
||||
# The regular/straight-forward case.
|
||||
out.append(f" {variant_name}({ref_name}),\n")
|
||||
|
||||
out.append("}\n\n")
|
||||
return out
|
||||
|
||||
|
||||
def get_serde_annotation_for_anyof_type(type_name: str) -> str | None:
|
||||
# TODO: Solve this in a more generic way.
|
||||
match type_name:
|
||||
case "ClientRequest":
|
||||
return '#[serde(tag = "method", content = "params")]'
|
||||
case "ServerNotification":
|
||||
return '#[serde(tag = "method", content = "params")]'
|
||||
case _:
|
||||
return "#[serde(untagged)]"
|
||||
|
||||
|
||||
def map_type(
|
||||
typedef: dict[str, Any],
|
||||
prop_name: str | None = None,
|
||||
struct_name: str | None = None,
|
||||
) -> str:
|
||||
"""typedef must have a `type` key, but may also have an `items`key."""
|
||||
ref_prop = typedef.get("$ref", None)
|
||||
if ref_prop:
|
||||
return type_from_ref(ref_prop)
|
||||
|
||||
any_of = typedef.get("anyOf", None)
|
||||
if any_of:
|
||||
assert prop_name is not None
|
||||
assert struct_name is not None
|
||||
custom_type = struct_name + capitalize(prop_name)
|
||||
extra_defs.extend(define_any_of(custom_type, any_of))
|
||||
return custom_type
|
||||
|
||||
type_prop = typedef.get("type", None)
|
||||
if type_prop is None:
|
||||
# Likely `unknown` in TypeScript, like the JSONRPCError.data property.
|
||||
return "serde_json::Value"
|
||||
|
||||
if type_prop == "string":
|
||||
if const_prop := typedef.get("const", None):
|
||||
assert isinstance(const_prop, str)
|
||||
return f'&\'static str = "{const_prop}"'
|
||||
else:
|
||||
return "String"
|
||||
elif type_prop == "integer":
|
||||
return "i64"
|
||||
elif type_prop == "number":
|
||||
return "f64"
|
||||
elif type_prop == "boolean":
|
||||
return "bool"
|
||||
elif type_prop == "array":
|
||||
item_type = typedef.get("items", None)
|
||||
if item_type:
|
||||
item_type = map_type(item_type, prop_name, struct_name)
|
||||
assert isinstance(item_type, str)
|
||||
return f"Vec<{item_type}>"
|
||||
else:
|
||||
raise ValueError("Array type without items.")
|
||||
elif type_prop == "object":
|
||||
# If the schema says `additionalProperties: {}` this is effectively an
|
||||
# open-ended map, so deserialize into `serde_json::Value` for maximum
|
||||
# flexibility.
|
||||
if typedef.get("additionalProperties") is not None:
|
||||
return "serde_json::Value"
|
||||
|
||||
# If there are *no* properties declared treat it similarly.
|
||||
if not typedef.get("properties"):
|
||||
return "serde_json::Value"
|
||||
|
||||
# Otherwise, synthesize a nested struct for the inline object.
|
||||
assert prop_name is not None
|
||||
assert struct_name is not None
|
||||
custom_type = struct_name + capitalize(prop_name)
|
||||
extra_defs.extend(
|
||||
define_struct(
|
||||
custom_type,
|
||||
typedef["properties"],
|
||||
set(typedef.get("required", [])),
|
||||
typedef.get("description"),
|
||||
)
|
||||
)
|
||||
return custom_type
|
||||
else:
|
||||
raise ValueError(f"Unknown type: {type_prop} in {typedef}")
|
||||
|
||||
|
||||
@dataclass
|
||||
class RustProp:
|
||||
name: str
|
||||
# serde annotation, if necessary
|
||||
serde: str | None = None
|
||||
# ts annotation, if necessary
|
||||
ts: str | None = None
|
||||
|
||||
def rust_prop_name(name: str, is_optional: bool) -> RustProp:
|
||||
"""Convert a JSON property name to a Rust property name."""
|
||||
prop_name: str
|
||||
is_rename = False
|
||||
if name == "type":
|
||||
prop_name = "r#type"
|
||||
elif name == "ref":
|
||||
prop_name = "r#ref"
|
||||
elif name == "enum":
|
||||
prop_name = "r#enum"
|
||||
elif snake_case := to_snake_case(name):
|
||||
prop_name = snake_case
|
||||
is_rename = True
|
||||
else:
|
||||
prop_name = name
|
||||
|
||||
serde_annotations = []
|
||||
ts_str = None
|
||||
if is_rename:
|
||||
serde_annotations.append(f'rename = "{name}"')
|
||||
if is_optional:
|
||||
serde_annotations.append("default")
|
||||
serde_annotations.append('skip_serializing_if = "Option::is_none"')
|
||||
|
||||
if serde_annotations:
|
||||
# Also mark optional fields for ts-rs generation.
|
||||
serde_str = f"#[serde({', '.join(serde_annotations)})]"
|
||||
else:
|
||||
serde_str = None
|
||||
|
||||
if is_optional and serde_str:
|
||||
ts_str = "#[ts(optional)]"
|
||||
|
||||
return RustProp(prop_name, serde_str, ts_str)
|
||||
|
||||
|
||||
def to_snake_case(name: str) -> str | None:
|
||||
"""Convert a camelCase or PascalCase name to snake_case."""
|
||||
snake_case = name[0].lower() + "".join("_" + c.lower() if c.isupper() else c for c in name[1:])
|
||||
if snake_case != name:
|
||||
return snake_case
|
||||
else:
|
||||
return None
|
||||
|
||||
|
||||
def capitalize(name: str) -> str:
|
||||
"""Capitalize the first letter of a name."""
|
||||
return name[0].upper() + name[1:]
|
||||
|
||||
|
||||
def check_string_list(value: Any) -> list[str] | None:
|
||||
"""If the value is a list of strings, return it. Otherwise, return None."""
|
||||
if not isinstance(value, list):
|
||||
return None
|
||||
for item in value:
|
||||
if not isinstance(item, str):
|
||||
return None
|
||||
return value
|
||||
|
||||
|
||||
def type_from_ref(ref: str) -> str:
|
||||
"""Convert a JSON reference to a Rust type."""
|
||||
assert ref.startswith("#/definitions/")
|
||||
return ref.split("/")[-1]
|
||||
|
||||
|
||||
def emit_doc_comment(text: str | None, out: list[str]) -> None:
|
||||
"""Append Rust doc comments derived from the JSON-schema description."""
|
||||
if not text:
|
||||
return
|
||||
for line in text.strip().split("\n"):
|
||||
out.append(f"/// {line.rstrip()}\n")
|
||||
|
||||
|
||||
def eprint(*args: Any, **kwargs: Any) -> None:
|
||||
print(*args, file=sys.stderr, **kwargs)
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
sys.exit(main())
|
||||
2139
llmx-rs/mcp-types/schema/2025-03-26/schema.json
Normal file
2139
llmx-rs/mcp-types/schema/2025-03-26/schema.json
Normal file
File diff suppressed because it is too large
Load Diff
2517
llmx-rs/mcp-types/schema/2025-06-18/schema.json
Normal file
2517
llmx-rs/mcp-types/schema/2025-06-18/schema.json
Normal file
File diff suppressed because it is too large
Load Diff
1704
llmx-rs/mcp-types/src/lib.rs
Normal file
1704
llmx-rs/mcp-types/src/lib.rs
Normal file
File diff suppressed because it is too large
Load Diff
3
llmx-rs/mcp-types/tests/all.rs
Normal file
3
llmx-rs/mcp-types/tests/all.rs
Normal file
@@ -0,0 +1,3 @@
|
||||
// Single integration test binary that aggregates all test modules.
|
||||
// The submodules live in `tests/suite/`.
|
||||
mod suite;
|
||||
70
llmx-rs/mcp-types/tests/suite/initialize.rs
Normal file
70
llmx-rs/mcp-types/tests/suite/initialize.rs
Normal file
@@ -0,0 +1,70 @@
|
||||
use mcp_types::ClientCapabilities;
|
||||
use mcp_types::ClientRequest;
|
||||
use mcp_types::Implementation;
|
||||
use mcp_types::InitializeRequestParams;
|
||||
use mcp_types::JSONRPC_VERSION;
|
||||
use mcp_types::JSONRPCMessage;
|
||||
use mcp_types::JSONRPCRequest;
|
||||
use mcp_types::RequestId;
|
||||
use serde_json::json;
|
||||
|
||||
#[test]
|
||||
fn deserialize_initialize_request() {
|
||||
let raw = r#"{
|
||||
"jsonrpc": "2.0",
|
||||
"id": 1,
|
||||
"method": "initialize",
|
||||
"params": {
|
||||
"capabilities": {},
|
||||
"clientInfo": { "name": "acme-client", "title": "Acme", "version": "1.2.3" },
|
||||
"protocolVersion": "2025-06-18"
|
||||
}
|
||||
}"#;
|
||||
|
||||
// Deserialize full JSONRPCMessage first.
|
||||
let msg: JSONRPCMessage =
|
||||
serde_json::from_str(raw).expect("failed to deserialize JSONRPCMessage");
|
||||
|
||||
// Extract the request variant.
|
||||
let JSONRPCMessage::Request(json_req) = msg else {
|
||||
unreachable!()
|
||||
};
|
||||
|
||||
let expected_req = JSONRPCRequest {
|
||||
jsonrpc: JSONRPC_VERSION.into(),
|
||||
id: RequestId::Integer(1),
|
||||
method: "initialize".into(),
|
||||
params: Some(json!({
|
||||
"capabilities": {},
|
||||
"clientInfo": { "name": "acme-client", "title": "Acme", "version": "1.2.3" },
|
||||
"protocolVersion": "2025-06-18"
|
||||
})),
|
||||
};
|
||||
|
||||
assert_eq!(json_req, expected_req);
|
||||
|
||||
let client_req: ClientRequest =
|
||||
ClientRequest::try_from(json_req).expect("conversion must succeed");
|
||||
let ClientRequest::InitializeRequest(init_params) = client_req else {
|
||||
unreachable!()
|
||||
};
|
||||
|
||||
assert_eq!(
|
||||
init_params,
|
||||
InitializeRequestParams {
|
||||
capabilities: ClientCapabilities {
|
||||
experimental: None,
|
||||
roots: None,
|
||||
sampling: None,
|
||||
elicitation: None,
|
||||
},
|
||||
client_info: Implementation {
|
||||
name: "acme-client".into(),
|
||||
title: Some("Acme".to_string()),
|
||||
version: "1.2.3".into(),
|
||||
user_agent: None,
|
||||
},
|
||||
protocol_version: "2025-06-18".into(),
|
||||
}
|
||||
);
|
||||
}
|
||||
3
llmx-rs/mcp-types/tests/suite/mod.rs
Normal file
3
llmx-rs/mcp-types/tests/suite/mod.rs
Normal file
@@ -0,0 +1,3 @@
|
||||
// Aggregates all former standalone integration tests as modules.
|
||||
mod initialize;
|
||||
mod progress_notification;
|
||||
43
llmx-rs/mcp-types/tests/suite/progress_notification.rs
Normal file
43
llmx-rs/mcp-types/tests/suite/progress_notification.rs
Normal file
@@ -0,0 +1,43 @@
|
||||
use mcp_types::JSONRPCMessage;
|
||||
use mcp_types::ProgressNotificationParams;
|
||||
use mcp_types::ProgressToken;
|
||||
use mcp_types::ServerNotification;
|
||||
|
||||
#[test]
|
||||
fn deserialize_progress_notification() {
|
||||
let raw = r#"{
|
||||
"jsonrpc": "2.0",
|
||||
"method": "notifications/progress",
|
||||
"params": {
|
||||
"message": "Half way there",
|
||||
"progress": 0.5,
|
||||
"progressToken": 99,
|
||||
"total": 1.0
|
||||
}
|
||||
}"#;
|
||||
|
||||
// Deserialize full JSONRPCMessage first.
|
||||
let msg: JSONRPCMessage = serde_json::from_str(raw).expect("invalid JSONRPCMessage");
|
||||
|
||||
// Extract the notification variant.
|
||||
let JSONRPCMessage::Notification(notif) = msg else {
|
||||
unreachable!()
|
||||
};
|
||||
|
||||
// Convert via generated TryFrom.
|
||||
let server_notif: ServerNotification =
|
||||
ServerNotification::try_from(notif).expect("conversion must succeed");
|
||||
|
||||
let ServerNotification::ProgressNotification(params) = server_notif else {
|
||||
unreachable!()
|
||||
};
|
||||
|
||||
let expected_params = ProgressNotificationParams {
|
||||
message: Some("Half way there".into()),
|
||||
progress: 0.5,
|
||||
progress_token: ProgressToken::Integer(99),
|
||||
total: Some(1.0),
|
||||
};
|
||||
|
||||
assert_eq!(params, expected_params);
|
||||
}
|
||||
Reference in New Issue
Block a user