valknar/llmx
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
3c7efc58c86b35054cd26a5d3d0f9ae650ad5cc8
llmx/llmx-rs/FIXED-LITELLM-INTEGRATION.md
Sebastian Krüger 3c7efc58c8 feat: Complete LLMX v0.1.0 - Rebrand from Codex with LiteLLM Integration 
This release represents a comprehensive transformation of the codebase from Codex to LLMX,
enhanced with LiteLLM integration to support 100+ LLM providers through a unified API.

## Major Changes

### Phase 1: Repository & Infrastructure Setup
- Established new repository structure and branching strategy
- Created comprehensive project documentation (CLAUDE.md, LITELLM-SETUP.md)
- Set up development environment and tooling configuration

### Phase 2: Rust Workspace Transformation
- Renamed all Rust crates from `codex-*` to `llmx-*` (30+ crates)
- Updated package names, binary names, and workspace members
- Renamed core modules: codex.rs → llmx.rs, codex_delegate.rs → llmx_delegate.rs
- Updated all internal references, imports, and type names
- Renamed directories: codex-rs/ → llmx-rs/, codex-backend-openapi-models/ → llmx-backend-openapi-models/
- Fixed all Rust compilation errors after mass rename

### Phase 3: LiteLLM Integration
- Integrated LiteLLM for multi-provider LLM support (Anthropic, OpenAI, Azure, Google AI, AWS Bedrock, etc.)
- Implemented OpenAI-compatible Chat Completions API support
- Added model family detection and provider-specific handling
- Updated authentication to support LiteLLM API keys
- Renamed environment variables: OPENAI_BASE_URL → LLMX_BASE_URL
- Added LLMX_API_KEY for unified authentication
- Enhanced error handling for Chat Completions API responses
- Implemented fallback mechanisms between Responses API and Chat Completions API

### Phase 4: TypeScript/Node.js Components
- Renamed npm package: @codex/codex-cli → @valknar/llmx
- Updated TypeScript SDK to use new LLMX APIs and endpoints
- Fixed all TypeScript compilation and linting errors
- Updated SDK tests to support both API backends
- Enhanced mock server to handle multiple API formats
- Updated build scripts for cross-platform packaging

### Phase 5: Configuration & Documentation
- Updated all configuration files to use LLMX naming
- Rewrote README and documentation for LLMX branding
- Updated config paths: ~/.codex/ → ~/.llmx/
- Added comprehensive LiteLLM setup guide
- Updated all user-facing strings and help text
- Created release plan and migration documentation

### Phase 6: Testing & Validation
- Fixed all Rust tests for new naming scheme
- Updated snapshot tests in TUI (36 frame files)
- Fixed authentication storage tests
- Updated Chat Completions payload and SSE tests
- Fixed SDK tests for new API endpoints
- Ensured compatibility with Claude Sonnet 4.5 model
- Fixed test environment variables (LLMX_API_KEY, LLMX_BASE_URL)

### Phase 7: Build & Release Pipeline
- Updated GitHub Actions workflows for LLMX binary names
- Fixed rust-release.yml to reference llmx-rs/ instead of codex-rs/
- Updated CI/CD pipelines for new package names
- Made Apple code signing optional in release workflow
- Enhanced npm packaging resilience for partial platform builds
- Added Windows sandbox support to workspace
- Updated dotslash configuration for new binary names

### Phase 8: Final Polish
- Renamed all assets (.github images, labels, templates)
- Updated VSCode and DevContainer configurations
- Fixed all clippy warnings and formatting issues
- Applied cargo fmt and prettier formatting across codebase
- Updated issue templates and pull request templates
- Fixed all remaining UI text references

## Technical Details

**Breaking Changes:**
- Binary name changed from `codex` to `llmx`
- Config directory changed from `~/.codex/` to `~/.llmx/`
- Environment variables renamed (CODEX_* → LLMX_*)
- npm package renamed to `@valknar/llmx`

**New Features:**
- Support for 100+ LLM providers via LiteLLM
- Unified authentication with LLMX_API_KEY
- Enhanced model provider detection and handling
- Improved error handling and fallback mechanisms

**Files Changed:**
- 578 files modified across Rust, TypeScript, and documentation
- 30+ Rust crates renamed and updated
- Complete rebrand of UI, CLI, and documentation
- All tests updated and passing

**Dependencies:**
- Updated Cargo.lock with new package names
- Updated npm dependencies in llmx-cli
- Enhanced OpenAPI models for LLMX backend

This release establishes LLMX as a standalone project with comprehensive LiteLLM
integration, maintaining full backward compatibility with existing functionality
while opening support for a wide ecosystem of LLM providers.

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
Co-Authored-By: Sebastian Krüger <support@pivoine.art>
2025-11-12 20:40:44 +01:00

2.4 KiB
Raw Blame History

✅ FIXED: LiteLLM Integration with LLMX

The Root Cause

The prompt_cache_key: Extra inputs are not permitted error was caused by a hardcoded default provider.

File: llmx-rs/core/src/config/mod.rs:983 Problem: Default provider was set to "openai" which uses the Responses API Fix: Changed default to "litellm" which uses the Chat Completions API

The Error Chain

  1. No provider specified → defaults to "openai"
  2. OpenAI provider → uses wire_api: WireApi::Responses
  3. Responses API → sends prompt_cache_key field in requests
  4. LiteLLM Chat Completions API → rejects prompt_cache_key → 400 error

The Solution

Changed one line in llmx-rs/core/src/config/mod.rs:

// BEFORE:
.unwrap_or_else(|| "openai".to_string());

// AFTER:
.unwrap_or_else(|| "litellm".to_string());

Current Status ✅

  • Binary Built: llmx-rs/target/release/llmx (44MB, built at 16:36)
  • Default Provider: LiteLLM (uses Chat Completions API)
  • Default Model: anthropic/claude-sonnet-4-20250514
  • Commit: e3507a7f

How to Use Now

Option 1: Use Environment Variables (Recommended)

export LITELLM_BASE_URL="https://llm.ai.pivoine.art/v1"
export LITELLM_API_KEY="your-api-key"

# Just run - no config needed!
./llmx-rs/target/release/llmx "hello world"

Option 2: Use Config File

Config at ~/.llmx/config.toml (already created):

model_provider = "litellm"  # Optional - this is now the default!
model = "anthropic/claude-sonnet-4-20250514"

Option 3: Override via CLI

./llmx-rs/target/release/llmx -m "openai/gpt-4" "hello"

What This Fixes

✅ No more prompt_cache_key errors ✅ Correct API endpoint (/v1/chat/completions) ✅ Works with LiteLLM proxy out of the box ✅ No manual provider configuration needed ✅ Config file is now optional (defaults work)

Commits in This Session

  1. 831e6fa6 - Complete comprehensive Llmx → LLMX branding (78 files, 242 changes)
  2. 424090f2 - Add LiteLLM setup documentation
  3. e3507a7f - Fix default provider from 'openai' to 'litellm' ⭐

Testing

Try this now:

export LITELLM_BASE_URL="https://llm.ai.pivoine.art/v1"
export LITELLM_API_KEY="your-key"
./llmx-rs/target/release/llmx "say hello"

Should work without any 400 errors!

Binary Location

/home/valknar/Projects/llmx/llmx/llmx-rs/target/release/llmx

Built: November 11, 2025 at 16:36 Size: 44MB Version: 0.0.0

Reference in New Issue View Git Blame Copy Permalink