Skip to content

chore(llm): Removing Claude Haiku 3.5#7577

Merged
justin-tahara merged 1 commit intomainfrom
jtahara/removing-claude-haiku-3.5
Jan 20, 2026
Merged

chore(llm): Removing Claude Haiku 3.5#7577
justin-tahara merged 1 commit intomainfrom
jtahara/removing-claude-haiku-3.5

Conversation

@justin-tahara
Copy link
Copy Markdown
Contributor

@justin-tahara justin-tahara commented Jan 20, 2026

Description

Removing to stay ahead

Screenshot 2026-01-20 at 10 36 37 AM

How Has This Been Tested?

Ran updated tests

Additional Options

  • [Optional] Override Linear Check

Summary by cubic

Removed all Claude Haiku 3.5 model aliases from the LLM registry and updated the Anthropic prompt-caching test to a supported Haiku model. This removes a deprecated option and keeps caching metrics coverage.

  • Migration
    • Update any configs using claude-3-5-haiku* IDs (incl. Bedrock/OpenRouter/Vertex AI variants) to claude-haiku-4-5-20251001 or another supported Anthropic model.

Written for commit 199b0d7. Summary will update on new commits.

@justin-tahara justin-tahara requested a review from a team as a code owner January 20, 2026 18:37
@greptile-apps
Copy link
Copy Markdown
Contributor

greptile-apps bot commented Jan 20, 2026

Greptile Summary

This PR removes the deprecated claude-3-5-haiku model from the codebase and updates tests to use the newer claude-haiku-4-5 model naming convention.

  • Removed all claude-3-5-haiku variants from model metadata (direct Anthropic, Bedrock, OpenRouter, Vertex AI)
  • Updated prompt caching test to use claude-haiku-4-5-20251001 instead of claude-3-5-haiku-20241022
  • Changes align with existing model naming in constants.py which already uses claude-haiku-4-5

Confidence Score: 5/5

  • This PR is safe to merge - it's a clean model removal with consistent updates across all references.
  • Simple metadata-only changes removing a deprecated model. All references have been consistently updated. The replacement model exists in the metadata file. No code logic changes.
  • No files require special attention.

Important Files Changed

Filename Overview
backend/onyx/llm/model_metadata_enrichments.json Removed all claude-3-5-haiku model entries across multiple providers (Anthropic, Bedrock, OpenRouter, Vertex AI). Consistent removal with no residual references.
backend/tests/external_dependency_unit/llm/test_prompt_caching.py Updated test to use claude-haiku-4-5-20251001 instead of claude-3-5-haiku-20241022. The new model exists in model_metadata_enrichments.json.

Sequence Diagram

sequenceDiagram
    participant User
    participant LitellmLLM
    participant Anthropic API
    
    Note over User,Anthropic API: Before PR: claude-3-5-haiku-20241022
    User->>LitellmLLM: Request with model name
    LitellmLLM->>Anthropic API: Call claude-3-5-haiku
    Anthropic API-->>LitellmLLM: Response
    LitellmLLM-->>User: Model response
    
    Note over User,Anthropic API: After PR: claude-haiku-4-5-20251001
    User->>LitellmLLM: Request with model name
    LitellmLLM->>Anthropic API: Call claude-haiku-4-5
    Anthropic API-->>LitellmLLM: Response
    LitellmLLM-->>User: Model response
Loading

Copy link
Copy Markdown
Contributor

@cubic-dev-ai cubic-dev-ai bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 2 files

@justin-tahara justin-tahara added this pull request to the merge queue Jan 20, 2026
Merged via the queue into main with commit ba906ae Jan 20, 2026
116 of 122 checks passed
@justin-tahara justin-tahara deleted the jtahara/removing-claude-haiku-3.5 branch January 20, 2026 19:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants