Skip to content

Replace retired manager LLM default with claude-opus-4-8 #115

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
aleksUIX wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Replace retired manager LLM default with claude-opus-4-8 #115

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .env.example
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ OPENDIRECT_API_KEY=
# Provider: Anthropic (default)
ANTHROPIC_API_KEY=your-anthropic-api-key-here
DEFAULT_LLM_MODEL=anthropic/claude-sonnet-4-5-20250929
MANAGER_LLM_MODEL=anthropic/claude-opus-4-20250514
MANAGER_LLM_MODEL=anthropic/claude-opus-4-8
LLM_TEMPERATURE=0.3
LLM_MAX_TOKENS=4096

Expand All @@ -37,7 +37,7 @@ LLM_MAX_TOKENS=4096
# AWS_SECRET_ACCESS_KEY=your-aws-secret-key
# AWS_REGION=us-west-2
# DEFAULT_LLM_MODEL=bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0
# MANAGER_LLM_MODEL=bedrock/us.anthropic.claude-opus-4-20250514-v1:0
# MANAGER_LLM_MODEL=bedrock/us.anthropic.claude-opus-4-8

# Provider: Custom OpenAI-compatible endpoint (alternative)
# For endpoints with no CrewAI native provider prefix of their own — NVIDIA
Expand Down
2 changes: 1 addition & 1 deletion docs/ai-assistant/developer-setup.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,7 @@ CORS_ALLOWED_ORIGINS=http://localhost:3000,http://localhost:8080

# LLM model overrides (optional)
DEFAULT_LLM_MODEL=anthropic/claude-sonnet-4-5-20250929
MANAGER_LLM_MODEL=anthropic/claude-opus-4-20250514
MANAGER_LLM_MODEL=anthropic/claude-opus-4-8
```

## Step 6: Start the Server
Expand Down
2 changes: 1 addition & 1 deletion docs/architecture/agent-hierarchy.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -61,7 +61,7 @@ The Portfolio Manager is the top-level orchestrator. It receives a campaign brie
| Attribute | Value |
|-----------|-------|
| Role | Portfolio Manager |
| LLM | `anthropic/claude-opus-4-20250514` (configurable via `MANAGER_LLM_MODEL`) |
| LLM | `anthropic/claude-opus-4-8` (configurable via `MANAGER_LLM_MODEL`) |
| Temperature | 0.3 |
| Delegation | Enabled --- delegates to Level 2 agents |
| Memory | Enabled |
Expand Down
2 changes: 1 addition & 1 deletion docs/getting-started/quickstart.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ ANTHROPIC_API_KEY=sk-ant-...

# LLM model overrides — uses provider/model format (native Anthropic, OpenAI, Gemini, Azure, Bedrock)
DEFAULT_LLM_MODEL=anthropic/claude-sonnet-4-5-20250929
MANAGER_LLM_MODEL=anthropic/claude-opus-4-20250514
MANAGER_LLM_MODEL=anthropic/claude-opus-4-8
# DEFAULT_LLM_MODEL=openai/gpt-4o # OpenAI example
# DEFAULT_LLM_MODEL=ollama/llama3 # Local Ollama example

Expand Down
6 changes: 3 additions & 3 deletions docs/guides/configuration.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ IAB_SERVER_URL=http://localhost:8001

# Optional overrides
DEFAULT_LLM_MODEL=anthropic/claude-sonnet-4-5-20250929
MANAGER_LLM_MODEL=anthropic/claude-opus-4-20250514
MANAGER_LLM_MODEL=anthropic/claude-opus-4-8
LOG_LEVEL=INFO
```

Expand Down Expand Up @@ -81,7 +81,7 @@ endpoints = settings.get_seller_endpoints()
| Variable | Type | Default | Description |
|----------|------|---------|-------------|
| `DEFAULT_LLM_MODEL` | `str` | `anthropic/claude-sonnet-4-5-20250929` | Model for Level 2 channel specialists and Level 3 functional agents. |
| `MANAGER_LLM_MODEL` | `str` | `anthropic/claude-opus-4-20250514` | Model for the Level 1 Portfolio Manager. Opus is used for strategic reasoning. |
| `MANAGER_LLM_MODEL` | `str` | `anthropic/claude-opus-4-8` | Model for the Level 1 Portfolio Manager. Opus is used for strategic reasoning. |
| `LLM_TEMPERATURE` | `float` | `0.3` | Default temperature for LLM calls. Individual agents may override this. |
| `LLM_MAX_TOKENS` | `int` | `4096` | Maximum token output for LLM responses. |
| `OPENAI_COMPATIBLE_LLM_API_KEY` | `str` | `None` | API key for a [custom OpenAI-compatible endpoint](#custom-openai-compatible-endpoints) (optional — some endpoints don't require one). |
Expand All @@ -92,7 +92,7 @@ Models are specified in `provider/model-name` format using CrewAI's native provi
```bash
# Use a different model provider
DEFAULT_LLM_MODEL=openai/gpt-4o
MANAGER_LLM_MODEL=anthropic/claude-opus-4-20250514
MANAGER_LLM_MODEL=anthropic/claude-opus-4-8
```

### Supported Providers
Expand Down
6 changes: 3 additions & 3 deletions docs/guides/deployment-ops-guide.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ IAB_SERVER_URL=http://localhost:8000

# LLM models
DEFAULT_LLM_MODEL=anthropic/claude-sonnet-4-5-20250929
MANAGER_LLM_MODEL=anthropic/claude-opus-4-20250514
MANAGER_LLM_MODEL=anthropic/claude-opus-4-8

# Storage
DATABASE_URL=sqlite:///./ad_buyer.db
Expand Down Expand Up @@ -438,15 +438,15 @@ Authentication is enforced via the `X-API-Key` header. Public paths (`/health`,
| Variable | Default | Description |
|----------|---------|-------------|
| `DEFAULT_LLM_MODEL` | `anthropic/claude-sonnet-4-5-20250929` | Model for Level 2 channel specialists and Level 3 functional agents. |
| `MANAGER_LLM_MODEL` | `anthropic/claude-opus-4-20250514` | Model for the Level 1 Portfolio Manager. Opus is used for strategic reasoning. |
| `MANAGER_LLM_MODEL` | `anthropic/claude-opus-4-8` | Model for the Level 1 Portfolio Manager. Opus is used for strategic reasoning. |
| `LLM_TEMPERATURE` | `0.3` | Default temperature. Individual agents use tuned values (0.1–0.5). |
| `LLM_MAX_TOKENS` | `4096` | Maximum token output per LLM call. |

Models use `provider/model-name` format with CrewAI's native provider integrations (Anthropic, OpenAI, Gemini, Azure, Bedrock):

```dotenv
DEFAULT_LLM_MODEL=openai/gpt-4o
MANAGER_LLM_MODEL=anthropic/claude-opus-4-20250514
MANAGER_LLM_MODEL=anthropic/claude-opus-4-8
```

### Storage
Expand Down
2 changes: 1 addition & 1 deletion src/ad_buyer/config/agents.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ portfolio_manager:
mix optimization, and cross-channel attribution.
allow_delegation: true
temperature: 0.3
model: anthropic/claude-opus-4-20250514
model: anthropic/claude-opus-4-8

branding_agent:
role: "Branding Specialist"
Expand Down
2 changes: 1 addition & 1 deletion src/ad_buyer/config/settings.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -121,7 +121,7 @@ def get_seller_endpoints(self) -> list[str]:
# gemini/gemini-2.5-flash (requires GOOGLE_API_KEY)
# bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0 (requires AWS creds)
default_llm_model: str = "anthropic/claude-sonnet-4-5-20250929"
manager_llm_model: str = "anthropic/claude-opus-4-20250514"
manager_llm_model: str = "anthropic/claude-opus-4-8"
llm_temperature: float = 0.3
llm_max_tokens: int = 4096

Expand Down
2 changes: 1 addition & 1 deletion tests/integration/test_api_endpoint_integration.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -149,7 +149,7 @@ def _make_settings(api_key: str = "") -> Settings:
opendirect_token=None,
opendirect_api_key=None,
default_llm_model="anthropic/claude-sonnet-4-5-20250929",
manager_llm_model="anthropic/claude-opus-4-20250514",
manager_llm_model="anthropic/claude-opus-4-8",
llm_temperature=0.3,
llm_max_tokens=4096,
database_url="sqlite:///./ad_buyer.db",
Expand Down
6 changes: 3 additions & 3 deletions tests/integration/test_config_registry_coordination.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ def test_settings_seller_endpoints_parsing(self):
opendirect_token=None,
opendirect_api_key=None,
default_llm_model="anthropic/claude-sonnet-4-5-20250929",
manager_llm_model="anthropic/claude-opus-4-20250514",
manager_llm_model="anthropic/claude-opus-4-8",
llm_temperature=0.3,
llm_max_tokens=4096,
database_url="sqlite:///./test.db",
Expand Down Expand Up @@ -63,7 +63,7 @@ def test_settings_empty_endpoints(self):
opendirect_token=None,
opendirect_api_key=None,
default_llm_model="anthropic/claude-sonnet-4-5-20250929",
manager_llm_model="anthropic/claude-opus-4-20250514",
manager_llm_model="anthropic/claude-opus-4-8",
llm_temperature=0.3,
llm_max_tokens=4096,
database_url="sqlite:///./test.db",
Expand All @@ -90,7 +90,7 @@ def test_cors_origins_parsing(self):
opendirect_token=None,
opendirect_api_key=None,
default_llm_model="anthropic/claude-sonnet-4-5-20250929",
manager_llm_model="anthropic/claude-opus-4-20250514",
manager_llm_model="anthropic/claude-opus-4-8",
llm_temperature=0.3,
llm_max_tokens=4096,
database_url="sqlite:///./test.db",
Expand Down
2 changes: 1 addition & 1 deletion tests/unit/test_api_auth.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ def _make_settings(api_key: str = "") -> Settings:
opendirect_token=None,
opendirect_api_key=None,
default_llm_model="anthropic/claude-sonnet-4-5-20250929",
manager_llm_model="anthropic/claude-opus-4-20250514",
manager_llm_model="anthropic/claude-opus-4-8",
llm_temperature=0.3,
llm_max_tokens=4096,
database_url="sqlite:///./ad_buyer.db",
Expand Down
Loading