LLM timeout default 60 s → 180 s (v0.21.4) #47

Merged
kamilkrzywda merged 1 commits from fix/llm-timeout into main 2026-09-26 11:55:54 +02:00
Owner

Production incident: #rss get lublin failed with "summary failed: The operation was aborted due to timeout" — the LlmService call hit its 60 s cap while the local OpenAI-compatible server (qwen3.8-27b, uncontrollable reasoning tokens) was in a slow/busy period. Same endpoint answers trivial prompts in ~1 s when idle, so this is latency variance on the server side.

  • LLM_TIMEOUT_MS default 60000 → 180000 (3 min headroom); still env-overridable
  • AGENTS.md + code comment synced

No test changes needed (spec pins its own timeout). Build clean, oxlint clean. Lockfile untouched.

Production incident: `#rss get lublin` failed with "summary failed: The operation was aborted due to timeout" — the LlmService call hit its 60 s cap while the local OpenAI-compatible server (qwen3.8-27b, uncontrollable reasoning tokens) was in a slow/busy period. Same endpoint answers trivial prompts in ~1 s when idle, so this is latency variance on the server side. - LLM_TIMEOUT_MS default 60000 → **180000** (3 min headroom); still env-overridable - AGENTS.md + code comment synced No test changes needed (spec pins its own timeout). Build clean, oxlint clean. Lockfile untouched.
kamilkrzywda added 1 commit 2026-09-26 11:55:47 +02:00
LLM_TIMEOUT_MS default 60 s -> 3 min (v0.21.4)
CI / build + unit (pull_request) Failing after 21s
98b9ec5185
Production incident: '#rss get lublin' at 9:41 AM failed with 'The operation
was aborted due to timeout' — the LlmService call hit its 60 s cap while the
local OpenAI-compatible server (qwen3.8-27b, uncontrollable reasoning tokens)
was slow/busy. The same endpoint answers a trivial prompt in ~1 s when idle,
so this is latency variance on the server side, not a dead endpoint.

Bump the LLM_TIMEOUT_MS fallback from 60000 to 180000 (3 min headroom for
slow reasoning periods); still env-overridable, only the default changed.
kamilkrzywda merged commit 3f6c02d71e into main 2026-09-26 11:55:54 +02:00
kamilkrzywda deleted branch fix/llm-timeout 2026-09-26 11:55:54 +02:00
Sign in to join this conversation.
No Reviewers
No labels
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: OpenCode/MeshBot#47