summarylogtreecommitdiffstats
path: root/sglang@.service
AgeCommit message (Collapse)Author
2026-04-14Bake --sleep-on-idle into service fileWill Handley
Prevents scheduler busy-wait burning a CPU core at idle. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-07Template service, per-model configs, sleep-on-idle defaultWill Handley
- Replace sglang.service with sglang@.service template unit - Add per-model config files for Gemma 4 and Qwen 3.5 variants - Default to --sleep-on-idle to reduce CPU usage when idle - Update sglang.conf as global config with SGLANG_OPTS/SGLANG_ARGS split Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>