Fix batch inference#511

Open

makaveli10 wants to merge 2 commits into

collabora:mainfrom

makaveli10:fix-batch-inference

Commits on Jun 16, 2026

Enable single-model mode for stock models when batch_inference is set
makaveli10
committed
fix(batch): add temperature fallback to prevent decoder runaway
makaveli10
committed