Hi everyone!
2026.5.0 Beta4, 2026.4.1, and 2026.3.2 are now available on the public Python package repository.
2026.5.0 Beta4 — improvements since Beta3
- Implemented repetition_detection for the OpenAI-compatible Completions and Chat Completions APIs.
- Added return_prompt_text for Chat Completions and support for interleaved reasoning in chat templates.
- JSON-schema structured outputs now disable extra whitespace by default.
- Improved KV-cache allocation for long-context serving, with clearer startup errors when the requested context length exceeds available capacity.
- Improved native multimodal request handling and fixed sampled-token and vision-buffer allocation issues.
2026.4.1 and 2026.3.2 — security hotfix
• eMudhra-related certificate trust updates and Python dependency security fixes
Installation
Choose the version for your release line:
# 2026.5.0 beta4
uv pip install --prerelease=allow --torch-backend auto furiosa-llm==2026.5.0b4
# Latest stable
uv pip install --torch-backend auto furiosa-llm==2026.4.1
# 2026.3 release
uv pip install --torch-backend auto furiosa-llm==2026.3.2