• v1.0.7 a287c27665

    v1.0.7 Stable

    kerem released this 2025-12-18 23:13:12 +03:00 | 150 commits to main since this release

    📅 Originally published on GitHub: Thu, 18 Dec 2025 20:20:14 GMT
    🏷️ Git tag created: Thu, 18 Dec 2025 20:13:12 GMT

    Fixed silent streaming failures, added configurable streaming timeouts, and improved error diagnostics.

    New Features

    • Configurable streaming read timeout (#9): Added STREAMING_READ_TIMEOUT environment variable to control how long to wait between chunks during streaming (default: 300s)
    • Timeout configuration warning: Gateway now warns at startup if FIRST_TOKEN_TIMEOUT >= STREAMING_READ_TIMEOUT (suboptimal configuration)

    🐛 Bug Fixes

    • Silent streaming failures (#8): Fixed issue where streaming would "hang" without any error information in logs
      • Exceptions with empty str(e) (like httpx.RemoteProtocolError) now log exception type: [RuntimeError] actual message or [EmptyError] (empty message)
      • Exceptions are now properly propagated to routes.py instead of being silently swallowed
      • GeneratorExit (client disconnect) is handled separately as a normal situation, not an error
      • Response closing in finally block is now wrapped in try/except to prevent masking original errors

    Improvements

    • Timeout logging: Specific timeout types are now correctly identified and logged (ConnectTimeout, ReadTimeout, FirstTokenTimeout) for easier debugging
    • Improved timeout handling: Refactored timeout logic in http_client.py and streaming.py for better reliability
    • Manual test script: Enhanced manual_api_test.py with:
      • Support for loading credentials from KIRO_CREDS_FILE
      • Improved logging using loguru library
      • Better error messages and credential source tracking

    ⚙️ Configuration

    Variable Default Description
    STREAMING_READ_TIMEOUT 300 Maximum time (seconds) to wait for data between chunks during streaming

    📝 Documentation

    • Bug report template: Added GitHub Issue template for bug reports with structured fields for version, description, and debug logs
    • Code comments: Started translating comments from Russian to English (only in modified files) for better international collaboration

    🙏 Contributors

    • @Kartvya69 - STREAMING_READ_TIMEOUT feature (#9)

    Full Changelog: https://github.com/jwadow/kiro-openai-gateway/compare/v1.0.6...v1.0.7

    Downloads