[GH-ISSUE #416] Add better support for OpenRouter + document current workaround using `humanify openai --baseURL` #80

New issue

Open

opened 2026-03-03 13:52:50 +03:00 by kerem · 0 comments

kerem commented

2026-03-03 13:52:50 +03:00

Owner

Originally created by @0xdevalias on GitHub (Apr 24, 2025).
Original GitHub issue: https://github.com/jehna/humanify/issues/416

Originally raised in this issue:

https://github.com/jehna/humanify/issues/392

Oh, sorry, looks like I can just pass baseURL for this

Originally posted by @beautyfree in https://github.com/jehna/humanify/issues/392#issuecomment-2776404357

Could be worth improving the docs around this potentially

Originally posted by @0xdevalias in https://github.com/jehna/humanify/issues/392#issuecomment-2777294029

At a minimum we should more explicitly document how to achieve this sort of thing using humanify openai --baseURL.

There may also be benefits to adding more explicit internal support for it as well. Need to read/think deeper into it:

https://openrouter.ai/
- The Unified Interface For LLMs
- Better prices, better uptime, no subscription.
- https://openrouter.ai/rankings?view=trending
  - LLM Rankings
- https://openrouter.ai/models?order=pricing-low-to-high
  - Models
- https://openrouter.ai/docs/quickstart
  - Quickstart
  - Get started with OpenRouter
  - OpenRouter provides a unified API that gives you access to hundreds of AI models through a single endpoint, while automatically handling fallbacks and selecting the most cost-effective options. Get started with just a few lines of code using your preferred SDK or framework.
  - https://openrouter.ai/docs/quickstart#using-the-openai-sdk
    - Using the OpenAI SDK
  - https://openrouter.ai/docs/quickstart#using-the-openrouter-api-directly
    - Using the OpenRouter API directly
  - https://openrouter.ai/docs/quickstart#using-third-party-sdks
    - Using third-party SDKs
    - For information about using third-party SDKs and frameworks with OpenRouter, please see our frameworks documentation.
    - https://openrouter.ai/docs/community/frameworks
      - Frameworks
      - Using OpenRouter with Frameworks
      - It lists a few examples, including...
        
        https://openrouter.ai/docs/community/frameworks#using-the-openai-sdk
        
        Using the OpenAI SDK
        
        https://openrouter.ai/docs/community/frameworks#using-langchain
        
        Using LangChain
        
        https://openrouter.ai/docs/community/frameworks#vercel-ai-sdk
        
        Vercel AI SDK
- https://openrouter.ai/docs/features/model-routing
  - Model Routing
  - Dynamically route requests to models
  - The models parameter lets you automatically try other models if the primary model’s providers are down, rate-limited, or refuse to reply due to content moderation.
  - If the model you selected returns an error, OpenRouter will try to use the fallback model instead. If the fallback model is down or returns an error, OpenRouter will return that error.
- https://openrouter.ai/docs/features/provider-routing
  - Provider Routing
  - Route requests to the best provider
  - OpenRouter routes requests to the best available providers for your model. By default, requests are load balanced across the top providers to maximize uptime.
- https://openrouter.ai/docs/features/structured-outputs
  - Structured Outputs
  - Return structured data from your models
  - OpenRouter supports structured outputs for compatible models, ensuring responses follow a specific JSON Schema format. This feature is particularly useful when you need consistent, well-formatted responses that can be reliably parsed by your application.
https://github.com/OpenRouterTeam/openrouter-examples
- Examples of integrating the OpenRouter API

Originally created by @0xdevalias on GitHub (Apr 24, 2025). Original GitHub issue: https://github.com/jehna/humanify/issues/416 Originally raised in this issue: - https://github.com/jehna/humanify/issues/392 > Oh, sorry, looks like I can just pass baseURL for this > > _Originally posted by @beautyfree in https://github.com/jehna/humanify/issues/392#issuecomment-2776404357_ > Could be worth improving the docs around this potentially > > _Originally posted by @0xdevalias in https://github.com/jehna/humanify/issues/392#issuecomment-2777294029_ --- At a minimum we should more explicitly document how to achieve this sort of thing using `humanify openai --baseURL`. There may also be benefits to adding more explicit internal support for it as well. Need to read/think deeper into it: - https://openrouter.ai/ - > The Unified Interface For LLMs - > Better prices, better uptime, no subscription. - https://openrouter.ai/rankings?view=trending - > LLM Rankings - https://openrouter.ai/models?order=pricing-low-to-high - > Models - https://openrouter.ai/docs/quickstart - > Quickstart - > Get started with OpenRouter - > OpenRouter provides a unified API that gives you access to hundreds of AI models through a single endpoint, while automatically handling fallbacks and selecting the most cost-effective options. Get started with just a few lines of code using your preferred SDK or framework. - https://openrouter.ai/docs/quickstart#using-the-openai-sdk - > Using the OpenAI SDK - https://openrouter.ai/docs/quickstart#using-the-openrouter-api-directly - > Using the OpenRouter API directly - https://openrouter.ai/docs/quickstart#using-third-party-sdks - > Using third-party SDKs - > For information about using third-party SDKs and frameworks with OpenRouter, please see our frameworks documentation. - https://openrouter.ai/docs/community/frameworks - > Frameworks - > Using OpenRouter with Frameworks - It lists a few examples, including... - https://openrouter.ai/docs/community/frameworks#using-the-openai-sdk - > Using the OpenAI SDK - https://openrouter.ai/docs/community/frameworks#using-langchain - > Using LangChain - https://openrouter.ai/docs/community/frameworks#vercel-ai-sdk - > Vercel AI SDK - https://openrouter.ai/docs/features/model-routing - > Model Routing - > Dynamically route requests to models - > The `models` parameter lets you automatically try other models if the primary model’s providers are down, rate-limited, or refuse to reply due to content moderation. - > If the model you selected returns an error, OpenRouter will try to use the fallback model instead. If the fallback model is down or returns an error, OpenRouter will return that error. - https://openrouter.ai/docs/features/provider-routing - > Provider Routing - > Route requests to the best provider - > OpenRouter routes requests to the best available providers for your model. By default, [requests are load balanced](https://openrouter.ai/docs/features/provider-routing#load-balancing-default-strategy) across the top providers to maximize uptime. - https://openrouter.ai/docs/features/structured-outputs - > Structured Outputs - > Return structured data from your models - > OpenRouter supports structured outputs for compatible models, ensuring responses follow a specific JSON Schema format. This feature is particularly useful when you need consistent, well-formatted responses that can be reliably parsed by your application. - https://github.com/OpenRouterTeam/openrouter-examples - > Examples of integrating the OpenRouter API ## See Also - https://github.com/jehna/humanify/issues/392 - https://github.com/jehna/humanify/issues/400 - https://github.com/jehna/humanify/issues/167 - https://github.com/jehna/humanify/issues/2 - https://github.com/jehna/humanify/issues/84 - https://github.com/jehna/humanify/issues/213 - https://github.com/jehna/humanify/issues/419 - etc