Add Gatewayz.ai provider support #4477
Open
+63
−0
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add support for Gatewayz AI gateway as a provider in the Zen API system. Gatewayz uses OpenAI-compatible API format and integrates seamlessly with the existing provider infrastructure. 🤖 Generated with Claude Code Co-Authored-By: Claude <noreply@anthropic.com>
…der-m6npnl feat: add Gatewayz provider support
Collaborator
|
Thank you for the PR but for Zen itself we select the providers ourselves so we would prefer you talk to us before trying to make changes |
github-actions
bot
force-pushed
the
dev
branch
3 times, most recently
from
f1dc981 to
3e15a39
Compare
github-actions
bot
force-pushed
the
dev
branch
3 times, most recently
from
f8ee907 to
6a9856d
Compare
Contributor
|
Hey! Your PR title Please update it to start with one of:
Where See CONTRIBUTING.md for details. |
Author
|
Hi @rekram1-node how do we get in touch? We would be interested in serving models for Zen but also having Gatewayz AI recognized as a provider in the /connect menu |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds support for Gatewayz as an LLM provider in the Zen API system. Gatewayz is a universal AI gateway that provides access to 1000+ models with circuit breakers, load balancing, and comprehensive monitoring.
Key Features
OpenAI-Compatible API: Seamlessly integrates with existing OpenAI-compatible endpoints
Universal Inference Gateway: Access to Claude, GPT, Llama, and 50+ other models
Advanced Monitoring: Real-time health checks, error detection, and automatic fallback routing
Token Usage Tracking: Full support for usage statistics and billing
Changes Made
Added gatewayz.ts provider helper with OpenAI-compatible format support
Updated provider registry to export Gatewayz helper for future customizations
Provider will automatically route through oa-compat format in the Zen handler
API Compatibility
Base URL: https://api.gatewayz.ai
Auth: Bearer token (X-API-Key header)
Endpoints:
/v1/chat/completions - Main inference endpoint
/v1/models - List available models
/health/* - System and provider health monitoring
Response Format: OpenAI-compatible JSON
Testing
Providers can be configured in the ZenData system by specifying:
id: Provider identifier (e.g., "gatewayz")
api: Base URL (https://api.gatewayz.ai)
format: "oa-compat"
apiKey: Bearer token from Gatewayz account