gate9 · Model gateway Planned concept

A common entry point for model calls.

We are exploring a model gateway for provider configuration, routing, caching, and usage controls. The goal is to make model access easier to manage while keeping provider behavior and costs visible.

Scope is subject to change. No public release or API is announced.

Model routingProvider configurationCachingUsage controls
proposed workflow

Model access with policies you can inspect.

The concept puts routing and usage policy in one place. Teams could choose provider credentials, permitted models, and how to handle failures. Provider coverage, cache behavior, and budget enforcement are still being designed.

provider settings routing policy usage visibility
gate9 · concept
1. Choose the providers and models a workload may use.

2. Define routing, caching, and usage policies.

3. Review model usage and request outcomes.
areas we're exploring

Route. Observe. Control.

We are exploring a shared interface with explicit policies for model access.

01 · Route

Choose among providers

Explore model routing through a common interface. Supported providers and compatibility with their individual APIs remain to be defined.

02 · Control

Usage policies and caching

Explore request caching and budget controls with visible usage. Accounting rules, in-flight requests, and enforcement limits need explicit semantics.

03 · Handle failures

Explicit provider selection

Explore configurable alternate-provider policies for errors or rate limits. Model differences and retry behavior would remain visible to the caller.

share your requirements

What should a model gateway control?

Tell us which providers, routing rules, and usage controls your team needs.