A fair test
- Use currently available model versions.
- Keep temperature and output limits comparable.
- Score failures and retries, not only successful examples.
- Measure tool-call JSON validity.
- Record current public pricing separately.
Availability comes first
If a model is not present in the live catalog, this service is not claiming it can route requests to that model. Use the availability pages before comparison work.
Common questions
Is the API compatible with the OpenAI SDK?
The public gateway follows the OpenAI-compatible chat completions pattern. Confirm model-specific features in the live catalog and documentation before production rollout.
Where do model availability and prices come from?
Public model pages read the active catalog exposed by the service. A model is not presented as available merely because its name appears in an article.