Hosted API advantages
- No GPU provisioning
- One authentication pattern
- Usage and budget controls
- Faster model evaluation
Self-hosting advantages
- Deeper runtime control
- Custom weights and serving stack
- Potentially stronger data boundary
- No per-token provider dependency
Check the actual license
The phrase open source is used inconsistently in AI. Review the specific model license, acceptable-use terms and commercial restrictions before deployment.
Common questions
Is the API compatible with the OpenAI SDK?
The public gateway follows the OpenAI-compatible chat completions pattern. Confirm model-specific features in the live catalog and documentation before production rollout.
Where do model availability and prices come from?
Public model pages read the active catalog exposed by the service. A model is not presented as available merely because its name appears in an article.