Proxying to External Models
To proxy requests to models from unsupported providers, you’ll need to complete the following steps:
- Add an external model provider
- Update your chat completion requests
To add an external model provider to your project, follow the instructions in External Models. Once it’s been added, continue to the next step.
Updating your chat completion requests
Set the model parameter in your requests to match this format: openpipe:<external-model-provider-slug>/<external-model-slug>
.
For example, if you’re calling gpt-4o-2024-08-06 on Azure, the model parameter should be openpipe:custom-azure-provider/gpt-4o-2024-08-06
.
External models can also be used for filtering and relabeling your data. We currently support custom external models for providers with openai and azure-compatible endpoints. If you’d like support for an external provider with a different API format, send a request to hello@openpipe.ai.