Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure Open AI request need a version query parameter #169

Open
witti-stephen opened this issue Dec 28, 2024 · 5 comments
Open

Azure Open AI request need a version query parameter #169

witti-stephen opened this issue Dec 28, 2024 · 5 comments
Assignees
Labels
for-next-release Item included for next release provider support

Comments

@witti-stephen
Copy link

witti-stephen commented Dec 28, 2024

In the current code of Azure Open AI client chat creation:

def chat_completions_create(self, model, messages, **kwargs):
    url = f"https://{model}.westus3.models.ai.azure.com/v1/chat/completions"
    url = f"https://{self.base_url}/chat/completions"
    if self.base_url:
        url = f"{self.base_url}/chat/completions"

This would result in a request with url:
https://openai-[region].openai.azure.com/openai/deployments/[deployment name]/chat/completions

and it would then result in a 404 resources not found error

The actual observed url should be
https://openai-[region].openai.azure.com/openai/deployments/[deployment name]/chat/completions?api-version=[version]


And last but not least, I like this library, it's faster than LiteLLM and as other mentioned, cleaner.

@ksolo ksolo added provider support for-next-release Item included for next release labels Dec 29, 2024
@ksolo ksolo self-assigned this Dec 29, 2024
@htcd-subham
Copy link

@ksolo when we are planning to add the solution of this?

@Jamespani
Copy link

when is the next release planned for?

@wbgonz
Copy link

wbgonz commented Jan 8, 2025

when is the next release planned for? We are also waiting for this update. thanks

@htcd-subham
Copy link

@ksolo any updates on this issue?

@wbgonz
Copy link

wbgonz commented Jan 21, 2025

@ksolo is there any updates when this will be fixed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
for-next-release Item included for next release provider support
Projects
None yet
Development

No branches or pull requests

5 participants