You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Bug description
Unable to use embedding functionality when integrating Spring AI with VLLM using OpenAI API format. The issue appears to be related to HTTP protocol version compatibility.
Environment
Spring AI: 1.0.0-M4
JDK: 22
VLLM: 0.6.6.post1
Bug description
Unable to use embedding functionality when integrating Spring AI with VLLM using OpenAI API format. The issue appears to be related to HTTP protocol version compatibility.
Environment
Spring AI: 1.0.0-M4
JDK: 22
VLLM: 0.6.6.post1
Steps to reproduce
Expected behavior
Return embedding results.
Current Behavior
When sending requests to VLLM using Spring AI's OpenAI API implementation:
The request being sent contains:
Current Workaround
I've implemented a temporary solution by forcing HTTP/1.1:
🤔Perhaps a better solution would be for VLLM to provide support.
The text was updated successfully, but these errors were encountered: