Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lora model not load successfully but the ModelAdapter status is running #235

Closed
brosoul opened this issue Sep 26, 2024 · 2 comments
Closed
Assignees
Labels
area/lora event/bugbash issues reported at bug bash kind/bug Something isn't working
Milestone

Comments

@brosoul
Copy link
Collaborator

brosoul commented Sep 26, 2024

🐛 Describe the bug

It seems ModelAdapter is running.
image

But request the lora model failed
image

Check the log of aibrix-controller-manager
image

Steps to Reproduce

No response

Expected behavior

No response

Environment

No response

@brosoul brosoul added the event/bugbash issues reported at bug bash label Sep 26, 2024
@Jeffwan Jeffwan self-assigned this Sep 26, 2024
@Jeffwan Jeffwan added kind/bug Something isn't working area/lora labels Sep 26, 2024
@Jeffwan Jeffwan added this to the v0.1.0-rc.3 milestone Sep 26, 2024
@Jeffwan
Copy link
Collaborator

Jeffwan commented Sep 27, 2024

@brosoul did you check the engine logs at that time? Seems it's an Internal Server Error returned from the server.

In order to check whether the lora is successfully loaded in the container, we should curl http//localhost:8000/v1/models to have a see

@Jeffwan
Copy link
Collaborator

Jeffwan commented Sep 30, 2024

improving the event handling logic helps on all status issues. We should be good after the #257

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/lora event/bugbash issues reported at bug bash kind/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants