New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feature] multiple adapters for the core language model #66

Open

1 task

Aisuko opened this issue Apr 15, 2024 · 0 comments

Open

1 task

[feature] multiple adapters for the core language model #66

Aisuko opened this issue Apr 15, 2024 · 0 comments

Assignees

Member

Aisuko commented Apr 15, 2024 •

edited

Loading

~~https://www.kaggle.com/code/aisuko/customize-building-llm-in-pytorch~~

As we discussed

We should fine-tuned the model with RLHF to the specific adapters. And those adapters as micro-services. See example below.

https://www.kaggle.com/code/aisuko/producing-adapter-with-vera

Aisuko changed the title ~~[feature] customise LLM~~ [feature] customise the language models

Aisuko self-assigned this

Aisuko added the llms label

Aisuko changed the title ~~[feature] customise the language models~~ [feature] multiple adapters for the core language model

Aisuko mentioned this issue

[feature] Support multiple adapters for core small language models #15

Closed

Aisuko removed the llms label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment