Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: unify naming of production-stack, vllm-stack and vllm-router #178

Open
bufferoverflow opened this issue Feb 25, 2025 · 5 comments
Labels
discussion feature request New feature or request

Comments

@bufferoverflow
Copy link
Contributor

Describe the feature

Today multiple names are used, e.g.,

It would be great to have consistent naming all over, e.g., vllm-router

Why do you need this feature?

Simplifies usage and avoid confusion with different names

Additional context

No response

@bufferoverflow bufferoverflow added the feature request New feature or request label Feb 25, 2025
@ApostaC
Copy link
Collaborator

ApostaC commented Feb 25, 2025

Thanks for your suggestion! It makes a lot of sense!

"production-stack" is the name of the whole project and it contains a couple of components, including router, the helm chart, and the observability stack. We are also expecting more features around vLLM to be added into production-stack in the future, such as autoscaling, and kv cache offloading interface.

I think it makes sense to change the release/container/python-package name to something like:

  • release: production-stack-chart
  • container (for router) and python package name (for router): production-stack-router

Also cc @YuhanLiu11 @gaocegege for your opinions.

@YuhanLiu11
Copy link
Collaborator

Thanks for your suggestion! It makes a lot of sense!

"production-stack" is the name of the whole project and it contains a couple of components, including router, the helm chart, and the observability stack. We are also expecting more features around vLLM to be added into production-stack in the future, such as autoscaling, and kv cache offloading interface.

I think it makes sense to change the release/container/python-package name to something like:

  • release: production-stack-chart
  • container (for router) and python package name (for router): production-stack-router

Also cc @YuhanLiu11 @gaocegege for your opinions.

production-stack-chart and product-stack-router sounds good to me!

@bufferoverflow
Copy link
Contributor Author

I personally would prefer having vllm within the name as this is the focus and hosting group here

@wangchen615
Copy link

I second @YuhanLiu11 's comment.

@gaocegege
Copy link
Collaborator

I personally would prefer having vllm within the name as this is the focus and hosting group here

I agree. "Production stack" is too broad and makes SEO and community marketing challenging. Including "vllm" in the name would clarify that our stack is specifically tailored for vllm, similar to how "sglang-router" is purpose-built for its use case.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discussion feature request New feature or request
Projects
None yet
Development

No branches or pull requests

5 participants