Skip to content

Commit

Permalink
remove extra hyphen in mistral compose
Browse files Browse the repository at this point in the history
  • Loading branch information
lionello committed Jun 21, 2024
1 parent 3e9b70a commit 97b391d
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/tutorials/deploy-with-gpu.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -69,7 +69,7 @@ services:
image: ghcr.io/mistralai/mistral-src/vllm:latest
ports:
- mode: host
- target: 8000
target: 8000
// highlight-next-line
command: ["--host","0.0.0.0","--model","TheBloke/Mistral-7B-Instruct-v0.2-AWQ","--quantization","awq","--dtype","auto","--tensor-parallel-size","1","--gpu-memory-utilization",".95","--max-model-len","8000"]
deploy:
Expand Down

0 comments on commit 97b391d

Please sign in to comment.