Fill in the middle model

[mina58]

Is there a way to deploy a model with fill in the middle. I want to deploy a model to use it for code completion (like copilot)

[alihatamitajik]

Take a look at Continue documentation https://docs.continue.dev/customize/model-providers/more/vllm for instance. Using base models is more suitable for fill in the middle tasks.