Skip to content

Commit

Permalink
docs: add code completion configuration docs (#2822)
Browse files Browse the repository at this point in the history
* docs: add code completion configuration docs

* update
  • Loading branch information
wsxiaoys authored Aug 9, 2024
1 parent fdfbf04 commit 13a5f8b
Showing 1 changed file with 21 additions and 0 deletions.
21 changes: 21 additions & 0 deletions website/docs/administration/code-completion.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
# Code Completion

Code completion is a key feature offered by Tabby in IDEs/extensions. Tabby allows for more customized configuration by modifying the `config.toml` file in the `[completion]` section.

## Input / Output

This configuration requires tuning of the model serving configuration as well (e.g., context length settings) and can vary significantly based on the model provider (e.g., llama.cpp, vLLM, TensorRT-LLM, etc).
Therefore, please only modify these values after consulting with the model deployment vendor.

```toml
[completion]

# Maximum length of the input prompt, in UTF-8 characters. The default value is set to 1536.
max_input_length = 1536

# Maximum number of decoding tokens. The default value is set to 64.
max_decoding_tokens = 64
```

The default value is set conservatively to accommodate local GPUs and smaller LLMs.

0 comments on commit 13a5f8b

Please sign in to comment.