diff options
| author | Nate Sesti <sestinj@gmail.com> | 2023-09-01 13:36:49 -0700 |
|---|---|---|
| committer | Nate Sesti <sestinj@gmail.com> | 2023-09-01 13:36:49 -0700 |
| commit | e6d4e5f60bcf855401d09a2649a516b5932cc53a (patch) | |
| tree | 666999157ebfbe348912434303b23155db1de09f /docs | |
| parent | c1e5039731941eb6b6eea166edd433cd49d4e858 (diff) | |
| parent | 456a8239f18ac5159fffc2484050f94ac3f36317 (diff) | |
| download | sncontinue-e6d4e5f60bcf855401d09a2649a516b5932cc53a.tar.gz sncontinue-e6d4e5f60bcf855401d09a2649a516b5932cc53a.tar.bz2 sncontinue-e6d4e5f60bcf855401d09a2649a516b5932cc53a.zip | |
Merge branch 'main' of https://github.com/continuedev/continue
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/docs/walkthroughs/codellama.md | 15 |
1 files changed, 15 insertions, 0 deletions
diff --git a/docs/docs/walkthroughs/codellama.md b/docs/docs/walkthroughs/codellama.md index 68e99948..ff5b9cf3 100644 --- a/docs/docs/walkthroughs/codellama.md +++ b/docs/docs/walkthroughs/codellama.md @@ -67,3 +67,18 @@ config = ContinueConfig( ``` 3. Reload the VS Code window for changes to take effect + +## FastChat API +1. Setup the FastChat API (https://github.com/lm-sys/FastChat) to use one of the Codellama models on Hugging Face (e.g: codellama/CodeLlama-7b-Instruct-hf). +2. Start the OpenAI compatible API (ref: https://github.com/lm-sys/FastChat/blob/main/docs/openai_api.md). +3. Change your Continue config file to look like this: + +```python +config = ContinueConfig( + ... + models=Models(default=OpenAI( + model="CodeLlama-7b-Instruct-hf", + openai_server_info={'api_base': 'http://localhost:8000/v1'}) + +``` +4. Reload the VS Code window for changes to take effect. |