diff options
Diffstat (limited to 'docs')
| -rw-r--r-- | docs/docs/walkthroughs/codellama.md | 22 |
1 files changed, 22 insertions, 0 deletions
diff --git a/docs/docs/walkthroughs/codellama.md b/docs/docs/walkthroughs/codellama.md index 5338df3e..78fff5ab 100644 --- a/docs/docs/walkthroughs/codellama.md +++ b/docs/docs/walkthroughs/codellama.md @@ -4,6 +4,28 @@ With Continue, you can use Code Llama as a drop-in replacement for GPT-4, either If you haven't already installed Continue, you can do that [here](https://marketplace.visualstudio.com/items?itemName=Continue.continue). For more general information on customizing Continue, read [our customization docs](../customization.md). +## TogetherAI + +1. Create an account [here](https://api.together.xyz/signup) +2. Copy your API key that appears on the welcome screen +3. Click the "play" button on Code Llama Instruct (13B) on the [Together Models list](https://docs.together.ai/docs/models-inference) +4. Update your Continue config file to look like this: + +```python +from continuedev.src.continuedev.core.models import Models +from continuedev.src.continuedev.libs.llm.together import TogetherLLM + +config = ContinueConfig( + ... + models=Models( + default=TogetherLLM( + api_key="<API_KEY>", + model="togethercomputer/CodeLlama-13b-Instruct" + ) + ) +) +``` + ## Ollama 1. Download Ollama [here](https://ollama.ai/) (it should walk you through the rest of these steps) |