diff options
author | Nate Sesti <sestinj@gmail.com> | 2023-08-24 10:27:40 -0700 |
---|---|---|
committer | Nate Sesti <sestinj@gmail.com> | 2023-08-24 10:27:40 -0700 |
commit | 243a0b91e3956a9cd61f17f6b5eeb7a41a56d6c9 (patch) | |
tree | 53a8b1efff8f2fb47004856c934585f39fb5a62f /docs | |
parent | 358d8b8439c1619ea8259a9950746d8d7535829c (diff) | |
download | sncontinue-243a0b91e3956a9cd61f17f6b5eeb7a41a56d6c9.tar.gz sncontinue-243a0b91e3956a9cd61f17f6b5eeb7a41a56d6c9.tar.bz2 sncontinue-243a0b91e3956a9cd61f17f6b5eeb7a41a56d6c9.zip |
update with together
Diffstat (limited to 'docs')
-rw-r--r-- | docs/docs/walkthroughs/codellama.md | 22 |
1 files changed, 22 insertions, 0 deletions
diff --git a/docs/docs/walkthroughs/codellama.md b/docs/docs/walkthroughs/codellama.md index 5338df3e..78fff5ab 100644 --- a/docs/docs/walkthroughs/codellama.md +++ b/docs/docs/walkthroughs/codellama.md @@ -4,6 +4,28 @@ With Continue, you can use Code Llama as a drop-in replacement for GPT-4, either If you haven't already installed Continue, you can do that [here](https://marketplace.visualstudio.com/items?itemName=Continue.continue). For more general information on customizing Continue, read [our customization docs](../customization.md). +## TogetherAI + +1. Create an account [here](https://api.together.xyz/signup) +2. Copy your API key that appears on the welcome screen +3. Click the "play" button on Code Llama Instruct (13B) on the [Together Models list](https://docs.together.ai/docs/models-inference) +4. Update your Continue config file to look like this: + +```python +from continuedev.src.continuedev.core.models import Models +from continuedev.src.continuedev.libs.llm.together import TogetherLLM + +config = ContinueConfig( + ... + models=Models( + default=TogetherLLM( + api_key="<API_KEY>", + model="togethercomputer/CodeLlama-13b-Instruct" + ) + ) +) +``` + ## Ollama 1. Download Ollama [here](https://ollama.ai/) (it should walk you through the rest of these steps) |