summaryrefslogtreecommitdiff
path: root/docs
diff options
context:
space:
mode:
authorNate Sesti <sestinj@gmail.com>2023-08-24 10:27:40 -0700
committerNate Sesti <sestinj@gmail.com>2023-08-24 10:27:40 -0700
commit243a0b91e3956a9cd61f17f6b5eeb7a41a56d6c9 (patch)
tree53a8b1efff8f2fb47004856c934585f39fb5a62f /docs
parent358d8b8439c1619ea8259a9950746d8d7535829c (diff)
downloadsncontinue-243a0b91e3956a9cd61f17f6b5eeb7a41a56d6c9.tar.gz
sncontinue-243a0b91e3956a9cd61f17f6b5eeb7a41a56d6c9.tar.bz2
sncontinue-243a0b91e3956a9cd61f17f6b5eeb7a41a56d6c9.zip
update with together
Diffstat (limited to 'docs')
-rw-r--r--docs/docs/walkthroughs/codellama.md22
1 files changed, 22 insertions, 0 deletions
diff --git a/docs/docs/walkthroughs/codellama.md b/docs/docs/walkthroughs/codellama.md
index 5338df3e..78fff5ab 100644
--- a/docs/docs/walkthroughs/codellama.md
+++ b/docs/docs/walkthroughs/codellama.md
@@ -4,6 +4,28 @@ With Continue, you can use Code Llama as a drop-in replacement for GPT-4, either
If you haven't already installed Continue, you can do that [here](https://marketplace.visualstudio.com/items?itemName=Continue.continue). For more general information on customizing Continue, read [our customization docs](../customization.md).
+## TogetherAI
+
+1. Create an account [here](https://api.together.xyz/signup)
+2. Copy your API key that appears on the welcome screen
+3. Click the "play" button on Code Llama Instruct (13B) on the [Together Models list](https://docs.together.ai/docs/models-inference)
+4. Update your Continue config file to look like this:
+
+```python
+from continuedev.src.continuedev.core.models import Models
+from continuedev.src.continuedev.libs.llm.together import TogetherLLM
+
+config = ContinueConfig(
+ ...
+ models=Models(
+ default=TogetherLLM(
+ api_key="<API_KEY>",
+ model="togethercomputer/CodeLlama-13b-Instruct"
+ )
+ )
+)
+```
+
## Ollama
1. Download Ollama [here](https://ollama.ai/) (it should walk you through the rest of these steps)