summaryrefslogtreecommitdiff
path: root/docs
diff options
context:
space:
mode:
authorNate Sesti <sestinj@gmail.com>2023-08-20 17:21:00 -0700
committerNate Sesti <sestinj@gmail.com>2023-08-20 17:21:00 -0700
commit84ec574e182ec441e95d13c3543a934e0a036228 (patch)
tree9e058eb72fbd8de31dcf221175538f4056c38f5a /docs
parentdf86a15774716f7f7e0903f4917eb284708a5556 (diff)
downloadsncontinue-84ec574e182ec441e95d13c3543a934e0a036228.tar.gz
sncontinue-84ec574e182ec441e95d13c3543a934e0a036228.tar.bz2
sncontinue-84ec574e182ec441e95d13c3543a934e0a036228.zip
fix: :bug: fix replicate to work with models requiring prompt input
Diffstat (limited to 'docs')
-rw-r--r--docs/docs/customization.md6
1 files changed, 3 insertions, 3 deletions
diff --git a/docs/docs/customization.md b/docs/docs/customization.md
index a3774e91..b7279fe3 100644
--- a/docs/docs/customization.md
+++ b/docs/docs/customization.md
@@ -117,7 +117,7 @@ config = ContinueConfig(
)
```
-### Replicate (beta)
+### Replicate
Replicate is a great option for newly released language models or models that you've deployed through their platform. Sign up for an account [here](https://replicate.ai/), copy your API key, and then select any model from the [Replicate Streaming List](https://replicate.com/collections/streaming-language-models). Change `~/.continue/config.py` to look like this:
@@ -129,13 +129,13 @@ config = ContinueConfig(
...
models=Models(
default=ReplicateLLM(
- model="stablecode-completion-alpha-3b-4k",
+ model="replicate/llama-2-70b-chat:58d078176e02c219e11eb4da5a02a7830a283b14cf8f94537af893ccff5ee781",
api_key="my-replicate-api-key")
)
)
```
-If you don't specify the `model` parameter, it will default to `stablecode-completion-alpha-3b-4k`.
+If you don't specify the `model` parameter, it will default to `replicate/llama-2-70b-chat:58d078176e02c219e11eb4da5a02a7830a283b14cf8f94537af893ccff5ee781`.
### Self-hosting an open-source model