summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorNate Sesti <sestinj@gmail.com>2023-09-30 09:50:28 -0700
committerNate Sesti <sestinj@gmail.com>2023-09-30 09:50:28 -0700
commit87e4a6289c3cbb54d4c227b90640ae77aa7cebc1 (patch)
tree3882aac3342e44c7bd3133780242834ba1b07392
parent3f988101e0800cdac25fd4443d2cec6893799814 (diff)
downloadsncontinue-87e4a6289c3cbb54d4c227b90640ae77aa7cebc1.tar.gz
sncontinue-87e4a6289c3cbb54d4c227b90640ae77aa7cebc1.tar.bz2
sncontinue-87e4a6289c3cbb54d4c227b90640ae77aa7cebc1.zip
docs: :memo: update embeddings docs page
-rw-r--r--docs/docs/walkthroughs/codebase-embeddings.md6
1 files changed, 5 insertions, 1 deletions
diff --git a/docs/docs/walkthroughs/codebase-embeddings.md b/docs/docs/walkthroughs/codebase-embeddings.md
index fc4d19cd..79c9edc1 100644
--- a/docs/docs/walkthroughs/codebase-embeddings.md
+++ b/docs/docs/walkthroughs/codebase-embeddings.md
@@ -9,6 +9,8 @@ While it is experimental, codebase embeddings will only be available through the
3. `python -m continuedev` to start the Continue server
4. Open `~/.continue/config.py` and add the following, filling in your OpenAI API key:
+> NOTE: All of the `params` are optional. If you don't provide an OpenAI API key, sentence transformers embeddings will be calculated locally. And the values seen for the other parameters are the defaults so you can leave them out. After retrieving the top `n_retrieve` results from the vector database, an additional re-reranking step uses 2 LLM calls to select the top `n_final` results to use to answer the question. If you want to increase the speed of the query at the cost of relevancy, you can skip the re-ranking step by setting `use_reranking` to `False`. Then the top `n_final` results will just be directly calculated from the vector database.
+
```python
from continuedev.plugins.steps.chroma import (
AnswerQuestionChroma,
@@ -30,7 +32,9 @@ config=ContinueConfig(
description="Answer question after embeddings-based retrieval",
step=AnswerQuestionChroma,
params={
- "openai_api_key": "<OPENAI_API_KEY>"
+ "n_retrieve": 20,
+ "n_final": 10,
+ "use_reranking": True
},
),
]