diff options
| author | Ty Dunn <ty@tydunn.com> | 2023-09-07 11:19:38 -0700 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2023-09-07 11:19:38 -0700 |
| commit | 8dad79af8b18c08e270382ce1b18a3956fa59626 (patch) | |
| tree | 2317e2a5e43624e54e7894e016b9a84a08d1cec9 /extension | |
| parent | 65887473f4c6711d2a64a087f835f86556c75dff (diff) | |
| download | sncontinue-8dad79af8b18c08e270382ce1b18a3956fa59626.tar.gz sncontinue-8dad79af8b18c08e270382ce1b18a3956fa59626.tar.bz2 sncontinue-8dad79af8b18c08e270382ce1b18a3956fa59626.zip | |
adding support for Hugging Face Inference Endpoints (#460)
* stream complete sketch
* correct structure but issues
* refactor: :art: clean up hf_inference_api.py
* fix: :bug: quick fix in hf_infrerence_api.py
* feat: :memo: update documentation code for hf_inference_api
* hf docs
* now working
---------
Co-authored-by: Nate Sesti <sestinj@gmail.com>
Diffstat (limited to 'extension')
| -rw-r--r-- | extension/react-app/src/components/ModelSelect.tsx | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/extension/react-app/src/components/ModelSelect.tsx b/extension/react-app/src/components/ModelSelect.tsx index e6c0e9c9..6a7692ff 100644 --- a/extension/react-app/src/components/ModelSelect.tsx +++ b/extension/react-app/src/components/ModelSelect.tsx @@ -60,6 +60,14 @@ const MODEL_INFO: { title: string; class: string; args: any }[] = [ args: {}, }, { + title: "HuggingFace Inference API", + class: "HuggingFaceInferenceAPI", + args: { + endpoint_url: "<INFERENCE_API_ENDPOINT_URL>", + hf_token: "<HUGGING_FACE_TOKEN>", + }, + }, + { title: "Other OpenAI-compatible API", class: "GGML", args: { |