selfhostyourtech/reflector
2
0
Fork 0
mirror of https://github.com/Monadical-SAS/reflector.git synced 2025-12-20 12:19:06 +00:00
Code Issues Packages Projects Releases Wiki Activity

server: add default uvicorn server + update readme

Browse Source
This commit is contained in:
Mathieu Virbel
2023-08-01 20:13:16 +02:00
parent 74d2974ed2
commit cb198927b0
2 changed files with 12 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
server/README.md
View File

@@ -33,15 +33,21 @@ Then run the server:
```
# With a config.ini
$ poetry run python -m reflector.server
$ poetry run python -m reflector.app
# Within a poetry env
$ poetry shell
$ LLM_URL=http://.../api/v1/generate python -m reflector.server
$ LLM_URL=http://.../api/v1/generate python -m reflector.app
```
### Using local GPT4All
- Start GPT4All with any model you want
- Ensure the API server is activated in GPT4all
- Run with: `LLM_BACKEND=openai LLM_URL=http://localhost:4891/v1/completions LLM_OPENAI_MODEL="GPT4All Falcon" python -m reflector.app`
# Old documentation
This is the code base for the Reflector demo (formerly called agenda-talk-diff) for the leads : Troy Web Consulting