selfhostyourtech/reflector
2
0
Fork 0
mirror of https://github.com/Monadical-SAS/reflector.git synced 2025-12-20 20:29:06 +00:00
Code Issues Packages Projects Releases Wiki Activity

server: add default uvicorn server + update readme

Browse Source
This commit is contained in:
Mathieu Virbel
2023-08-01 20:13:16 +02:00
parent 74d2974ed2
commit cb198927b0
2 changed files with 12 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
server/README.md
View File

@@ -33,15 +33,21 @@ Then run the server:
``` ```
# With a config.ini # With a config.ini
$ poetry run python -m reflector.server $ poetry run python -m reflector.app
# Within a poetry env # Within a poetry env
$ poetry shell $ poetry shell
$ LLM_URL=http://.../api/v1/generate python -m reflector.server $ LLM_URL=http://.../api/v1/generate python -m reflector.app
``` ```
### Using local GPT4All
- Start GPT4All with any model you want
- Ensure the API server is activated in GPT4all
- Run with: `LLM_BACKEND=openai LLM_URL=http://localhost:4891/v1/completions LLM_OPENAI_MODEL="GPT4All Falcon" python -m reflector.app`
# Old documentation # Old documentation
This is the code base for the Reflector demo (formerly called agenda-talk-diff) for the leads : Troy Web Consulting This is the code base for the Reflector demo (formerly called agenda-talk-diff) for the leads : Troy Web Consulting

4
server/reflector/app.py
View File

@@ -26,3 +26,7 @@ app.add_middleware(
# register views # register views
app.include_router(rtc_offer_router) app.include_router(rtc_offer_router)
if __name__ == "__main__":
import uvicorn
uvicorn.run("reflector.app:app", host="0.0.0.0", port=1250, reload=True)