044f40eb32
server: fixes for tests
2023-08-15 17:40:26 +02:00
857505124f
server: implement data persistence with database
...
Using databases + sqlite/postgresql depending of what you want.
Use DATABASE_URL to configure
Closes #70
2023-08-15 17:40:26 +02:00
a21a726eb1
server: prevent storing audio for transcription unless wanted
...
Closes #145
2023-08-15 14:11:57 +02:00
Mathieu Virbel
93acea4ad9
server: add env.example
...
Closes #95
2023-08-15 09:13:17 +02:00
Mathieu Virbel
01806ce037
server: remove warmup, increase LLM timeout for now
2023-08-11 19:56:39 +02:00
Mathieu Virbel
82ce8202bd
server: improve llm warmup exception handling
...
If LLM is stuck to warm or an exception happen in the pipeline, then the processor responsible for the exception fail, and there is no fallback. So audio continue to arrive, but no processing happen.While this should be done right especially after disconnection, still, we should ignore llm warmup issue and just go.
Closes #140
2023-08-11 19:33:07 +02:00
Mathieu Virbel
802f2c248e
server: remove print
2023-08-11 16:18:39 +02:00
Mathieu Virbel
a06056f9bc
server: fixes initial timeout for llm warmup
2023-08-11 15:45:28 +02:00
Mathieu Virbel
38a5ee0da2
server: implement warmup event for llm and transcription
2023-08-11 15:32:41 +02:00
Mathieu Virbel
a2518df3bd
server: fixes websocket preventing server to stop
2023-08-11 15:18:13 +02:00
Mathieu Virbel
445d3c1221
server: implement modal backend for llm and transcription
2023-08-11 12:43:09 +02:00
projects-g
e3ea7e7cb9
Merge pull request #130 from Monadical-SAS/feat/evaluate
...
Model evaluation feature
2023-08-10 19:14:18 +05:30
Mathieu Virbel
f8fc83c943
server/www: simplify operationId in openapi and update www
2023-08-10 14:52:35 +02:00
Gokul Mohanarangan
992134a38b
minor update
2023-08-10 14:37:39 +05:30
Gokul Mohanarangan
af954e2818
resolve review comments
2023-08-10 14:33:46 +05:30
Gokul Mohanarangan
bb983194f8
update folder structure
2023-08-10 12:24:07 +05:30
Gokul Mohanarangan
0a11a7f669
change dependency group
2023-08-10 12:16:39 +05:30
Gokul Mohanarangan
7ee049bad6
update deps
2023-08-10 12:09:52 +05:30
Gokul Mohanarangan
8cab94cda1
add model evaluation feature
2023-08-10 11:40:55 +05:30
Mathieu Virbel
92366f2662
server: fix websocket
2023-08-09 14:37:39 +02:00
Mathieu Virbel
26e34aec2d
server: ensure transcript status model is updated + tests
2023-08-09 11:23:28 +02:00
Mathieu Virbel
a9e0c9aa03
server: implement status update in model and websocket
2023-08-09 11:21:48 +02:00
Mathieu Virbel
7f807c8f5f
server: implement FINAL_SUMMARY for websocket + update tests and fix flush
2023-08-08 19:32:20 +02:00
Mathieu Virbel
93564bfd89
server: fix stamina missing for old server
2023-08-08 18:31:39 +02:00
Mathieu Virbel
0272904363
Merge
2023-08-08 15:33:55 +02:00
7d40305737
Implement retry that automatically detect httpx and backoff ( #119 )
...
* server: implement retry that automatically detect httpx and backoff
Closes #118
* server: fix formatting
2023-08-08 14:03:36 +02:00
Mathieu Virbel
96f52c631a
api: implement first server API + tests
2023-08-04 20:06:43 +02:00
Mathieu Virbel
20767fde3f
server: start implementing new api
2023-08-04 18:17:02 +02:00
Mathieu Virbel
e55cfce930
server: fixes tests
2023-08-04 18:16:51 +02:00
Mathieu Virbel
dce92e0cf7
server: fixes pipeline logger not transmitted to processors
...
Closes #110
2023-08-04 12:02:18 +02:00
Mathieu Virbel
6d2085ce61
server: update topic detection minimum length required
2023-08-04 11:53:56 +02:00
d94e2911c3
Serverless GPU support on banana.dev ( #106 )
...
* serverless: implement banana backend for both audio and LLM
Related to monadical-sas/reflector-gpu-banana project
* serverless: got llm working on banana !
* tests: fixes
* serverless: fix dockerfile to use fastapi server + httpx
2023-08-04 10:24:11 +02:00
Gokul Mohanarangan
6fc5fe9c6a
sample chat llm
2023-08-03 12:28:22 +05:30
4d4292e1b5
server: add sentry to server ( #93 )
...
Closes #91
2023-08-02 11:28:18 +02:00
Mathieu Virbel
e4f2b785ca
server: update process tools and tests
2023-08-01 20:16:54 +02:00
Mathieu Virbel
cb198927b0
server: add default uvicorn server + update readme
2023-08-01 20:13:16 +02:00
Mathieu Virbel
74d2974ed2
server: fixes latest implementation details on rtc offer and fastapi
2023-08-01 20:09:05 +02:00
Mathieu Virbel
d320558cc9
server/rtc: fix topic output
2023-08-01 19:12:51 +02:00
Mathieu Virbel
99c9ba3e6b
tests: remove unused mock
2023-08-01 16:08:15 +02:00
Mathieu Virbel
1f8e4200fd
tests: rework tests and fixes bugs along the way
2023-08-01 16:05:48 +02:00
Mathieu Virbel
bc55cfdea3
processors: split processors into their own files
2023-08-01 14:24:01 +02:00
Mathieu Virbel
42f1442e56
server: introduce LLM backends
2023-08-01 14:23:34 +02:00
224afc6f28
fastapi: implement server with same back compatibility as before
2023-07-29 15:59:25 +02:00
3908c1ca53
processors: customize logger and auto describe
2023-07-29 01:32:37 +02:00
6f61863136
processors: implement Pipeline, simplify usage
2023-07-29 00:59:09 +02:00
Mathieu Virbel
509840cb4c
processors: Introduce processors implementation
...
Each processor is standalone, with define INPUT/OUTPUT.
Processor can be threaded or not (can be extensible later)
TODO: Pipeline that automatically connect all processors, flush and clean data
To test: python -m reflector.processors tests/records/test_mathieu_hello.wav
```
Transcript: [00:00.500]: Hi there, everyone.
Transcript: [00:02.700]: Today, I want to share my incredible experience.
Transcript: [00:05.461]: with Reflector, a cutineage product that revolutionizes audio processing.
Transcript: [00:10.922]: With Refector, I can easily convert any audio into accurate transcription.
Transcript: [00:16.493]: serving me hours of tedious manual work.
```
This is not a good transcript, but not the purpose here.
2023-07-28 20:08:33 +02:00
Mathieu Virbel
833a206110
test: add missing wav
2023-07-27 18:30:49 +02:00
Mathieu Virbel
c7f2453090
server: formatting
2023-07-27 18:09:01 +02:00
Mathieu Virbel
fe85005e8e
server: add basic rtc test with local audio and fake llm
2023-07-27 18:04:26 +02:00
Mathieu Virbel
7bd3d54d15
server: fix lowercase settings
2023-07-27 15:36:52 +02:00
