Gokul Mohanarangan
0cdd7037fb
wrap JSONFormer around LLM
2023-08-16 14:03:25 +05:30
projects-g
d470696a49
Merge pull request #154 from Monadical-SAS/modal
...
Integrate reflector-gpu-modal repo
2023-08-16 13:57:25 +05:30
Gokul Mohanarangan
2f0e9a51f7
integrate reflector-gpu-modal repo
2023-08-16 13:28:23 +05:30
0b2fb6ee85
server: remove non-apified server
2023-08-16 09:53:39 +02:00
a809e5e734
server: implement wav/mp3 audio download
...
If set, will save audio transcription to disk.
MP3 conversion is on-request, but cached to disk as well only if it is successfull.
Closes #148
2023-08-16 09:34:26 +02:00
290b552479
server: update documentation
2023-08-15 17:40:26 +02:00
044f40eb32
server: fixes for tests
2023-08-15 17:40:26 +02:00
857505124f
server: implement data persistence with database
...
Using databases + sqlite/postgresql depending of what you want.
Use DATABASE_URL to configure
Closes #70
2023-08-15 17:40:26 +02:00
a21a726eb1
server: prevent storing audio for transcription unless wanted
...
Closes #145
2023-08-15 14:11:57 +02:00
Mathieu Virbel
93acea4ad9
server: add env.example
...
Closes #95
2023-08-15 09:13:17 +02:00
Mathieu Virbel
01806ce037
server: remove warmup, increase LLM timeout for now
2023-08-11 19:56:39 +02:00
Mathieu Virbel
82ce8202bd
server: improve llm warmup exception handling
...
If LLM is stuck to warm or an exception happen in the pipeline, then the processor responsible for the exception fail, and there is no fallback. So audio continue to arrive, but no processing happen.While this should be done right especially after disconnection, still, we should ignore llm warmup issue and just go.
Closes #140
2023-08-11 19:33:07 +02:00
Mathieu Virbel
802f2c248e
server: remove print
2023-08-11 16:18:39 +02:00
Mathieu Virbel
a06056f9bc
server: fixes initial timeout for llm warmup
2023-08-11 15:45:28 +02:00
Mathieu Virbel
38a5ee0da2
server: implement warmup event for llm and transcription
2023-08-11 15:32:41 +02:00
Mathieu Virbel
a2518df3bd
server: fixes websocket preventing server to stop
2023-08-11 15:18:13 +02:00
Mathieu Virbel
445d3c1221
server: implement modal backend for llm and transcription
2023-08-11 12:43:09 +02:00
projects-g
e3ea7e7cb9
Merge pull request #130 from Monadical-SAS/feat/evaluate
...
Model evaluation feature
2023-08-10 19:14:18 +05:30
Mathieu Virbel
f8fc83c943
server/www: simplify operationId in openapi and update www
2023-08-10 14:52:35 +02:00
Gokul Mohanarangan
992134a38b
minor update
2023-08-10 14:37:39 +05:30
Gokul Mohanarangan
af954e2818
resolve review comments
2023-08-10 14:33:46 +05:30
Gokul Mohanarangan
bb983194f8
update folder structure
2023-08-10 12:24:07 +05:30
Gokul Mohanarangan
0a11a7f669
change dependency group
2023-08-10 12:16:39 +05:30
Gokul Mohanarangan
7ee049bad6
update deps
2023-08-10 12:09:52 +05:30
Gokul Mohanarangan
8cab94cda1
add model evaluation feature
2023-08-10 11:40:55 +05:30
Mathieu Virbel
92366f2662
server: fix websocket
2023-08-09 14:37:39 +02:00
Mathieu Virbel
26e34aec2d
server: ensure transcript status model is updated + tests
2023-08-09 11:23:28 +02:00
Mathieu Virbel
a9e0c9aa03
server: implement status update in model and websocket
2023-08-09 11:21:48 +02:00
Mathieu Virbel
7f807c8f5f
server: implement FINAL_SUMMARY for websocket + update tests and fix flush
2023-08-08 19:32:20 +02:00
Mathieu Virbel
93564bfd89
server: fix stamina missing for old server
2023-08-08 18:31:39 +02:00
Mathieu Virbel
0272904363
Merge
2023-08-08 15:33:55 +02:00
7d40305737
Implement retry that automatically detect httpx and backoff ( #119 )
...
* server: implement retry that automatically detect httpx and backoff
Closes #118
* server: fix formatting
2023-08-08 14:03:36 +02:00
Mathieu Virbel
96f52c631a
api: implement first server API + tests
2023-08-04 20:06:43 +02:00
Mathieu Virbel
20767fde3f
server: start implementing new api
2023-08-04 18:17:02 +02:00
Mathieu Virbel
e55cfce930
server: fixes tests
2023-08-04 18:16:51 +02:00
Mathieu Virbel
dce92e0cf7
server: fixes pipeline logger not transmitted to processors
...
Closes #110
2023-08-04 12:02:18 +02:00
Mathieu Virbel
6d2085ce61
server: update topic detection minimum length required
2023-08-04 11:53:56 +02:00
d94e2911c3
Serverless GPU support on banana.dev ( #106 )
...
* serverless: implement banana backend for both audio and LLM
Related to monadical-sas/reflector-gpu-banana project
* serverless: got llm working on banana !
* tests: fixes
* serverless: fix dockerfile to use fastapi server + httpx
2023-08-04 10:24:11 +02:00
Gokul Mohanarangan
6fc5fe9c6a
sample chat llm
2023-08-03 12:28:22 +05:30
4d4292e1b5
server: add sentry to server ( #93 )
...
Closes #91
2023-08-02 11:28:18 +02:00
Mathieu Virbel
e4f2b785ca
server: update process tools and tests
2023-08-01 20:16:54 +02:00
Mathieu Virbel
cb198927b0
server: add default uvicorn server + update readme
2023-08-01 20:13:16 +02:00
Mathieu Virbel
74d2974ed2
server: fixes latest implementation details on rtc offer and fastapi
2023-08-01 20:09:05 +02:00
Mathieu Virbel
d320558cc9
server/rtc: fix topic output
2023-08-01 19:12:51 +02:00
Mathieu Virbel
99c9ba3e6b
tests: remove unused mock
2023-08-01 16:08:15 +02:00
Mathieu Virbel
1f8e4200fd
tests: rework tests and fixes bugs along the way
2023-08-01 16:05:48 +02:00
Mathieu Virbel
bc55cfdea3
processors: split processors into their own files
2023-08-01 14:24:01 +02:00
Mathieu Virbel
42f1442e56
server: introduce LLM backends
2023-08-01 14:23:34 +02:00
224afc6f28
fastapi: implement server with same back compatibility as before
2023-07-29 15:59:25 +02:00
3908c1ca53
processors: customize logger and auto describe
2023-07-29 01:32:37 +02:00
