Commit Graph

12 Commits

Author SHA1 Message Date
Gokul Mohanarangan
b08724a191 correct schema typing from str to dict 2023-08-17 20:57:31 +05:30
Gokul Mohanarangan
a98a9853be PR review comments 2023-08-17 14:42:45 +05:30
Gokul Mohanarangan
eb13a7bd64 make schema optional argument 2023-08-17 09:23:14 +05:30
Gokul Mohanarangan
5f79e04642 make schema optional for all LLMs 2023-08-16 22:37:20 +05:30
Mathieu Virbel
82ce8202bd server: improve llm warmup exception handling
If LLM is stuck to warm or an exception happen in the pipeline, then the processor responsible for the exception fail, and there is no fallback. So audio continue to arrive, but no processing happen.While this should be done right especially after disconnection, still, we should ignore llm warmup issue and just go.

Closes #140
2023-08-11 19:33:07 +02:00
Mathieu Virbel
a06056f9bc server: fixes initial timeout for llm warmup 2023-08-11 15:45:28 +02:00
Mathieu Virbel
38a5ee0da2 server: implement warmup event for llm and transcription 2023-08-11 15:32:41 +02:00
Mathieu Virbel
dce92e0cf7 server: fixes pipeline logger not transmitted to processors
Closes #110
2023-08-04 12:02:18 +02:00
d94e2911c3 Serverless GPU support on banana.dev (#106)
* serverless: implement banana backend for both audio and LLM

Related to monadical-sas/reflector-gpu-banana project

* serverless: got llm working on banana !

* tests: fixes

* serverless: fix dockerfile to use fastapi server + httpx
2023-08-04 10:24:11 +02:00
Mathieu Virbel
d320558cc9 server/rtc: fix topic output 2023-08-01 19:12:51 +02:00
Mathieu Virbel
1f8e4200fd tests: rework tests and fixes bugs along the way 2023-08-01 16:05:48 +02:00
Mathieu Virbel
42f1442e56 server: introduce LLM backends 2023-08-01 14:23:34 +02:00