Commit Graph

13 Commits

Author SHA1 Message Date
c87c30d339 hotfix/server: add follow_redirect on modal 2023-11-02 19:09:13 +01:00
projects-g
1d92d43fe0 New summary (#283)
* handover final summary to Zephyr deployment

* fix display error

* push new summary feature

* fix failing test case

* Added markdown support for final summary

* update UI render issue

* retain sentence tokenizer call

---------

Co-authored-by: Koper <andreas@monadical.com>
2023-10-13 22:53:29 +05:30
47f7e1836e server: remove warmup methods everywhere 2023-10-06 13:59:17 -04:00
projects-g
9fe261406c Feature additions (#210)
* initial

* add LLM features

* update LLM logic

* update llm functions: change control flow

* add generation config

* update return types

* update processors and tests

* update rtc_offer

* revert new title processor change

* fix unit tests

* add comments and fix HTTP 500

* adjust prompt

* test with reflector app

* revert new event for final title

* update

* move onus onto processors

* move onus onto processors

* stash

* add provision for gen config

* dynamically pack the LLM input using context length

* tune final summary params

* update consolidated class structures

* update consolidated class structures

* update precommit

* add broadcast processors

* working baseline

* Organize LLMParams

* minor fixes

* minor fixes

* minor fixes

* fix unit tests

* fix unit tests

* fix unit tests

* update tests

* update tests

* edit pipeline response events

* update summary return types

* configure tests

* alembic db migration

* change LLM response flow

* edit main llm functions

* edit main llm functions

* change llm name and gen cf

* Update transcript_topic_detector.py

* PR review comments

* checkpoint before db event migration

* update DB migration of past events

* update DB migration of past events

* edit LLM classes

* Delete unwanted file

* remove List typing

* remove List typing

* update oobabooga API call

* topic enhancements

* update UI event handling

* move ensure_casing to llm base

* update tests

* update tests
2023-09-13 11:26:08 +05:30
Gokul Mohanarangan
2d686da15c pass schema as dict 2023-08-17 21:51:44 +05:30
Gokul Mohanarangan
b08724a191 correct schema typing from str to dict 2023-08-17 20:57:31 +05:30
Gokul Mohanarangan
a98a9853be PR review comments 2023-08-17 14:42:45 +05:30
Gokul Mohanarangan
eb13a7bd64 make schema optional argument 2023-08-17 09:23:14 +05:30
Gokul Mohanarangan
5f79e04642 make schema optional for all LLMs 2023-08-16 22:37:20 +05:30
Mathieu Virbel
01806ce037 server: remove warmup, increase LLM timeout for now 2023-08-11 19:56:39 +02:00
Mathieu Virbel
a06056f9bc server: fixes initial timeout for llm warmup 2023-08-11 15:45:28 +02:00
Mathieu Virbel
38a5ee0da2 server: implement warmup event for llm and transcription 2023-08-11 15:32:41 +02:00
Mathieu Virbel
445d3c1221 server: implement modal backend for llm and transcription 2023-08-11 12:43:09 +02:00