Commit Graph

137 Commits

Author SHA1 Message Date
Gokul Mohanarangan
19dfb1d027 Upgrade to a bigger translation model 2023-09-20 20:02:52 +05:30
07204ee2db server: add missing mp3 2023-09-13 17:26:03 +02:00
2b9eef6131 server: use mp3 as default for audio storage
Closes #223
2023-09-13 17:26:03 +02:00
fb93c55993 server: fix nltk download 2023-09-13 11:40:39 +02:00
Gokul Mohanarangan
ed83236145 remove cache dir 2023-09-13 14:41:38 +05:30
Gokul Mohanarangan
9a10eef789 add nltk lookup path 2023-09-13 14:13:31 +05:30
Gokul Mohanarangan
9c9bbced47 add protobuf 2023-09-13 12:57:20 +05:30
Gokul Mohanarangan
7f300b9876 add sentencepiece 2023-09-13 12:55:29 +05:30
projects-g
9fe261406c Feature additions (#210)
* initial

* add LLM features

* update LLM logic

* update llm functions: change control flow

* add generation config

* update return types

* update processors and tests

* update rtc_offer

* revert new title processor change

* fix unit tests

* add comments and fix HTTP 500

* adjust prompt

* test with reflector app

* revert new event for final title

* update

* move onus onto processors

* move onus onto processors

* stash

* add provision for gen config

* dynamically pack the LLM input using context length

* tune final summary params

* update consolidated class structures

* update consolidated class structures

* update precommit

* add broadcast processors

* working baseline

* Organize LLMParams

* minor fixes

* minor fixes

* minor fixes

* fix unit tests

* fix unit tests

* fix unit tests

* update tests

* update tests

* edit pipeline response events

* update summary return types

* configure tests

* alembic db migration

* change LLM response flow

* edit main llm functions

* edit main llm functions

* change llm name and gen cf

* Update transcript_topic_detector.py

* PR review comments

* checkpoint before db event migration

* update DB migration of past events

* update DB migration of past events

* edit LLM classes

* Delete unwanted file

* remove List typing

* remove List typing

* update oobabooga API call

* topic enhancements

* update UI event handling

* move ensure_casing to llm base

* update tests

* update tests
2023-09-13 11:26:08 +05:30
Gokul Mohanarangan
b52e145a65 Merge branch 'main' of github.com:Monadical-SAS/reflector into llm-modal 2023-09-13 10:19:26 +05:30
a3edd7a7cd server: update metric for rtc_offer 2023-09-12 20:46:01 +02:00
60edca6366 server: add prometheus instrumentation 2023-09-12 13:11:13 +02:00
Gokul Mohanarangan
9a7b89adaa keep models in cache and load from cache 2023-09-08 10:05:17 +05:30
Gokul Mohanarangan
2bed312e64 persistent model storage 2023-09-08 00:22:38 +05:30
Gokul Mohanarangan
e613157fd6 update to use cache dir 2023-09-05 14:28:48 +05:30
Gokul Mohanarangan
6b84bbb4f6 download transcriber model 2023-09-05 12:52:07 +05:30
Gokul Mohanarangan
b1ace2a079 Merge branch 'main' of github.com:Monadical-SAS/reflector into llm-modal 2023-09-05 12:39:59 +05:30
a7f0cdd50e server: fixes tests 2023-08-31 14:48:12 +02:00
600f2ca370 server: add BroadcastProcessor tests 2023-08-31 14:48:12 +02:00
9ed26030a5 server: add Broadcast processor 2023-08-31 14:48:12 +02:00
1d814beb81 server: add a tool runpipeline
Allow to create a pipeline from a single processor
MISSING: support multiple processor, yaml, stdin
2023-08-31 14:48:12 +02:00
bdf7fe6ebc server: update process tools to save all events into a jsonl file 2023-08-31 14:48:12 +02:00
Gokul Mohanarangan
61e24969e4 change model download 2023-08-30 13:00:42 +05:30
Gokul Mohanarangan
012390d0aa backup 2023-08-30 10:43:51 +05:30
d379dc2376 server: fix dockerfile with migrations 2023-08-29 15:07:04 +02:00
cc186fd8b2 server: allow server to be started locally 2023-08-29 11:19:27 +02:00
68dce235ec server: pass source and target language from api to pipeline 2023-08-29 11:16:23 +02:00
cce8a9137a server: add basic sql migration 2023-08-29 10:58:27 +02:00
Gokul Mohanarangan
e4fe3dfd3a remove print 2023-08-28 15:28:53 +05:30
Gokul Mohanarangan
a5b8849e5e change modal app name 2023-08-28 15:22:26 +05:30
Gokul Mohanarangan
d92a0de56c update HTTP POST 2023-08-28 15:19:36 +05:30
Gokul Mohanarangan
ebbe01f282 update fixes 2023-08-28 14:32:21 +05:30
Gokul Mohanarangan
49d6e2d1dc return both en and fr in transcriptio 2023-08-28 14:25:44 +05:30
Andreas Bonini
826b7ed283 Merge pull request #189 from Monadical-SAS/56-update-the-root-readme
Update README
2023-08-24 20:59:10 +07:00
9dcac97efb server: update to have 0-128 range, feedback from jose 2023-08-24 14:58:59 +02:00
621ae7d681 server: update to set 256 points by default 2023-08-24 14:58:59 +02:00
c21d88b797 server: implement audio waveform download as json
Closes #136
2023-08-24 14:58:59 +02:00
Koper
fcd98e9fd7 Update README 2023-08-24 19:08:53 +07:00
Koper
92cd950572 Force vercel re-deploy 2023-08-23 15:35:59 +07:00
d76bb83fe0 modal: fix schema passing issue with shadowing BaseModel.schema default 2023-08-22 17:10:36 +02:00
4cbda1d0c6 server: allow transcript summary edition
Closes #161
2023-08-22 15:22:19 +02:00
466d3670a1 server: support Range HTTP header for audio download
Closes #178
2023-08-22 15:22:00 +02:00
Gokul Mohanarangan
a0ea32db8a review comments 2023-08-21 13:50:59 +05:30
Gokul Mohanarangan
78153c6cfb update 2023-08-21 12:57:50 +05:30
Gokul Mohanarangan
acdd5f7dab update 2023-08-21 12:53:49 +05:30
Gokul Mohanarangan
5b0883730f translation update 2023-08-21 11:46:28 +05:30
eac40404a9 server: fixes get_all 2023-08-18 15:28:32 +02:00
de38b0047d server: deactivate user auth for ws for now 2023-08-18 12:49:02 +02:00
2339be4172 server: add PUBLIC_MODE settings to allow listing for anonymous user 2023-08-18 12:45:59 +02:00
0c93a39e33 server: add transcript verification on get_by_id 2023-08-18 12:39:19 +02:00