Commit Graph

213 Commits

Author SHA1 Message Date
Sara
fb7a7602f3 waveform is a list 2023-10-13 11:34:22 +02:00
Koper
abf9dbcaf1 Keep range_requests_response 2023-10-13 10:17:36 +01:00
Sara
a1df512603 Merge branch 'main' of github.com:Monadical-SAS/reflector into sara/recorder-memory 2023-10-13 11:05:02 +02:00
Koper
33d82bc9af Force MP3 download 2023-10-13 10:03:13 +01:00
Sara
006ab10b44 use numpy in waveform calculation 2023-10-13 10:51:55 +02:00
362a3d5589 docker: fix build for arm64
This was broken with safetensors dependencies required by torch
2023-10-12 20:28:39 +02:00
Koper
827c9cdf13 Remove .mp3 from .gitignore
See 2a5fbed867

It was making the tests fail
2023-10-12 14:34:34 +01:00
35af25d4e8 update export tools for danswer to match the plugin 2023-10-12 10:48:42 +02:00
953e51ef9f export danswer as text file 2023-10-12 10:48:42 +02:00
3f5133e419 server: add a tool to export a reflector sqlite3 database to csv 2023-10-12 10:48:42 +02:00
projects-g
bbe63ad407 Fix extra space between some tokens (punctuations) (#267)
* ensure uptime for reflector.media

* remove extra space before punct

* update detokenizer method

* create detokenizer property

* merge conflict
2023-10-12 10:42:19 +05:30
Sara
2cf61b191f fix waveform generation 2023-10-09 16:00:01 +02:00
47f7e1836e server: remove warmup methods everywhere 2023-10-06 13:59:17 -04:00
projects-g
c9f613aff5 Revert GPU/Container retention settings for modal apps (#260) 2023-10-03 09:54:32 +05:30
projects-g
e78bcc9190 Scaleai Translation (#258)
* hotfix

* remove assert from translation

* review comments

* reflector.media change targetLang to en
2023-09-28 18:16:39 +05:30
6c2651c63e Default length to 750 2023-09-27 10:47:58 -04:00
projects-g
24aa9a74bd hotfix (#254) 2023-09-27 19:20:43 +05:30
projects-g
6a43297309 Translation enhancements (#247) 2023-09-26 19:49:54 +05:30
Gokul Mohanarangan
f56eaeb6cc dont delete censored words 2023-09-25 21:25:18 +05:30
Gokul Mohanarangan
0b00881ce4 update tests: LLM mock to return LLM TITLE for all cases 2023-09-25 10:22:41 +05:30
projects-g
3a374ea593 Delete server/reflector/llm/llm_params_cod.py 2023-09-25 09:46:00 +05:30
Gokul Mohanarangan
117acfacae update comment 2023-09-25 09:43:02 +05:30
Gokul Mohanarangan
d7ed93ae3e fix runtime download by creating specific storage paths for models 2023-09-25 09:34:42 +05:30
Gokul Mohanarangan
80fd5e6176 update llm params 2023-09-22 07:49:41 +05:30
Gokul Mohanarangan
009d52ea23 update casing and trimming 2023-09-22 07:29:01 +05:30
Gokul Mohanarangan
ab41ce90e8 add profanity filter, post-process topic/title 2023-09-21 11:12:00 +05:30
Gokul Mohanarangan
19dfb1d027 Upgrade to a bigger translation model 2023-09-20 20:02:52 +05:30
07204ee2db server: add missing mp3 2023-09-13 17:26:03 +02:00
2b9eef6131 server: use mp3 as default for audio storage
Closes #223
2023-09-13 17:26:03 +02:00
fb93c55993 server: fix nltk download 2023-09-13 11:40:39 +02:00
Gokul Mohanarangan
ed83236145 remove cache dir 2023-09-13 14:41:38 +05:30
Gokul Mohanarangan
9a10eef789 add nltk lookup path 2023-09-13 14:13:31 +05:30
Gokul Mohanarangan
9c9bbced47 add protobuf 2023-09-13 12:57:20 +05:30
Gokul Mohanarangan
7f300b9876 add sentencepiece 2023-09-13 12:55:29 +05:30
projects-g
9fe261406c Feature additions (#210)
* initial

* add LLM features

* update LLM logic

* update llm functions: change control flow

* add generation config

* update return types

* update processors and tests

* update rtc_offer

* revert new title processor change

* fix unit tests

* add comments and fix HTTP 500

* adjust prompt

* test with reflector app

* revert new event for final title

* update

* move onus onto processors

* move onus onto processors

* stash

* add provision for gen config

* dynamically pack the LLM input using context length

* tune final summary params

* update consolidated class structures

* update consolidated class structures

* update precommit

* add broadcast processors

* working baseline

* Organize LLMParams

* minor fixes

* minor fixes

* minor fixes

* fix unit tests

* fix unit tests

* fix unit tests

* update tests

* update tests

* edit pipeline response events

* update summary return types

* configure tests

* alembic db migration

* change LLM response flow

* edit main llm functions

* edit main llm functions

* change llm name and gen cf

* Update transcript_topic_detector.py

* PR review comments

* checkpoint before db event migration

* update DB migration of past events

* update DB migration of past events

* edit LLM classes

* Delete unwanted file

* remove List typing

* remove List typing

* update oobabooga API call

* topic enhancements

* update UI event handling

* move ensure_casing to llm base

* update tests

* update tests
2023-09-13 11:26:08 +05:30
Gokul Mohanarangan
b52e145a65 Merge branch 'main' of github.com:Monadical-SAS/reflector into llm-modal 2023-09-13 10:19:26 +05:30
a3edd7a7cd server: update metric for rtc_offer 2023-09-12 20:46:01 +02:00
60edca6366 server: add prometheus instrumentation 2023-09-12 13:11:13 +02:00
Gokul Mohanarangan
9a7b89adaa keep models in cache and load from cache 2023-09-08 10:05:17 +05:30
Gokul Mohanarangan
2bed312e64 persistent model storage 2023-09-08 00:22:38 +05:30
Gokul Mohanarangan
e613157fd6 update to use cache dir 2023-09-05 14:28:48 +05:30
Gokul Mohanarangan
6b84bbb4f6 download transcriber model 2023-09-05 12:52:07 +05:30
Gokul Mohanarangan
b1ace2a079 Merge branch 'main' of github.com:Monadical-SAS/reflector into llm-modal 2023-09-05 12:39:59 +05:30
a7f0cdd50e server: fixes tests 2023-08-31 14:48:12 +02:00
600f2ca370 server: add BroadcastProcessor tests 2023-08-31 14:48:12 +02:00
9ed26030a5 server: add Broadcast processor 2023-08-31 14:48:12 +02:00
1d814beb81 server: add a tool runpipeline
Allow to create a pipeline from a single processor
MISSING: support multiple processor, yaml, stdin
2023-08-31 14:48:12 +02:00
bdf7fe6ebc server: update process tools to save all events into a jsonl file 2023-08-31 14:48:12 +02:00
Gokul Mohanarangan
61e24969e4 change model download 2023-08-30 13:00:42 +05:30
Gokul Mohanarangan
012390d0aa backup 2023-08-30 10:43:51 +05:30