Commit Graph

384 Commits

Author SHA1 Message Date
b323254376 server: move out profanity filter to transcript, and implement segmentation 2023-11-02 17:39:21 +01:00
726efbc97a server: allow extra environment variable to ease switch between branch
suggested by Andreas
2023-11-02 12:24:52 +01:00
fe6d096f6f server: do not filter empty and recording for now 2023-11-02 12:24:52 +01:00
b8df3cde8c server: ensure loading bad topic won't be problematic 2023-11-02 12:24:52 +01:00
a3e9683f1e server: update get_all to filter empty and unfinished transcripts 2023-11-02 12:24:52 +01:00
86f4de7958 server: allow CORS credentials 2023-10-18 12:41:15 +02:00
c55f038ed4 server: allow to configure CORS_ORIGIN 2023-10-17 20:38:44 +02:00
Koper
f97174e863 Tired of looking this up every time 2023-10-15 17:38:13 +01:00
Gokul Mohanarangan
c1a9005ec3 update buller condition 2023-10-14 18:55:40 +05:30
Gokul Mohanarangan
79fa537c35 update return format 2023-10-14 18:08:16 +05:30
Gokul Mohanarangan
894c989d60 update language codes 2023-10-14 17:35:30 +05:30
Sara
90c6824f52 replace two letter codes with three letter codes 2023-10-13 23:36:02 +02:00
9269db74c0 gpu: update format + list of country 2 to 3 2023-10-13 23:33:37 +02:00
6c1869b79a gpu: improve concurrency on modal - coauthored with Gokul (#286) 2023-10-13 21:15:57 +02:00
projects-g
1d92d43fe0 New summary (#283)
* handover final summary to Zephyr deployment

* fix display error

* push new summary feature

* fix failing test case

* Added markdown support for final summary

* update UI render issue

* retain sentence tokenizer call

---------

Co-authored-by: Koper <andreas@monadical.com>
2023-10-13 22:53:29 +05:30
Sara
21473b584f Merge branch 'main' of github.com:Monadical-SAS/reflector into sara/recorder-memory 2023-10-13 19:10:55 +02:00
projects-g
628c69f81c Separate out transcription and translation into own Modal deployments (#268)
* abstract transcript/translate into separate GPU apps

* update app names

* update transformers library version

* update env.example file
2023-10-13 22:01:21 +05:30
c5297be924 gh: use poetry cache from setup-python and remove old deps (#281)
* gh: use poetry cache from setup-python and remove old deps

* gh: use pipx and not setup-poetry, as per setup-python example

* server: remove pyaudio unused in current reflector
2023-10-13 15:29:54 +02:00
4e40cc511a server: create fixture for starting the server, and always close server even if one test fail 2023-10-13 15:01:58 +02:00
Koper
149342f854 Fix unit tests 2023-10-13 10:42:52 +01:00
Koper
1a7da94cae Fix MP3 download python error 2023-10-13 10:37:45 +01:00
Sara
fb7a7602f3 waveform is a list 2023-10-13 11:34:22 +02:00
Koper
abf9dbcaf1 Keep range_requests_response 2023-10-13 10:17:36 +01:00
Sara
a1df512603 Merge branch 'main' of github.com:Monadical-SAS/reflector into sara/recorder-memory 2023-10-13 11:05:02 +02:00
Koper
33d82bc9af Force MP3 download 2023-10-13 10:03:13 +01:00
Sara
006ab10b44 use numpy in waveform calculation 2023-10-13 10:51:55 +02:00
362a3d5589 docker: fix build for arm64
This was broken with safetensors dependencies required by torch
2023-10-12 20:28:39 +02:00
Koper
827c9cdf13 Remove .mp3 from .gitignore
See 2a5fbed867

It was making the tests fail
2023-10-12 14:34:34 +01:00
35af25d4e8 update export tools for danswer to match the plugin 2023-10-12 10:48:42 +02:00
953e51ef9f export danswer as text file 2023-10-12 10:48:42 +02:00
3f5133e419 server: add a tool to export a reflector sqlite3 database to csv 2023-10-12 10:48:42 +02:00
projects-g
bbe63ad407 Fix extra space between some tokens (punctuations) (#267)
* ensure uptime for reflector.media

* remove extra space before punct

* update detokenizer method

* create detokenizer property

* merge conflict
2023-10-12 10:42:19 +05:30
Sara
2cf61b191f fix waveform generation 2023-10-09 16:00:01 +02:00
47f7e1836e server: remove warmup methods everywhere 2023-10-06 13:59:17 -04:00
projects-g
c9f613aff5 Revert GPU/Container retention settings for modal apps (#260) 2023-10-03 09:54:32 +05:30
projects-g
e78bcc9190 Scaleai Translation (#258)
* hotfix

* remove assert from translation

* review comments

* reflector.media change targetLang to en
2023-09-28 18:16:39 +05:30
6c2651c63e Default length to 750 2023-09-27 10:47:58 -04:00
projects-g
24aa9a74bd hotfix (#254) 2023-09-27 19:20:43 +05:30
projects-g
6a43297309 Translation enhancements (#247) 2023-09-26 19:49:54 +05:30
Gokul Mohanarangan
f56eaeb6cc dont delete censored words 2023-09-25 21:25:18 +05:30
Gokul Mohanarangan
0b00881ce4 update tests: LLM mock to return LLM TITLE for all cases 2023-09-25 10:22:41 +05:30
projects-g
3a374ea593 Delete server/reflector/llm/llm_params_cod.py 2023-09-25 09:46:00 +05:30
Gokul Mohanarangan
117acfacae update comment 2023-09-25 09:43:02 +05:30
Gokul Mohanarangan
d7ed93ae3e fix runtime download by creating specific storage paths for models 2023-09-25 09:34:42 +05:30
Gokul Mohanarangan
80fd5e6176 update llm params 2023-09-22 07:49:41 +05:30
Gokul Mohanarangan
009d52ea23 update casing and trimming 2023-09-22 07:29:01 +05:30
Gokul Mohanarangan
ab41ce90e8 add profanity filter, post-process topic/title 2023-09-21 11:12:00 +05:30
Gokul Mohanarangan
19dfb1d027 Upgrade to a bigger translation model 2023-09-20 20:02:52 +05:30
07204ee2db server: add missing mp3 2023-09-13 17:26:03 +02:00
2b9eef6131 server: use mp3 as default for audio storage
Closes #223
2023-09-13 17:26:03 +02:00