projects-g
628c69f81c
Separate out transcription and translation into own Modal deployments ( #268 )
...
* abstract transcript/translate into separate GPU apps
* update app names
* update transformers library version
* update env.example file
2023-10-13 22:01:21 +05:30
c5297be924
gh: use poetry cache from setup-python and remove old deps ( #281 )
...
* gh: use poetry cache from setup-python and remove old deps
* gh: use pipx and not setup-poetry, as per setup-python example
* server: remove pyaudio unused in current reflector
2023-10-13 15:29:54 +02:00
4e40cc511a
server: create fixture for starting the server, and always close server even if one test fail
2023-10-13 15:01:58 +02:00
Koper
149342f854
Fix unit tests
2023-10-13 10:42:52 +01:00
Koper
1a7da94cae
Fix MP3 download python error
2023-10-13 10:37:45 +01:00
Sara
fb7a7602f3
waveform is a list
2023-10-13 11:34:22 +02:00
Koper
abf9dbcaf1
Keep range_requests_response
2023-10-13 10:17:36 +01:00
Sara
a1df512603
Merge branch 'main' of github.com:Monadical-SAS/reflector into sara/recorder-memory
2023-10-13 11:05:02 +02:00
Koper
33d82bc9af
Force MP3 download
2023-10-13 10:03:13 +01:00
Sara
006ab10b44
use numpy in waveform calculation
2023-10-13 10:51:55 +02:00
362a3d5589
docker: fix build for arm64
...
This was broken with safetensors dependencies required by torch
2023-10-12 20:28:39 +02:00
Koper
827c9cdf13
Remove .mp3 from .gitignore
...
See 2a5fbed867
2023-10-12 14:34:34 +01:00
35af25d4e8
update export tools for danswer to match the plugin
2023-10-12 10:48:42 +02:00
953e51ef9f
export danswer as text file
2023-10-12 10:48:42 +02:00
3f5133e419
server: add a tool to export a reflector sqlite3 database to csv
2023-10-12 10:48:42 +02:00
projects-g
bbe63ad407
Fix extra space between some tokens (punctuations) ( #267 )
...
* ensure uptime for reflector.media
* remove extra space before punct
* update detokenizer method
* create detokenizer property
* merge conflict
2023-10-12 10:42:19 +05:30
Sara
2cf61b191f
fix waveform generation
2023-10-09 16:00:01 +02:00
47f7e1836e
server: remove warmup methods everywhere
2023-10-06 13:59:17 -04:00
projects-g
c9f613aff5
Revert GPU/Container retention settings for modal apps ( #260 )
2023-10-03 09:54:32 +05:30
projects-g
e78bcc9190
Scaleai Translation ( #258 )
...
* hotfix
* remove assert from translation
* review comments
* reflector.media change targetLang to en
2023-09-28 18:16:39 +05:30
6c2651c63e
Default length to 750
2023-09-27 10:47:58 -04:00
projects-g
24aa9a74bd
hotfix ( #254 )
2023-09-27 19:20:43 +05:30
projects-g
6a43297309
Translation enhancements ( #247 )
2023-09-26 19:49:54 +05:30
Gokul Mohanarangan
f56eaeb6cc
dont delete censored words
2023-09-25 21:25:18 +05:30
Gokul Mohanarangan
0b00881ce4
update tests: LLM mock to return LLM TITLE for all cases
2023-09-25 10:22:41 +05:30
projects-g
3a374ea593
Delete server/reflector/llm/llm_params_cod.py
2023-09-25 09:46:00 +05:30
Gokul Mohanarangan
117acfacae
update comment
2023-09-25 09:43:02 +05:30
Gokul Mohanarangan
d7ed93ae3e
fix runtime download by creating specific storage paths for models
2023-09-25 09:34:42 +05:30
Gokul Mohanarangan
80fd5e6176
update llm params
2023-09-22 07:49:41 +05:30
Gokul Mohanarangan
009d52ea23
update casing and trimming
2023-09-22 07:29:01 +05:30
Gokul Mohanarangan
ab41ce90e8
add profanity filter, post-process topic/title
2023-09-21 11:12:00 +05:30
Gokul Mohanarangan
19dfb1d027
Upgrade to a bigger translation model
2023-09-20 20:02:52 +05:30
07204ee2db
server: add missing mp3
2023-09-13 17:26:03 +02:00
2b9eef6131
server: use mp3 as default for audio storage
...
Closes #223
2023-09-13 17:26:03 +02:00
fb93c55993
server: fix nltk download
2023-09-13 11:40:39 +02:00
Gokul Mohanarangan
ed83236145
remove cache dir
2023-09-13 14:41:38 +05:30
Gokul Mohanarangan
9a10eef789
add nltk lookup path
2023-09-13 14:13:31 +05:30
Gokul Mohanarangan
9c9bbced47
add protobuf
2023-09-13 12:57:20 +05:30
Gokul Mohanarangan
7f300b9876
add sentencepiece
2023-09-13 12:55:29 +05:30
projects-g
9fe261406c
Feature additions ( #210 )
...
* initial
* add LLM features
* update LLM logic
* update llm functions: change control flow
* add generation config
* update return types
* update processors and tests
* update rtc_offer
* revert new title processor change
* fix unit tests
* add comments and fix HTTP 500
* adjust prompt
* test with reflector app
* revert new event for final title
* update
* move onus onto processors
* move onus onto processors
* stash
* add provision for gen config
* dynamically pack the LLM input using context length
* tune final summary params
* update consolidated class structures
* update consolidated class structures
* update precommit
* add broadcast processors
* working baseline
* Organize LLMParams
* minor fixes
* minor fixes
* minor fixes
* fix unit tests
* fix unit tests
* fix unit tests
* update tests
* update tests
* edit pipeline response events
* update summary return types
* configure tests
* alembic db migration
* change LLM response flow
* edit main llm functions
* edit main llm functions
* change llm name and gen cf
* Update transcript_topic_detector.py
* PR review comments
* checkpoint before db event migration
* update DB migration of past events
* update DB migration of past events
* edit LLM classes
* Delete unwanted file
* remove List typing
* remove List typing
* update oobabooga API call
* topic enhancements
* update UI event handling
* move ensure_casing to llm base
* update tests
* update tests
2023-09-13 11:26:08 +05:30
Gokul Mohanarangan
b52e145a65
Merge branch 'main' of github.com:Monadical-SAS/reflector into llm-modal
2023-09-13 10:19:26 +05:30
a3edd7a7cd
server: update metric for rtc_offer
2023-09-12 20:46:01 +02:00
60edca6366
server: add prometheus instrumentation
2023-09-12 13:11:13 +02:00
Gokul Mohanarangan
9a7b89adaa
keep models in cache and load from cache
2023-09-08 10:05:17 +05:30
Gokul Mohanarangan
2bed312e64
persistent model storage
2023-09-08 00:22:38 +05:30
Gokul Mohanarangan
e613157fd6
update to use cache dir
2023-09-05 14:28:48 +05:30
Gokul Mohanarangan
6b84bbb4f6
download transcriber model
2023-09-05 12:52:07 +05:30
Gokul Mohanarangan
b1ace2a079
Merge branch 'main' of github.com:Monadical-SAS/reflector into llm-modal
2023-09-05 12:39:59 +05:30
a7f0cdd50e
server: fixes tests
2023-08-31 14:48:12 +02:00
600f2ca370
server: add BroadcastProcessor tests
2023-08-31 14:48:12 +02:00
