projects-g
|
5cb132cac7
|
fix loading shards from local cache (#313)
|
2023-11-08 22:02:48 +05:30 |
|
|
|
6c1869b79a
|
gpu: improve concurrency on modal - coauthored with Gokul (#286)
|
2023-10-13 21:15:57 +02:00 |
|
|
|
47f7e1836e
|
server: remove warmup methods everywhere
|
2023-10-06 13:59:17 -04:00 |
|
projects-g
|
9fe261406c
|
Feature additions (#210)
* initial
* add LLM features
* update LLM logic
* update llm functions: change control flow
* add generation config
* update return types
* update processors and tests
* update rtc_offer
* revert new title processor change
* fix unit tests
* add comments and fix HTTP 500
* adjust prompt
* test with reflector app
* revert new event for final title
* update
* move onus onto processors
* move onus onto processors
* stash
* add provision for gen config
* dynamically pack the LLM input using context length
* tune final summary params
* update consolidated class structures
* update consolidated class structures
* update precommit
* add broadcast processors
* working baseline
* Organize LLMParams
* minor fixes
* minor fixes
* minor fixes
* fix unit tests
* fix unit tests
* fix unit tests
* update tests
* update tests
* edit pipeline response events
* update summary return types
* configure tests
* alembic db migration
* change LLM response flow
* edit main llm functions
* edit main llm functions
* change llm name and gen cf
* Update transcript_topic_detector.py
* PR review comments
* checkpoint before db event migration
* update DB migration of past events
* update DB migration of past events
* edit LLM classes
* Delete unwanted file
* remove List typing
* remove List typing
* update oobabooga API call
* topic enhancements
* update UI event handling
* move ensure_casing to llm base
* update tests
* update tests
|
2023-09-13 11:26:08 +05:30 |
|
Gokul Mohanarangan
|
9a7b89adaa
|
keep models in cache and load from cache
|
2023-09-08 10:05:17 +05:30 |
|
Gokul Mohanarangan
|
2bed312e64
|
persistent model storage
|
2023-09-08 00:22:38 +05:30 |
|
Gokul Mohanarangan
|
012390d0aa
|
backup
|
2023-08-30 10:43:51 +05:30 |
|
|
|
d76bb83fe0
|
modal: fix schema passing issue with shadowing BaseModel.schema default
|
2023-08-22 17:10:36 +02:00 |
|
Gokul Mohanarangan
|
2d686da15c
|
pass schema as dict
|
2023-08-17 21:51:44 +05:30 |
|
Gokul Mohanarangan
|
9103c8cca8
|
remove ast
|
2023-08-17 15:15:43 +05:30 |
|
Gokul Mohanarangan
|
2e48f89fdc
|
add comments and log
|
2023-08-17 09:33:59 +05:30 |
|
Gokul Mohanarangan
|
eb13a7bd64
|
make schema optional argument
|
2023-08-17 09:23:14 +05:30 |
|
Gokul Mohanarangan
|
5f79e04642
|
make schema optional for all LLMs
|
2023-08-16 22:37:20 +05:30 |
|
Gokul Mohanarangan
|
0cdd7037fb
|
wrap JSONFormer around LLM
|
2023-08-16 14:03:25 +05:30 |
|
Gokul Mohanarangan
|
2f0e9a51f7
|
integrate reflector-gpu-modal repo
|
2023-08-16 13:28:23 +05:30 |
|
