Commit Graph

31 Commits

Author SHA1 Message Date
406164033d feat: new summary using phi-4 and llama-index (#519)
* feat: add litellm backend implementation

* refactor: improve generate/completion methods for base LLM

* refactor: remove tokenizer logic

* style: apply code formatting

* fix: remove hallucinations from LLM responses

* refactor: comprehensive LLM and summarization rework

* chore: remove debug code

* feat: add structured output support to LiteLLM

* refactor: apply self-review improvements

* docs: add model structured output comments

* docs: update model structured output comments

* style: apply linting and formatting fixes

* fix: resolve type logic bug

* refactor: apply PR review feedback

* refactor: apply additional PR review feedback

* refactor: apply final PR review feedback

* fix: improve schema passing for LLMs without structured output

* feat: add PR comments and logger improvements

* docs: update README and add HTTP logging

* feat: improve HTTP logging

* feat: add summary chunking functionality

* fix: resolve title generation runtime issues

* refactor: apply self-review improvements

* style: apply linting and formatting

* feat: implement LiteLLM class structure

* style: apply linting and formatting fixes

* docs: env template model name fix

* chore: remove older litellm class

* chore: format

* refactor: simplify OpenAILLM

* refactor: OpenAILLM tokenizer

* refactor: self-review

* refactor: self-review

* refactor: self-review

* chore: format

* chore: remove LLM_USE_STRUCTURED_OUTPUT from envs

* chore: roll back migration lint changes

* chore: roll back migration lint changes

* fix: make summary llm configuration optional for the tests

* fix: missing f-string

* fix: tweak the prompt for summary title

* feat: try llamaindex for summarization

* fix: complete refactor of summary builder using llamaindex and structured output when possible

* fix: separate prompt as constant

* fix: typings

* fix: enhance prompt to prevent mentioning others subject while summarize one

* fix: various changes after self-review

* fix: from igor review

---------

Co-authored-by: Igor Loskutov <igor.loskutoff@gmail.com>
2025-07-31 15:29:29 -06:00
86ce68651f build: move to uv (#488)
* build: move to uv

* build: add packages declaration

* build: move to python 3.12, as sentencespiece does not work on 3.13

* ci: remove pre-commit check, will be done in another branch.

* ci: fix name checkout

* ci: update lock and dockerfile

* test: remove event_loop, not needed in python 3.12

* test: updated test due to av returning AudioFrame with 4096 samples instead of 1024

* build: prevent using fastapi cli, because there is no way to set default port

I don't want to pass --port 1250 every time, so back on previous
approach. I deactivated auto-reload for production.

* ci: remove main.py

* test: fix quirck with httpx
2025-07-16 18:10:11 -06:00
4895160181 docs: update readme with screenshots 2025-07-16 08:44:30 -06:00
d3498ae669 docs: add AGPL-v3 license and update README (#487) 2025-07-16 08:31:55 -06:00
Sara
a4077005b2 Setup instuctions 2024-08-12 12:22:21 +02:00
c36b64cff1 Upgrade to latest openapi codegen 2024-07-03 14:21:38 +02:00
Andreas
d207180b0f Update README.md 2024-01-02 21:28:04 +07:00
Koper
9f42c4d8a7 NextJS 14 experimental upgrade 2023-12-26 20:49:40 +07:00
Andreas
a0392edaf9 Update README.md 2023-12-18 20:42:36 +07:00
Andreas
e9192770b5 Updated documentation 2023-12-18 20:22:15 +07:00
Sara
4869e760a8 fix readme 2023-12-14 16:04:31 +01:00
Koper
7b9eedc170 Update README.md 2023-12-05 20:37:50 +07:00
Koper
7e29a0bf14 Merge branch 'main' into post-to-zulip 2023-12-04 21:06:10 +07:00
Koper
999a3e05a4 Temp commit to merge main into this branch 2023-12-04 20:54:54 +07:00
f9771427e2 server: add healthcheck for worker 2023-11-30 19:43:19 +01:00
da926b79a0 Update README.md - trigger vercel build after outage 2023-11-03 10:34:14 +01:00
e405ccb8f3 server: started updating documentation 2023-11-02 17:39:21 +01:00
Sara
2847ee177b fix readme and env files 2023-11-02 12:24:52 +01:00
Koper
3878c98357 Added cd www / cd server in README 2023-08-24 23:04:09 +07:00
Koper
1f2a4dc81d LLM_URL twice in example .env in readme 2023-08-24 22:19:58 +07:00
Koper
a2959ec396 Removed outdated image 2023-08-24 19:10:51 +07:00
Koper
fcd98e9fd7 Update README 2023-08-24 19:08:53 +07:00
Koper
dabc979596 TEST - vercel auto-deployment 2023-07-28 23:42:33 +07:00
Mathieu Virbel
00797d9cc6 project: add docker in root directory and readme 2023-07-27 12:46:50 +02:00
Koper
401aa1e6f9 Merged reflector-ui (now "www") into single repo 2023-07-26 15:18:05 +07:00
Koper
55e425f2b1 yarn format + project architecture image in readme 2023-07-19 13:17:09 +07:00
Andreas Bonini
e8aa72b0e4 Update README.md 2023-07-18 16:26:05 +07:00
Koper
9382ab13ab yarn format 2023-07-18 15:52:39 +07:00
Koper
244e8123d1 Update README.md 2023-07-18 11:55:08 +07:00
Koper
9e8eea12dc Update README.md 2023-07-18 11:54:39 +07:00
Koper
596b920484 Initial commit from Create Next App 2023-07-11 18:40:11 +07:00