selfhostyourtech/reflector
2
0
Fork 0
mirror of https://github.com/Monadical-SAS/reflector.git synced 2025-12-20 12:19:06 +00:00
Code Issues Packages Projects Releases Wiki Activity

Serverless GPU support on banana.dev (#106)

Browse Source 
* serverless: implement banana backend for both audio and LLM

Related to monadical-sas/reflector-gpu-banana project

* serverless: got llm working on banana !

* tests: fixes

* serverless: fix dockerfile to use fastapi server + httpx
This commit is contained in:
Mathieu Virbel
2023-08-04 10:24:11 +02:00
committed by GitHub
parent a5ce66c299
commit d94e2911c3
17 changed files with 602 additions and 53 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
server/Dockerfile
View File

@@ -18,7 +18,7 @@ COPY pyproject.toml poetry.lock /tmp
RUN pip install "poetry==$POETRY_VERSION"
RUN python -m venv /venv
RUN . /venv/bin/activate && poetry config virtualenvs.create false
RUN . /venv/bin/activate && poetry install --only main --no-root --no-interaction --no-ansi
RUN . /venv/bin/activate && poetry install --only main,aws --no-root --no-interaction --no-ansi
# bootstrap
FROM base AS final
@@ -26,4 +26,4 @@ COPY --from=builder /venv /venv
RUN mkdir -p /app
COPY reflector /app/reflector
WORKDIR /app
CMD ["/venv/bin/python", "-m", "reflector.server"]
CMD ["/venv/bin/python", "-m", "reflector.app"]