Files
reflector/gpu/self_hosted
Igor Monadical adc4c20bf4 feat: add local pyannote file diarization processor (#858)
* feat: add local pyannote file diarization processor

Enables file diarization without Modal by using pyannote.audio locally.
Downloads model bundle from S3 on first use, caches locally, patches
config to use local paths. Set DIARIZATION_BACKEND=pyannote to enable.

* fix: standalone setup enables pyannote diarization and public mode

Replace DIARIZATION_ENABLED=false with DIARIZATION_BACKEND=pyannote so
file uploads get speaker diarization out of the box. Add PUBLIC_MODE=true
so unauthenticated users can list/browse transcripts.

* fix: touch env files before first compose_cmd in standalone setup

docker-compose.yml references www/.env.local as env_file, but the
setup script only creates it in step 4. compose_cmd calls in step 3
(Garage) fail on a fresh clone when the file doesn't exist yet.

* feat: standalone uses self-hosted GPU service for transcription+diarization

Replace in-process pyannote approach with self-hosted gpu/self_hosted/ service.
Same HTTP API as Modal — just TRANSCRIPT_URL/DIARIZATION_URL point to local container.

- Add gpu/self_hosted/Dockerfile.cpu (GPU Dockerfile minus NVIDIA CUDA)
- Add S3 model bundle fallback in diarizer.py when HF_TOKEN not set
- Add gpu service to docker-compose.standalone.yml with compose env overrides
- Fix /browse empty in PUBLIC_MODE (search+list queries filtered out roomless transcripts)
- Remove audio_diarization_pyannote.py, file_diarization_pyannote.py and tests
- Remove pyannote-audio from server local deps

* fix: allow unauthenticated GPU requests when no API key configured

OAuth2PasswordBearer with auto_error=True rejects requests without
Authorization header before apikey_auth can check if auth is needed.

* fix: rename standalone gpu service to cpu to match Dockerfile.cpu usage

* docs: add programmatic testing section and fix gpu->cpu naming in setup script/docs

- Add "Testing programmatically" section to standalone docs with curl commands
  for creating transcript, uploading audio, polling status, checking result
- Fix setup-standalone.sh to reference `cpu` service (was still `gpu` after rename)
- Update all docs references from gpu to cpu service naming

---------

Co-authored-by: Igor Loskutov <igor.loskutoff@gmail.com>
2026-02-11 12:41:32 -05:00
..
2025-09-17 18:52:03 +02:00
2025-09-17 18:52:03 +02:00
2025-09-17 18:52:03 +02:00
2025-09-17 18:52:03 +02:00
2025-09-17 18:52:03 +02:00

Self-hosted Model API

Run transcription, translation, and diarization services compatible with Reflector's GPU Model API. Works on CPU or GPU.

Environment variables

  • REFLECTOR_GPU_APIKEY: Optional Bearer token. If unset, auth is disabled.
  • HF_TOKEN: Optional. Required for diarization to download pyannote pipelines

Requirements

  • FFmpeg must be installed and on PATH (used for URL-based and segmented transcription)
  • Python 3.12+
  • NVIDIA GPU optional. If available, it will be used automatically

Local run Set env vars in self_hosted/.env file uv sync

uv run uvicorn main:app --host 0.0.0.0 --port 8000

Authentication

  • If REFLECTOR_GPU_APIKEY is set, include header: Authorization: Bearer

Endpoints

  • POST /v1/audio/transcriptions

    • multipart/form-data
    • fields: file (single file) OR files[] (multiple files), language, batch (true/false)
    • response: single { text, words, filename } or { results: [ ... ] }
  • POST /v1/audio/transcriptions-from-url

    • application/json
    • body: { audio_file_url, language, timestamp_offset }
    • response: { text, words }
  • POST /translate

    • text: query parameter
    • body (application/json): { source_language, target_language }
    • response: { text: { : original, : translated } }
  • POST /diarize

    • query parameters: audio_file_url, timestamp (optional)
    • requires HF_TOKEN to be set (for pyannote)
    • response: { diarization: [ { start, end, speaker } ] }

OpenAPI docs

  • Visit /docs when the server is running

Docker

  • Not yet provided in this directory. A Dockerfile will be added later. For now, use Local run above

Setup

SETUP.md

Conformance tests

From this directory

TRANSCRIPT_URL=http://localhost:8000
TRANSCRIPT_API_KEY=dev-key
uv run -m pytest -m model_api --no-cov ../../server/tests/test_model_api_transcript.py

TRANSLATION_URL=http://localhost:8000
TRANSLATION_API_KEY=dev-key
uv run -m pytest -m model_api --no-cov ../../server/tests/test_model_api_translation.py

DIARIZATION_URL=http://localhost:8000
DIARIZATION_API_KEY=dev-key
uv run -m pytest -m model_api --no-cov ../../server/tests/test_model_api_diarization.py