Adolfo Delorenzo ee2f88e13b feat(01-02): LLM Backend Pool — LiteLLM Router with Ollama + Anthropic + OpenAI fallback ...

- Create llm_pool/router.py: LiteLLM Router with fast (Ollama) and quality (Anthropic/OpenAI) model groups
- Configure fallback chain: quality providers fail -> fast group
- Pin LiteLLM to ==1.82.5 (avoid September 2025 OOM regression in later releases)
- Create llm_pool/main.py: FastAPI service on port 8004 with /complete and /health endpoints
- Add providers/__init__.py: reserved for future per-provider customization
- Update docker-compose.yml: add llm-pool and celery-worker service stubs

2026-03-23 10:03:05 -06:00

.planning

docs(01-foundation-01): complete monorepo scaffolding and RLS tenant isolation plan

2026-03-23 09:59:55 -06:00

migrations

feat(01-foundation-01): Alembic migrations with RLS and tenant isolation tests

2026-03-23 09:57:29 -06:00

packages

feat(01-02): LLM Backend Pool — LiteLLM Router with Ollama + Anthropic + OpenAI fallback

2026-03-23 10:03:05 -06:00

scripts

feat(01-foundation-01): monorepo scaffolding, Docker Compose, and shared data models

2026-03-23 09:49:28 -06:00

tests

feat(01-foundation-01): Alembic migrations with RLS and tenant isolation tests

2026-03-23 09:57:29 -06:00

.env.example

feat(01-foundation-01): monorepo scaffolding, Docker Compose, and shared data models

2026-03-23 09:49:28 -06:00

alembic.ini

feat(01-foundation-01): Alembic migrations with RLS and tenant isolation tests

2026-03-23 09:57:29 -06:00

docker-compose.yml

feat(01-02): LLM Backend Pool — LiteLLM Router with Ollama + Anthropic + OpenAI fallback

2026-03-23 10:03:05 -06:00

pyproject.toml

feat(01-foundation-01): monorepo scaffolding, Docker Compose, and shared data models

2026-03-23 09:49:28 -06:00

uv.lock

feat(01-02): LLM Backend Pool — LiteLLM Router with Ollama + Anthropic + OpenAI fallback

2026-03-23 10:03:05 -06:00

Description

No description provided

2.4 MiB

Languages

Python 99.9%