143 lines
5.1 KiB
Markdown
143 lines
5.1 KiB
Markdown
# Moxie RAG
|
|
|
|
Multi-tenant RAG (Retrieval-Augmented Generation) system with hybrid SQLite + ChromaDB memory storage. Built for GPU-accelerated semantic search on AMD ROCm.
|
|
|
|
## Features
|
|
|
|
- **Multi-tenant document storage** — Isolated collections per user/tenant
|
|
- **Hybrid memory system** — SQLite for structured data + ChromaDB for vector embeddings
|
|
- **GPU-accelerated embeddings** — Runs on AMD ROCm (RX 7900 XTX tested)
|
|
- **Progressive disclosure** — Token-efficient retrieval pattern
|
|
- **File ingestion** — PDF, DOCX, Excel, TXT, MD, CSV support
|
|
- **Audio/video transcription** — Whisper integration for media files
|
|
- **Email polling** — Auto-ingest attachments from configured IMAP accounts
|
|
|
|
## Quick Start
|
|
|
|
```bash
|
|
# Clone and start
|
|
git clone https://git.oe74.net/adelorenzo/moxie-rag.git
|
|
cd moxie-rag
|
|
docker compose up -d
|
|
|
|
# Check health
|
|
curl http://localhost:8899/health
|
|
```
|
|
|
|
## API Endpoints
|
|
|
|
### Document Operations
|
|
|
|
| Endpoint | Method | Description |
|
|
|----------|--------|-------------|
|
|
| `/` | GET | Service info and collections |
|
|
| `/health` | GET | Health check |
|
|
| `/collections` | GET | List all collections |
|
|
| `/ingest` | POST | Ingest text content |
|
|
| `/ingest-file` | POST | Upload and ingest file |
|
|
| `/query` | POST | Semantic search |
|
|
| `/documents` | GET | List indexed documents |
|
|
| `/documents/{id}` | DELETE | Delete document |
|
|
| `/transcribe` | POST | Transcribe audio/video |
|
|
|
|
### Memory Operations
|
|
|
|
| Endpoint | Method | Description |
|
|
|----------|--------|-------------|
|
|
| `/memory/save` | POST | Save observation (auto-embeds) |
|
|
| `/memory/query` | POST | Semantic search with progressive disclosure |
|
|
| `/memory/get` | POST | Fetch full observations by IDs |
|
|
| `/memory/timeline` | POST | Chronological context around time/ID |
|
|
| `/memory/preference` | POST | Save user preference |
|
|
| `/memory/preferences/{user_id}` | GET | Get all preferences |
|
|
| `/memory/stats/{user_id}` | GET | Memory statistics |
|
|
|
|
## Memory System
|
|
|
|
The memory system provides user-isolated observation storage with vector search:
|
|
|
|
```bash
|
|
# Save an observation
|
|
curl -X POST http://localhost:8899/memory/save \
|
|
-H "Content-Type: application/json" \
|
|
-d '{
|
|
"user_id": "alice",
|
|
"content": "Learned that the API requires auth header X-API-Key",
|
|
"type": "learning",
|
|
"title": "API Auth Discovery"
|
|
}'
|
|
|
|
# Query memory (progressive disclosure - index first)
|
|
curl -X POST http://localhost:8899/memory/query \
|
|
-H "Content-Type: application/json" \
|
|
-d '{
|
|
"user_id": "alice",
|
|
"query": "API authentication",
|
|
"include_content": false
|
|
}'
|
|
|
|
# Get full details by IDs
|
|
curl -X POST http://localhost:8899/memory/get \
|
|
-H "Content-Type: application/json" \
|
|
-d '{
|
|
"user_id": "alice",
|
|
"ids": [1, 2, 3]
|
|
}'
|
|
```
|
|
|
|
### Observation Types
|
|
|
|
- `general` — Default type
|
|
- `learning` — Learned information
|
|
- `decision` — Decisions made
|
|
- `preference` — User preferences
|
|
- `tool_use` — Tool usage logs
|
|
- `system_event` — System events
|
|
|
|
## Configuration
|
|
|
|
Environment variables (set in docker-compose.yml):
|
|
|
|
| Variable | Default | Description |
|
|
|----------|---------|-------------|
|
|
| `CHROMA_DIR` | `/app/data/chromadb` | ChromaDB storage path |
|
|
| `MEMORY_DB` | `/app/data/memory.db` | SQLite database path |
|
|
| `WHISPER_URL` | `http://host.docker.internal:8081/transcribe` | Whisper API endpoint |
|
|
| `UPLOAD_DIR` | `/app/data/uploads` | File upload storage |
|
|
| `LOG_DIR` | `/app/logs` | Log directory |
|
|
|
|
## Architecture
|
|
|
|
```
|
|
┌─────────────────────────────────────────────────────┐
|
|
│ FastAPI Server │
|
|
│ (port 8899) │
|
|
├─────────────────────────────────────────────────────┤
|
|
│ Document Endpoints │ Memory Endpoints │
|
|
│ /ingest, /query │ /memory/save, /memory/query │
|
|
├──────────────────────┴──────────────────────────────┤
|
|
│ RAG Engine │
|
|
│ (sentence-transformers + ChromaDB) │
|
|
├─────────────────────────────────────────────────────┤
|
|
│ ChromaDB (vectors) │ SQLite (structured data) │
|
|
│ /app/data/chromadb │ /app/data/memory.db │
|
|
└─────────────────────────────────────────────────────┘
|
|
```
|
|
|
|
## Email Pollers
|
|
|
|
Auto-ingest attachments from IMAP accounts:
|
|
|
|
- **zeus-email-poller** — Polls zeus@zz11.net → `zeus_docs` collection
|
|
- **moxie-email-poller** — Polls moxie@zz11.net → `adolfo_docs` collection
|
|
|
|
## Requirements
|
|
|
|
- Docker with compose v2
|
|
- AMD GPU with ROCm 7.2+ (or modify Dockerfile for CUDA/CPU)
|
|
- Optional: Whisper API for transcription
|
|
|
|
## License
|
|
|
|
Private repository.
|