llm-reliability
Aug – Sept 2026 · published to PyPI
Local-first root-cause engine for LLM, RAG and agent systems. Ingests native, OpenTelemetry and LangSmith traces, emits evidence-backed hypotheses with confidence scores across 9 failure categories — retrieval failure, hallucination, agent loops, tool errors, schema violations. Ships a zero-overhead async tracing SDK, a streaming latency profiler (TTFT, tokens/sec, stall detection), and a multi-run regression comparator tracking p50–p99 drift.
267tests
90%coverage
45labeled scenarios
Python · Pydantic v2 · OpenTelemetry · pytest · mypy strict · CLI
advanced-rag-system
Sept – Oct 2025
Document Q&A platform built to production shape rather than notebook shape. Hybrid retrieval over semantic and BM25, multi-format ingestion (PDF, DOCX, TXT, CSV, MD) into ChromaDB, and a Redis cache layer with intelligent invalidation that cut repeat queries from 1.308s to 0.011s.
117×cache speedup
60%hit rate
100%suite passing
FastAPI · ChromaDB · Redis · Docker · LangChain · HuggingFace
distributed-url-shortener
Dec 2025 – Jan 2026
A sharding and observability exercise taken to completion. Application-level sharding across three PostgreSQL nodes, multi-layer Redis caching, event-driven analytics through Redpanda, and full Prometheus/Grafana instrumentation across a 13-container compose stack.
1,094req/s
2.7msp50
13containers
FastAPI · PostgreSQL · Redis · Redpanda · Prometheus · Grafana