Peptide AI RAG and Agent Platform
2026 to PresentHybrid retrieval, agent trajectories, and a privacy-safe semantic cache in production.
Problem
Users ask health questions that have to be answered from their own data, meaning their wearable signals, their logs, and their history, with no leakage between users, and it has to stream fast enough to feel like a conversation. At around 9 seconds to an answer, people stopped engaging with it.
Approach
A TypeScript retrieval stack on Supabase Edge Functions: hybrid dense + BM25 retrieval, Voyage cross-encoder reranking, streamed Claude responses, and a pgvector semantic cache scoped per user with dedicated safety guards.
Impact
- ~70% latency reduction on cache hits (9s → under 3s) at $0 marginal cost
- 10,000+ downloads, +66% month over month
- 85K+ daily App Store impressions (+850%)
- Deno regression suite gates every retrieval change
