~/writing$ rg "llm"

#llm

Production AI engineering notes tagged “llm” by Kaushal Prajapati.

2 matching posts

01Jul 20, 2026 · 4 min

The system layer behind AI products: what an agent runtime actually does

AI demos are easy; AI products are hard. The gap is a runtime — the shared execution layer that handles model routing, tool authorization, long-context state, memory, and fallback. Here is what it takes to run one at scale.

→

02Jul 14, 2026 · 3 min

From 86% to 97%: engineering evidence retrieval for compliance agents

Compliance answers are only trustworthy if every claim cites the right evidence. Here is how hybrid retrieval, reranking, control-aware chunking, and citation-span ranking took evidence F1@10 from 86% to 97%.

→