hermes-agent architecture: caching outranks compaction
The hermes-agent architecture at a glance: why the largest open-source agent harness ships both of its cheap context reducers switched off, and what that buys.
~/writing$ rg "cost"
#cost
Production AI engineering notes tagged “cost” by Kaushal Prajapati.
3 matching posts
→
hermes-agent internals, one component at a time
A component-by-component study of hermes-agent internals: the loop, the prompt, the cache plan, compaction, state, approvals, and what each one costs.
One model instead of 23: consolidating a Document AI stack
A model per document type does not scale. Here is how a single layout-aware extraction architecture replaced 23+ document-specific models, cut OCR spend 70%, and made new document types cheap to add.