Skip to main content

Context is King: Harnesses, Cost, and Output Quality in Agentic LLM Workflows

· 27 min read
Alex Hytha
Computer User

Just a few years ago, "Prompt Engineering" was the fastest growing career in tech. (Probably; I have no data for this at all) Today, it's all but disappeared from conversation. So what happened? Models got smarter, agentic workflows were introduced, and recently, AI fluency has become a defacto requirement in the professional world instead of a niche role.

Having smarter models means that a lot of the weird tricks that were shared ("You are a brilliant software engineer. Have fun while completing this task") are no longer applicable. At the same time, the more serious research has moved on to solving the general problem of context hydration. (LongRoPE context within LLMs, and RAG hydration in agentic systems).

While models and agents may be better, that doesn't mean prompting strategy is irrelevant. As AI use is becoming more central to professional work, it's more important than ever to know how the get the most out of them.