Tsinghua researchers released AKV, an SGLang-based serving system for cache engineering. LLM agents drop and reposition KV cache instead of summarizing history, cutting average cost 27.7% across 4 agent benchmarks. The…
Open-weights releases pressure closed pricing and widen access, changing the build-vs-buy math for the whole ecosystem.
Summaries are aggregated for information only — follow the source link for the full story. Demo entries are illustrative.