Tech
Tsinghua AI Open-Sources AKV, a Cache Engineering Server for LLM Agents on SGLang
Tsinghua researchers released AKV, an SGLang-based serving system for cache engineering. LLM agents drop and reposition KV cache instead of summarizing history, cutting…
Discussion (0)
No comments yet. Start the conversation!