Nvidia's KV Cache Transform Coding (KVTC) compresses LLM key-value cache by 20x without model changes, cutting GPU memory costs and time-to-first-token by up to 8x for multi-turn AI applications.
Today's AI agents don't meet the definition of true agents. Key missing elements are reinforcement learning and complex memory. It will take at least five years to get AI agents where they need to be.