Ramp Labs Introduces Multi-Agent Memory Sharing Solution, Token Consumption Reduced by Up to 65%
BlockBeats News, April 11th, AI infrastructure company Ramp Labs released research results on "Latent Briefing", achieving efficient memory sharing among multi-agent systems through direct compression of large-scale model KV cache, significantly reducing Token consumption without sacrificing accuracy.
In mainstream multi-agent architectures, the Orchestrator decomposes tasks and repeatedly calls Worker models. As the inference chain extends, Token usage exponentially inflates. The core idea of Latent Briefing is to leverage the attention mechanism to identify the truly critical parts in the context, directly discard redundant information at the representation layer, rather than relying on the slow-speed LLM summary or the unstable RAG retrieval.
In the LongBench v2 benchmark test, this method performed remarkably: Worker model Token consumption decreased by 65%, the median Token savings for medium-length documents (32k to 100k) reached 49%, the overall accuracy improved by approximately 3 percentage points compared to the baseline, and the additional time for each compression was only about 1.7 seconds, achieving a speedup of about 20 times compared to the original algorithm.
The experiment used Claude Sonnet 4 as the Orchestrator, and Qwen3-14B as the Worker model, covering various document scenarios such as academic papers, legal documents, novels, and government reports. The research also found that the optimal compression threshold varies depending on task difficulty and document length—difficult tasks are suitable for aggressive compression to filter out speculative reasoning noise, while long documents are more suitable for mild compression to retain scattered key information.
You may also like
The large models in the United States are moving towards closure in the name of security
From the white-haired stock god to the billionaire fund mogul, the smart people shorting Nvidia are all getting rich using the same framework
Morning Report | CoinEx becomes a key hub for Iran to evade sanctions, involving over $3.8 billion in funds; Kalshi seeks a new round of financing, with a valuation potentially rising to $40 billion
Global Launch: As predictions become the most scarce asset in the AI era, Manadia is defining the next generation of the value internet
Why do cryptocurrency projects always like to change their names?
Who is footing the bill for the $64 billion accounting frenzy?
I never expected that the first application of AI x Crypto would be in security auditing
What is your view on Binance's competitive advantages?
ETH has entered a non-consensus phase, and the turning point is approaching!
The shift in the cloud of the air: from despising stablecoins a year ago to the high-profile entry of capital today
The survival dilemma of small and medium exchanges behind the withdrawal anomalies exposed by AscendEX
Why Is Bitcoin Falling Below $60K? 5 Key Market Drivers Explained
Bitcoin has dropped sharply amid ETF outflows, Strategy stock weakness, AI stock rallies, and changing Fed expectations. Explore the key forces driving BTC’s latest correction and what traders should watch next.





