Bitget App
Trade smarter
Buy cryptoMarketsTradeFuturesEarnSquareMore
Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Bitget-RWA2025/10/23 16:33
By:Bitget-RWA

As the demand for AI infrastructure skyrockets, organizations are under increasing pressure to maximize the inference output from their available GPUs. For those with specialized knowledge in certain methods, this environment presents an excellent opportunity to secure investment.

This is one of the main reasons behind the emergence of Tensormesh, which has just come out of stealth mode after raising $4.5 million in seed capital. The round was headed by Laude Ventures, with additional backing from angel investor and database innovator Michael Franklin.

Tensormesh intends to use these funds to develop a commercial offering based on the open-source LMCache tool, which was created and is maintained by co-founder Yihua Cheng. When implemented effectively, LMCache can cut inference expenses by up to a factor of ten—a capability that has made it popular in open-source projects and attracted collaborations with major players like Google and Nvidia. Now, Tensormesh aims to transform its academic achievements into a sustainable business.

At the core of this technology is the key-value cache (KV cache), a memory architecture that streamlines the processing of complex inputs by summarizing them into key values. In most conventional systems, the KV cache is discarded after each query, but Tensormesh CEO Juchen Jiang believes this practice leads to significant inefficiency.

“It’s comparable to a brilliant analyst who reviews all the information but forgets everything after answering each question,” explains Tensormesh co-founder Junchen Jiang.

Rather than deleting the cache, Tensormesh’s approach preserves it, making it available for reuse when the model encounters a similar task in a future query. Since GPU memory is a limited resource, this often involves distributing data across multiple storage solutions, but the payoff is a substantial boost in inference capacity without increasing server demands.

This improvement is especially impactful for chat-based applications, where models must repeatedly access an expanding conversation history. Agentic systems face a similar challenge, as their logs of actions and objectives continually grow.

While, in principle, AI firms could implement these changes themselves, the technical hurdles make it a formidable undertaking. Given the Tensormesh team’s expertise and the complexity involved, the company is confident there will be strong interest in a ready-made solution.

“Storing the KV cache in secondary storage and reusing it efficiently without degrading system performance is a tough technical challenge,” Jiang notes. “We’ve observed teams hiring dozens of engineers and spending several months to build such a system. Alternatively, they can leverage our product and achieve the same results much more efficiently.”

0

Disclaimer: The content of this article solely reflects the author's opinion and does not represent the platform in any capacity. This article is not intended to serve as a reference for making investment decisions.

PoolX: Earn new token airdrops
Lock your assets and earn 10%+ APR
Lock now!

You may also like

Switzerland Delays Crypto Information Exchange Pending International Coordination

- Switzerland delays crypto tax data sharing with foreign nations until 2027, citing unresolved CARF partner agreements. - The OECD's 2022 framework requires member states to exchange crypto account details, but 75 countries including the EU and UK face implementation challenges. - Transitional measures ease compliance burdens for Swiss crypto firms while awaiting finalized international data-sharing protocols. - Major economies like the U.S., China, and Saudi Arabia remain outside CARF due to non-complian

Bitget-RWA2025/11/28 11:02
Switzerland Delays Crypto Information Exchange Pending International Coordination

Bitcoin Updates: SGX Addresses Offshore Perp Shortfall as Bitcoin Decline Increases Demand for Hedging

- SGX launched Bitcoin and Ethereum perpetual futures, becoming a first-mover in regulated onshore crypto derivatives to meet institutional demand. - The $187B/year perp market, dominated by Asia, now gains a regulated alternative to offshore platforms with SGX's 22.5-hour trading window. - Perps enable hedging during Bitcoin's 2025 downturn, with SGX's margin-call system prioritizing investor protection over instant liquidations. - Regulatory caution limits access to accredited investors, aligning with gl

Bitget-RWA2025/11/28 10:44
Bitcoin Updates: SGX Addresses Offshore Perp Shortfall as Bitcoin Decline Increases Demand for Hedging

Bitcoin News Update: Institutional ETF Adjustments Challenge Key Bitcoin Support Thresholds

- Analysts warn Bitcoin faces 25% drop risk if key support levels fail amid shifting institutional ETF dynamics. - Texas's $5M IBIT purchase highlights growing government interest, but ETFs fall short of direct BTC ownership criteria. - Technical analysis shows Bitcoin trapped in a broadening wedge pattern, with breakdown below $80,000 risking $53k decline. - Institutional rebalancing sees $66M IBIT outflows vs. $171M FBTC inflows, signaling tactical ETF rotation over accumulation. - Abu Dhabi's $238M ETF

Bitget-RWA2025/11/28 10:44
Bitcoin News Update: Institutional ETF Adjustments Challenge Key Bitcoin Support Thresholds

XRP News Today: IMF Cautions That Rapid Tokenized Markets Could Intensify Crashes in the Absence of Regulation

- IMF warned tokenized markets like XRP could worsen flash crashes without regulation, citing risks from decentralized systems lacking traditional safeguards. - Report acknowledged tokenization's potential to cut cross-border payment costs but highlighted volatility risks from rapid liquidity loss seen in crypto markets. - SEC's approval of crypto ETFs signals growing institutional acceptance, though regulators emphasize oversight frameworks to mitigate systemic risks. - IMF proposed a global digital marke

Bitget-RWA2025/11/28 10:44
XRP News Today: IMF Cautions That Rapid Tokenized Markets Could Intensify Crashes in the Absence of Regulation