Connect with us

News

OpenAI’s Jalapeño chip is built for fast inference at scale, benchmarks show

info

Published

on

Jalapeno chip final.jpeg

At the Hot Chips conference on Tuesday, OpenAI shared a more detailed look at Jalapeño, including the first batch of benchmark results for the new system. Tested on Semianalysis’s InferenceX benchmark, Jalapeño registered both more tokens per user and more throughput per kilowatt than the currently available state-of-the-art inference processors.

“The bottom line is that the results show a very, very significant performance advance over state of the art,” said Richard Ho, OpenAI’s head of hardware, in a press call. “Jalapeño can serve more AI work per unit of power, while also returning responses more quickly. It’s very efficient to serve a lot of customers, but it can also be very low latency.”

Notably, that comparison is against an Nvidia Blackwell system — but by the time Jalapeño reaches full deployment, the competition may have advanced significantly. Ho estimated that Jalapeño would deploy at the end of 2026 “in very small volumes,” with more significant deployment coming in 2027.

First announced last October, Jalapeño was developed by OpenAI in close collaboration with Broadcom, with OpenAI’s own models assisting in the development process. The company plans to make Jalapeño a multigenerational platform, allowing AI products, models, chips and memory all developed in concert.

Because of that full-stack approach, OpenAI was able to address specific phases in the inference process that often cause friction during inference processing. In particular, Jalapeño is designed to minimize delays during the prefill and communication phases of processing, which OpenAI says often act as bottlenecks.

“We designed Jalapeño to minimize data movement and communication delays,” the company said in a blog post presenting the results. “This means that model state, including the KV cache used while generating a response, can be explicitly placed and kept local while the system activates the right combination of compute, memory, and networking for each inference phase.”

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

News

Osimhen Scores Again But Injury Scare Raises Fresh Concern For Super Eagles

info

Published

on

By

Osimhen Scores Again But Injury Scare Raises Fresh Concern For.jpg

Super Eagles striker Victor Osimhen produced a mixed night for Galatasaray on Friday, scoring against İstanbul Başakşehir before being forced off with an injury that could raise concerns over his availability for Nigeria’s upcoming 2027 Africa Cup of Nations qualifiers.

Osimhen opened the scoring in the 17th minute with a stunning effort to put Galatasaray ahead.

Read Also: “My Injury Changed Everything” — Aiyegbeni Reveals How Achilles Blow Ruined Chelsea Move

However, his night was cut short after he appeared to suffer a problem following a challenge with Christopher Operi in the 23rd minute. The Nigerian striker continued briefly but later felt the problem again after making a run behind the defence and signalled that he could not continue.

Osimhen was eventually substituted in the 33rd minute, with Barış Alper Yılmaz coming on as his replacement.

Initial reports describe the problem as a suspected muscle/groin injury, but there is currently no confirmed diagnosis or recovery timeline. Osimhen himself reportedly admitted after the incident that he did not yet know whether the injury was serious.

The timing could be significant for Nigeria.

The Super Eagles are scheduled to begin their 2027 AFCON qualifying campaign against Madagascar on September 23, before travelling to face Guinea-Bissau on September 27.

That leaves Nigeria with just under three weeks before the Madagascar encounter, meaning Osimhen could still have time to recover if the injury proves minor. However, a significant muscle strain or tear could put his participation in doubt.

For now, Osimhen has not been ruled out of the Super Eagles’ upcoming matches, and his availability will depend on further medical examinations and his recovery over the coming days.

The immediate concern for Nigeria will therefore be the results of those assessments.

He scored a spectacular goal, but the biggest question tonight is whether Osimhen will be fit when Nigeria need him most.

Continue Reading

News

AI compute provider Nscale is looking for $3.5B in pre-IPO financing

info

Published

on

By

GettyImages 2266843677.jpg

Nscale, a British AI infrastructure company founded just two years ago, has said it may go public as early as later this month. Ahead of that expected IPO, the company is reportedly in talks to raise an additional $3.5 billion.

Bloomberg reported Friday that the company is looking to sell $1.5 billion in convertible notes — a type of loan that can later convert into company stock — to a group of investors, while also seeking an additional $2 billion in financing from Nvidia.

Nvidia also participated in the firm’s Series B funding round in March, a $1.1 billion raise led by investment fund Aker. Nscale hailed its round as “the largest Series B in European history.” The company’s Series A round, in December of 2024, raised $155 million.

TechCrunch reached out to Nscale and Nvidia for comment.

AI infrastructure startups have seen immense growth amid the current era of AI enthusiasm, wherein compute has become a competitive currency.

Nscale recently signed a large deal with Anthropic worth approximately $45 billion. Earlier this week, reports emerged that Nscale had been telling potential investors that it has approximately $103 billion in revenue following the deal. That figure isn’t current sales; it’s a projection based on signed customer leases, according to The Information.

Continue Reading

Trending