Connect with us

News

Hot French startup ZML releases free product to speed inference across lots of AI chips

info

Published

on

ZML founder Steeve Morin.jpg

The days of Nvidia’s unparalleled market dominance aren’t over, but challengers and choices are arising from all directions.

ZML, a hot French AI startup endorsed by Turing Award winner Yann LeCun, has released inference-performance software that allows a variety of open-source large language models to run on a variety of chips — including Nvidia’s, AMD’s, Google’s TPU, Apple Metal and Intel Arc.

With ZML/LLMD, the newly launched LLM inference server, the company’s ambition is to break existing silos and make different chips available for AI use cases at their maximum available speed, and sometimes faster, ZML founder Steeve Morin told TechCrunch.

As AI becomes integrated into our work and everyday lives, optimizing inference — aka, the processing of prompts — has been outpacing model training in importance, but often feels patchy behind the scenes, with software and architecture barriers that lead to vendor lock-in, Morin said.

The promise of achieving peak performance across a variety of chips is a technological feat, but it could also be a market disruptor, amid mounting fears over AI-related costs.

ZML hopes to provide enterprises and clouds with the option to use a mix of chips, some of which might be less costly or consume less energy. “The idea is to give people back the power to create their own system and achieve real efficiency gains that allow [AI] to be disseminated,” Morin said.

Such a software assist may help novel AI chipmakers, many of which happen to be from Europe, Morin observed, citing Axelera, Fractile, Kalray, OLIX, Q.ANT, SiPearl, SpiNNcloud, and VSORA. But more than their region of origin, what matters to him is that ZML can work with them on “things that haven’t been done before anywhere in the world.”

That doesn’t mean Morin is bearish on Nvidia. He’s not, in part because of its existing supply. He told TechCrunch that ZML has a good relationship with the AI chip giant, which has been gearing up for the rise of inference.

Inference has been an area of such intense investment, that the trend has been hailed the “inference gold rush.” So ZML has competition such as Baseten, recently valued at $13 billion; Inferact, from the creators of open source project vLLM; as well as RadixArk, the commercial company behind SGLang.

Both vLLM and SGLang partially compete with LLMD, but Morin’s ambitions for ZML cover a broader spectrum. “We have reached the point where we are co-designing silicon,” he said. He further credited ZML’s lean team of 20 people as the reason why the Paris-based startup has been able to move fast, with more releases in the plans.

It also helped that this small team is well funded for its size. Thanks to his track record as VP of engineering of Zenly, which Snapchat acquired for nine figures in 2017, Morin raised $20 million from venture firms including Harry Stebbings’ 20VC, >commit, AALVC, Drysdale Ventures, Xavier Niel’s Kima Ventures, Kindred Capital, LocalGlobe, and Puzzle Ventures.

Unlike ZML’s first public project, the inference-focused ML framework released in 2024 and updated in March, ZML/LLMD is not open source. But it is launching as a free product with the goal of learning about usage. “I’d rather measure and [then generate revenue] where it is most effective without hindering my growth stupidly because I have been too greedy from the get-go,” Morin said.

It is too early to tell when ZML/LLMD might become a paid product, and what its adoption will look like. But the startup’s cap table confirms that other founders are paying attention, including Dagger and Docker founder Solomon Hykes, Clément Delangue and Julien Chaumond from Hugging Face, as well LeCun, now with AMI Labs. This also builds the case that Europe’s AI startups can now build from home. “I couldn’t do ZML anywhere but in Paris,” Morin said.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

News

‘We won’t trust INEC with our votes in 2027 election’ – ADC

info

Published

on

By

The African Democratic Congress (ADC) has declared that it will not trust the Independent National Electoral Commission (INEC) with its votes in the 2027 general election.

The party insisted that it would take steps to protect every vote cast for its candidates.

The National Publicity Secretary of the party, Mallam Bolaji Abdullahi, made the declaration on Wednesday in Ilorin while speaking with journalists during a walk organised to sensitise residents of the Kwara State capital about the party’s activities and preparations ahead of the 2027 elections.

Abdullahi said the party had resolved not to rely solely on the electoral umpire, despite acknowledging that there are officials within the commission who are committed to doing the right thing.

He said that although there are still committed officials within INEC, elections should not be conducted based on trust alone.

“We know what INEC is capable of. We trusted the commission during the 2023 general election, but the outcome left us disappointed. We will not make the same mistake again by relying solely on trust,” he said.

According to him, the ADC is determined to defend its votes across the country, regardless of the circumstances surrounding the election.

He said the party was confident that President Bola Tinubu would lose the election because it was determined to protect its votes, regardless of whether the election was free and fair.

“We are not going to tell you, but that is what we are going to do if we must win this election,” he stated.

Continue Reading

News

Controversy Trails NYSC’s Plan To Replace Khaki With Local Fabric

info

Published

on

By

NYSC Swears In Corps Members.jpeg

Controversy trails NYSC’s plan to replace khaki with local fabric

By Agnes Bature

Controversy has trailed the National Youth Service Corps’ plan to replace its iconic khaki uniform with local fabric, as corps members and stakeholders continue to debate the proposed change.

Some stakeholders who spoke with the News Agency of Nigeria (NAN) in Abuja, said the move would promote Nigeria’s rich cultural heritage and strengthen the local textile industry.

Others, however, argued that the traditional khaki uniform remained a symbol of unity, discipline, and the identity of the scheme.

Mr Yakubu Isaiah, a corps member, said that Nigerian fabric was distinct and could project the country’s culture globally.

“Wearing a local fabric as part of the NYSC uniform will showcase our culture to the world and make corps members stand out, instead of wearing another military-style uniform,” Isaiah said.

He added that large-scale production of the Nigeria local fabric for the scheme would create employment opportunities for local artisans, particularly women involved in textile production.

Another corps member, Miss Blessing Iwu, expressed reservations about the proposal, noting that the khaki uniform was durable and ensured uniformity.

“Khaki is strong and looks the same on everyone. Local fabric fades more easily, tears faster, and different production batches may have varying shades,” Iwu said.

She also expressed concern that quality local fabric could be more expensive if not subsidised by the government, forcing corps members to spend more on additional uniforms.

Miss Chidimma Chinedu, a resident of Beggar’s Yard, Abuja, supported the proposal, arguing that locally produced fabric would reduce dependence on imported materials.

Chinedu said that replacing khaki and some imported uniform materials with locally made fabric could help reduce import costs, conserve foreign exchange, and support local industries.

According to her, local fabric is also lighter and more breathable than khaki, making it more suitable for Nigeria’s hot climate, particularly during orientation camp.

Similarly, Mr Ayoola John, a corps member serving in an engineering firm in Abuja, said the adoption of local fabric would give the NYSC scheme a distinctive Nigerian identity.

John said that passing-out parades, community development service activities, and official photographs would better reflect Nigeria’s cultural heritage and foster greater national pride.

Miss Hamzat Osigwe, a graduate of Agricultural Science, University of Jos, however, cautioned that the success of the proposal would depend largely on its implementation.

“Some young people fear it may become another policy that is poorly implemented. If the local fabric supplied is of poor quality or distributed late, it will create unnecessary challenges during orientation camp,” Osigwe said.

She also argued that the khaki uniform symbolised discipline, unity, and national service, adding that replacing it with a cultural fabric could alter public perception of the scheme.

NAN reports that the proposal was first announced by the Minister of Youth Development, Mr Ayodele Olawande, who suggested replacing the traditional khaki uniform with locally produced fabrics.

NAN reports that the idea is to promote Nigeria’s textile industry, create jobs, and retain government spending within the country.

The announcement, however, sparked widespread reactions on social media, particularly on X, with many Nigerians expressing divergent views. (NAN) (www.nannews.ng)

BA/AIR/DE

============

Edited by Abujah Racheal/Dorcas Jonah/

Continue Reading

Trending