Connect with us

News

Hot French startup ZML releases free product to speed inference across lots of AI chips

info

Published

on

ZML founder Steeve Morin.jpg

The days of Nvidia’s unparalleled market dominance aren’t over, but challengers and choices are arising from all directions.

ZML, a hot French AI startup endorsed by Turing Award winner Yann LeCun, has released inference-performance software that allows a variety of open-source large language models to run on a variety of chips — including Nvidia’s, AMD’s, Google’s TPU, Apple Metal and Intel Arc.

With ZML/LLMD, the newly launched LLM inference server, the company’s ambition is to break existing silos and make different chips available for AI use cases at their maximum available speed, and sometimes faster, ZML founder Steeve Morin told TechCrunch.

As AI becomes integrated into our work and everyday lives, optimizing inference — aka, the processing of prompts — has been outpacing model training in importance, but often feels patchy behind the scenes, with software and architecture barriers that lead to vendor lock-in, Morin said.

The promise of achieving peak performance across a variety of chips is a technological feat, but it could also be a market disruptor, amid mounting fears over AI-related costs.

ZML hopes to provide enterprises and clouds with the option to use a mix of chips, some of which might be less costly or consume less energy. “The idea is to give people back the power to create their own system and achieve real efficiency gains that allow [AI] to be disseminated,” Morin said.

Such a software assist may help novel AI chipmakers, many of which happen to be from Europe, Morin observed, citing Axelera, Fractile, Kalray, OLIX, Q.ANT, SiPearl, SpiNNcloud, and VSORA. But more than their region of origin, what matters to him is that ZML can work with them on “things that haven’t been done before anywhere in the world.”

That doesn’t mean Morin is bearish on Nvidia. He’s not, in part because of its existing supply. He told TechCrunch that ZML has a good relationship with the AI chip giant, which has been gearing up for the rise of inference.

Inference has been an area of such intense investment, that the trend has been hailed the “inference gold rush.” So ZML has competition such as Baseten, recently valued at $13 billion; Inferact, from the creators of open source project vLLM; as well as RadixArk, the commercial company behind SGLang.

Both vLLM and SGLang partially compete with LLMD, but Morin’s ambitions for ZML cover a broader spectrum. “We have reached the point where we are co-designing silicon,” he said. He further credited ZML’s lean team of 20 people as the reason why the Paris-based startup has been able to move fast, with more releases in the plans.

It also helped that this small team is well funded for its size. Thanks to his track record as VP of engineering of Zenly, which Snapchat acquired for nine figures in 2017, Morin raised $20 million from venture firms including Harry Stebbings’ 20VC, >commit, AALVC, Drysdale Ventures, Xavier Niel’s Kima Ventures, Kindred Capital, LocalGlobe, and Puzzle Ventures.

Unlike ZML’s first public project, the inference-focused ML framework released in 2024 and updated in March, ZML/LLMD is not open source. But it is launching as a free product with the goal of learning about usage. “I’d rather measure and [then generate revenue] where it is most effective without hindering my growth stupidly because I have been too greedy from the get-go,” Morin said.

It is too early to tell when ZML/LLMD might become a paid product, and what its adoption will look like. But the startup’s cap table confirms that other founders are paying attention, including Dagger and Docker founder Solomon Hykes, Clément Delangue and Julien Chaumond from Hugging Face, as well LeCun, now with AMI Labs. This also builds the case that Europe’s AI startups can now build from home. “I couldn’t do ZML anywhere but in Paris,” Morin said.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

News

PDP supporters attacked in Calabar, many injured, vehicles damaged

info

Published

on

Pdp.jpg

Several supporters of the Peoples Democratic Party, PDP, were injured while vehicles belonging to members of the party were damaged during the party’s consultative tour of Calabar South Local Government Area of Cross River State on Thursday.

The PDP governorship candidate, Sir Arthur Jarvis-Archibong, said the first attack occurred at the palace of the Paramount Ruler of Calabar South, Etubom Nyong Edet Okon I, where gunmen allegedly disrupted the meeting and injured three persons.

He said the victims were taken to hospital for treatment, adding that the violence later escalated at the African Club along Calabar Road, where another meeting was scheduled.

According to him, hoodlums allegedly shot at the party’s convoy and damaged vehicles belonging to members of the consultative team.

Recommended

Jarvis-Archibong said about 3,000 supporters attended the exercise and that the party had notified the police ahead of the tour, expecting adequate security.

He said the party restrained its supporters from retaliating and instead moved its convoy to the Commissioner of Police for protection.

The candidate said the PDP would petition the Inspector-General of Police, the Department of State Services (DSS) and other relevant security agencies over the incidents.

He warned that continued attacks on political activities could undermine the democratic process and lead to a breakdown of law and order as preparations for the 2027 elections intensify.

The PDP State Publicity Secretary, in a separate statement, condemned the attacks and urged security agencies to identify and prosecute those responsible.

The party said it had reported the incidents to the Commissioner of Police, Cross River Command, and appealed to its members to remain calm and avoid retaliatory actions.

However, the state chapter of the All Progressives Congress (APC) denied responsibility for the incident.

The APC Publicity Secretary, Emmanuel Inyang, said the PDP should look elsewhere for those responsible, adding that the party was focused on its own political activities.

The Cross River State Police Command confirmed the incidents and said personnel had been deployed to the affected locations.

The command’s spokesman, ASP Sunday Eitokpah, said police were verifying reports of gunfire, injuries and damage to property, adding that the situation was under control.

He advised residents to remain calm, avoid affected areas where necessary and refrain from circulating unverified information, while assuring that police presence and monitoring had been strengthened to maintain peace and public order.

Continue Reading

Health

Plateau: Medical Women Association of Nigeria Marks Older Persons Day with Free Outreach

info

Published

on

FB IMG

 

The Medical Women Association of Nigeria (MWAN) Plateau State, in collaboration with the Plateau State Specialist Hospital, has organised a free medical outreach for persons aged 60 and above in Jos.

The outreach, held to commemorate the 2026 International Day of Older Persons, featured free medical consultations, health talks, eye and ear examinations, blood pressure and blood sugar checks, general health screening and provision of basic medications.

FB IMG

The programme was held on October 2, a day after the official International Day of Older Persons, which is observed globally every October 1.

The 2026 celebration is themed “The Age of Longevity: Rethinking Systems for Longer Lives.”

FB IMG

Speaking during the event, Plateau State Commissioner for Health, Nicholas Ba’amlong, represented by the Director of Medical Services, Dr Stephen Bishmang, reaffirmed the state government’s commitment to strengthening the health system and ensuring access to healthcare regardless of age, status or circumstance.

Bishmang commended MWAN and the Plateau State Specialist Hospital for organising the outreach, noting that collaboration between government, healthcare professionals and civil society organisations could help improve healthcare delivery and the wellbeing of older persons.

FB IMG

State President of MWAN, Sekyen Sana, said the initiative was aimed at addressing the healthcare needs of older persons and helping them live healthier and more fulfilling lives.

She noted that ageing is a natural process and should not necessarily be associated with sickness, stress or emotional difficulties.

Sana said MWAN wants older persons to remain healthy, happy and able to enjoy their lives while encouraging them to pay greater attention to their health.

FB IMG

The Chief Medical Director of Plateau State Specialist Hospital, Professor Christopher Yilgwan, represented by Barnabas Saidu, welcomed the beneficiaries and encouraged them to take advantage of available healthcare services.

He also urged retirees and older persons who had not been enrolled in the state health insurance programme to make enquiries and register so they could access available medical services.

Saidu stressed the importance of regular health checks, noting that medical conditions can be identified and treated more effectively when detected early.

FB IMG

Also speaking, the Plateau State Chairman of the Nigeria Medical Association, Dr Shainan Andrew, pledged continued collaboration with MWAN and other stakeholders to expand healthcare interventions for older persons.

Andrew encouraged the beneficiaries to seek medical advice, ask questions about their health and take advantage of available healthcare services.

One of the beneficiaries, Da Samuel Davou, expressed appreciation to the organisers for providing the free medical services.

The organisers appealed to government agencies, non-governmental organisations, companies and other stakeholders to support similar initiatives to enable more older persons to access healthcare and enjoy healthier lives.

FB IMG FB IMG  FB IMG FB IMG   FB IMG

Continue Reading

Trending