Among the companies adopting the Hailo-10H is HP Inc., which is using the chip as the basis for the HP AI Accelerator M.2 Card that can integrate “seamlessly” with HP point-point sale services as well as HP workstations and commercial PCs.
Nvidia rival Hailo on Tuesday announced the general availability of its second-generation AI accelerator chip, saying that the product is the first of its kind to “bring real generative AI performance to the edge” while consuming very little energy.
Hailo, an Israel-based AI chip startup, said the Hailo-10H chip is capable of 40 trillion operations per second (TOPS) of 4-bit integer (INT4) performance and 20 TOPS of 8-bit integer (INT8) performance using 2.5 watts. By contrast, Nvidia’s Jetson Orin Nano chips can hit up to 67 TOPS of INT8, which is double the size of INT4, but has a power range of 7-25 watts.
[Related: 7 New, Cutting-Edge AI Chips From Nvidia And Rivals In 2025]
Designed for edge devices across consumer, enterprise and automotive markets, the Hailo-10H combines “high efficiency, cost-effectiveness and a robust software ecosystem,” which is backed by its “mature and widely adopted software stack” that’s used by more than 10,000 monthly users, according to the startup.
Among the companies adopting the Hailo-10H is HP Inc., which is using the chip as the basis for the HP AI Accelerator M.2 Card that can integrate “seamlessly” with HP point-point sale services as well as HP workstations and commercial PCs.
The startup said the Hailo-10H can enable advanced use cases like natural language human-machine interaction, visual awareness and multi-modal AI to run seamlessly within the power and cost constraints typical of edge environments.”
In performance benchmarks conducted by Hailo, the chip was shown to achieve a “first-token latency of under 1 second and over 10 tokens per second” on various 2-billion-parameter language and vision-language models, according to the startup.
Hailo, which is among several AI chip startups challenging Nvidia, works with a wide range of partners, from OEMs such as HP, Dell and Advantech to distributors like J-Squared Technologies and Kaga Fei America, among others.
Founded in 2017, the startup has raised more than $340 million from investors, which includes $120 million for a Series C extension round it announced last year.
