By comparison, Nvidia's Jetson Orin Nano chip's INT8 performance tops out at 67 teraflops, twice the performance of INT4, but consumes a power range of 7-25 watts.
Designed for edge devices in the consumer, enterprise and automotive markets, Hailo-10H combines "high efficiency, high cost-effectiveness and a robust software ecosystem" and is powered by its "mature and widely adopted software stack" used by more than 10,000 users per month, according to the startup.
Companies adopting Hailo-10H include Hewlett-Packard, which uses the chip as the basis for the HP AI Accelerator M.2 card, which integrates "seamlessly" with HP point-to-point sales services as well as HP workstations and business PCs.
The startup says Hailo-10H enables advanced use cases such as natural language human-computer interaction, visual perception and multi-modal artificial intelligence to operate seamlessly within the power and cost constraints typical of edge environments. "
The startup said that in performance benchmarks conducted by Hailo, the chip achieved "first token latency of less than 1 second and over 10 tokens per second across a variety of 2 billion parameter linguistic and visual language models."word element".
Hailo is one of several AI chip startups challenging NVIDIA, and its partners range from OEMs such as HP, Dell and Advantech to distributors such as J-Squared Technologies and Kaga Fei America.