A new AI chip developed at the Technical University of Munich (TUM) works without the cloud server or internet connections needed by existing chips. The AI Pro, designed by Prof Hussam Amrouch, is modeled on the human brain. Its innovative neuromorphic architecture enables it to perform calculations on the spot, ensuring full cyber security. It is also up to 10 times more energy efficient.
The professor of AI processor design at TUM has already had the first prototypes produced by semiconductor manufacturer Global Foundries in Dresden. Unlike conventional chips, the computing and memory units of the AI Pro are located together. This is possible because the chip applies the principle of “hyperdimensional computing”: This means that it recognizes similarities and patterns, but does not require millions of data records to learn.
Instead of being shown countless images of cars, as with the deep learning method used in conventional AI chips, this chip combines various pieces of information, such as the fact that a car has four wheels, usually drives on the road, and can have different shapes. Like the new chip, explains Prof. Amrouch, “humans also draw inferences and learn through similarities.”
An important advantage of brain-like thinking: it saves energy. For the training of a sample task, the new chip consumed 24 microjoules, while comparable chips required 10 to 100 times more energy—”a record value,” notes Prof. Amrouch. “This mix of modern processor architecture, algorithm specialization and innovative data processing makes the AI chip something special.”
This also sets it apart from all-rounders like the chips from industry giant NVIDIA. “While NVIDIA has built a platform that relies on cloud data and promises to solve every problem, we have developed an AI chip that enables customized solutions. There is a huge market there.”
The research is under review for the European Solid-State Electronics Research Conference (ESSERC 2025).
Neuromorphic chips: Modeled on the human brain
The one-square-millimeter chip currently costs 30,000 euros. With about 10 million transistors it is not quite as densely packed or as powerful as NVIDIA chips with 200 billion transistors. But that is not Prof. Amrouch’s primary concern. His team specializes in AI chips that perform the processing directly on site instead of having to send the data to the cloud to be processed along with millions of other data sets before being sent back again. This saves time and server computing capacity and reduces the carbon footprint of AI.
The chips are also customized for specific applications. “That makes them very efficient,” says chip expert Amrouch. For example, they focus on processing heart rate and other vital data collected via smartwatch or navigation data of a drone. Because this personal and sometimes sensitive data remains on board the device, issues with stable internet connections or cybersecurity do not even arise. “The future belongs to the people who own the hardware,” says Amrouch.
More information:
End-to-end Hyperdimensional Computing with 24.65 µJ per Training Sample in 22 nm Technology. www.ce.cit.tum.de/fileadmin/w0 … h_KI_Chip_ESSERC.pdf
Technical University Munich
Citation:
AI chip developed for decentralized use without the cloud (2025, May 19)
retrieved 19 May 2025
from https://techxplore.com/news/2025-05-ai-chip-decentralized-cloud.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.
