Explore AI

Intel's Hala Point: A symbiosis of Neuroscience and AI

Written by Henry Marshall | 19-Apr-2024 17:16:11

In the expansive landscape of artificial intelligence (AI) research, Intel has made a groundbreaking stride. Their scientists have constructed the world's largest neuromorphic computer, a machine architected to emulate the human brain's structure and function. This machine, christened "Hala Point," is poised to revolutionize AI research and applications.

Intel's Hala Point, a neuromorphic computer, is energized by over 1,000 state-of-the-art AI chips. This large-scale system comprises 1.15 billion artificial neurons and 128 billion artificial synapses distributed over 140,544 processing cores. Impressively, it can perform AI workloads 50 times quicker and consume 100 times less energy than conventional computing systems employing central processing units (CPUs) and graphics processing units (GPUs), according to Intel representatives.

The formidable power of Hala Point lies in its ability to perform 20 quadrillion operations per second, or 20 petaops. This is a significant leap over Trinity, the 38th most powerful supercomputer globally, which offers approximately 20 petaFLOPS of power, where a FLOP is a floating-point operation per second.

Neuromorphic computing diverges from conventional computing in its architectural design. While classical computing involves binary bits of 1s and 0s feeding into hardware like the CPU, GPU, or memory for sequential calculations before yielding a binary output, neuromorphic computing operates differently.

In neuromorphic computing, a "spike input" — a set of discrete electrical signals — is fed into the spiking neural networks (SNNs), represented by the processors. These SNNs, akin to neurons in a human brain, allow for parallel processing, and spike outputs are measured following calculations. One of the key achievements of Hala Point is its high energy efficiency reading for AI workloads of 15 trillion operations per watt (TOPS/W). This is a significant improvement over conventional neural processing units (NPUs) and other AI systems, which typically achieve well under 10 TOPS/W.

Neuromorphic computing is a burgeoning field, with limited machines like Hala Point in deployment. However, this is set to change, with research intensifying in this area, and more such machines expected to be rolled out in the future. Future neuromorphic computers might even influence the evolution of large language models (LLMs) like ChatGPT, enabling them to learn continuously from new data. This would significantly reduce the extensive training burden inherent in current AI deployments.

While Hala Point is currently a "starting point" and a research prototype, it will eventually feed into future systems that could be deployed commercially, according to Intel representatives. This heralds a new era in AI, with neuromorphic computing potentially becoming a mainstream technology.

#ai
#digitaltransformation
#artificialintelligence
#machinelearning