In January, we gave ourselves 2 to 3 years to figure out the science behind building a new compute substrate to cut the power consumption of AI systems by 1,000x. We got there in 9 months, by answering these three questions:
Can you compute with dynamics?
Yes. The brain doesn't have floating point operations or instruction sets. It forms neural pathways when you learn and traverses them when you perform a task. Our systems work the same way: training sets the weights, a token perturbs the system, and the final state is the answer.
Is it power efficient?
Yes. Our first chip taped out on June 1st and is back in the lab. The power numbers are orders of magnitude below traditional inference systems.
Does it scale?
Yes, and this was the big one. A fully connected system needs trillions of wires, and nobody can physically build that. We found that cutting connections to roughly 2 to 3% improves output quality and learning and allows you to scale.
Watch @theCUBE where our CFO @aesfahani and @furrier discuss the research that brought us to the tape-out: youtube.com/watch?v=opkfSQ…
Can you compute with dynamics?
Yes. The brain doesn't have floating point operations or instruction sets. It forms neural pathways when you learn and traverses them when you perform a task. Our systems work the same way: training sets the weights, a token perturbs the system, and the final state is the answer.
Is it power efficient?
Yes. Our first chip taped out on June 1st and is back in the lab. The power numbers are orders of magnitude below traditional inference systems.
Does it scale?
Yes, and this was the big one. A fully connected system needs trillions of wires, and nobody can physically build that. We found that cutting connections to roughly 2 to 3% improves output quality and learning and allows you to scale.
Watch @theCUBE where our CFO @aesfahani and @furrier discuss the research that brought us to the tape-out: youtube.com/watch?v=opkfSQ…
0 0 2 16 1.8K 4
Naveen Rao