The Lounge is rated Safe For Work. If you're about to post something inappropriate for a shared office environment, then don't post it. No ads, no abuse, and no programming questions. Trolling, (political, climate, religious or whatever) will result in your account being removed.
The world's largest chip, weighing in at an unbelievable 400,000 cores, 1.2 trillion transistors, 46,225 square millimeters of silicon, and 18 GB of on-chip memory, all in one chip that is as large as an entire wafer. Add in that the chip sucks 15kW of power and features 9 PB/s of memory bandwidth:
The system measures a mere 15 Rack Units tall, or roughly 26", so three can fit in a single rack. Given the performance, that's an incredibly compact package: It would take a 1,000-GPU cluster, which consumes 15 entire racks and half a megawatt of power, to match the performance of one CS-1 system. That's because a single Cerebras chip has 78 times more cores, 3,000 times more memory, and 10,000 times more memory bandwidth than a single GPU. It also has 33,000 times more bandwidth (PB/s).
«One day it will have to be officially admitted that what we have christened reality is an even greater illusion than the world of dreams.» Salvador Dali
They compared its 400k cores to a GPU with 5k cores, so they are probably continuing the bad tradition of calling SIMD lanes "cores", IIRC that's something GPU vendors started (specifically nVidia and their "CUDA processors", AMD likes to call them "stream processors" which is fine I guess?). Or maybe it's even counting some more specialized component such as 8-bit multipliers (important in deep learning) or whatever, who knows, actually if someone knows please explain.
Either way it's a beastly processor, actually either way it's the same processor, I just think their marketing material is deliberately misleading about its internal organization.
I pride myself that I don't scare too easily, with one exception:
After a recent clean install on my machine (A Dell desktop), I thought it's a good time to run Dell's update utility. It gave me the dreaded message: "Your BIOS needs updating"! I do understand a little about BIOS systems and what can happen if you write a new BIOS to the main board and the process gets interrupted or fails for any reason. In many instances you can kiss your main board goodbye!
So with trembling fingers I told Dell Update to proceed, eyes glued to the main monitor. I blush to disclose that I may even have uttered a silent prayer - my first in a long time. Things did not seem to go very smoothly. The machine must have restarted about 5 times. At this stage my nails were gone!
Finally after many minutes, the machine restarted a final time and I was greeted with the running cursor as Windows loaded. I breathed out and collapsed behind the keyboard. What a hair-raising experience!