4,000,000,000,000 Transistors, One Giant Chip (Cerebras WSE-3)

Video Description

The only company with a chip as big as your head, Cerebras has a unique value proposition when it comes to AI silicon. Today they are announcing their third generation Wafer Scale Engine, called WSE-3. Built on 5nm, this chip increases the cores to over 900,000, has four trillion transistors, and doubles training performance over WSE-2. Each system costs a few million, but the price hasn't gone up, and these systems are being used globally to overcome the bottlenecks that GPUs can't get rid of. [00:00] Sneaky Snek [00:19] Moore's Law isn't Dead [02:00] Tasty Chip (specifications) [03:00] 2x Perf, 2x TCO [04:52] 250 ExaFLOPs in one Supercomputer [06:00] Eliminate GPU Bottlenecks [07:30] The Business Model [09:10] Partnership with Inference [11:12] Co-designed software [14:44] Wafer bite tax ----------------------- Need POTATO merch? There's a chip for that! http://merch.techtechpotato.com http://more-moore.com : Sign up to the More Than Moore Newsletter https://www.patreon.com/TechTechPotato : Patreon gets you access to the TTP Discord server! Follow Ian on Twitter at http://twitter.com/IanCutress Follow TechTechPotato on Twitter at http://twitter.com/TechTechPotato If you're in the market for something from Amazon, please use the following links. TTP may receive a commission if you purchase anything through these links. Amazon USA : https://geni.us/AmazonUS-TTP Amazon UK : https://geni.us/AmazonUK-TTP Amazon CAN : https://geni.us/AmazonCAN-TTP Amazon GER : https://geni.us/AmazonDE-TTP Amazon Other : https://geni.us/TTPAmazonOther Ending music: https://www.youtube.com/watch?v=2N0tmgau5E4 ----------------------- Welcome to the TechTechPotato (c) Dr. Ian Cutress Ramblings about things related to Technology from an analyst for More Than Moore #cerebras #waferscale3 #mooreslaw ------------ More Than Moore, as with other research and analyst firms, provides or has provided paid research, analysis, advising, or consulting to many high-tech companies in the industry, which may include advertising on TTP. The companies that fall under this banner include AMD, Armari, Baidu, Facebook, IBM, Infineon, Intel, Lattice Semi, Linode, MediaTek, NordPass, ProteanTecs, Qualcomm, SiFive, Supermicro, Tenstorrent, TSMC.