Preferred Networks: A 500 W Custom PCIe Card using 3000 mm2 Silicon

Pushing the physical limits of hardware is always a fun story, but I was positively blown away when I saw this poster at Supercomputing. Preferred Networks, seemingly a spin-out from Tokyo University, is shoving several large chiplets into a single PCIe card for peak performance, peak power, and it looks like they’re ready to deploy over 4800 of these cards into a custom supercomputer.