CONNECT WITH US
Apple

Apple

Tiny's new AI workstation is anything but — packing in 16 TB SSD array and 128 GB GPU memory, but with an eye-watering price tag to boot

TechRadar - Apple logo

Published on

Add as a preferred source on Google
Tiny's new AI workstation is anything but — packing in 16 TB SSD array and 128 GB GPU memory, but with an eye-watering price tag to boot

There is nothing tiny about Tiny Corp's latest tinybox, the tinybox Red Kimi: It costs a mammoth $30,000 and pairs four AMD Radeon AI Pro R9700 graphics cards with sixteen 1 TB NVMe SSDs, all with one goal in mind: running Moonshot AI's 2.8-trillion-parameter Kimi K3 on a desk rather than in a data center.

Each R9700 carries 32 GB of GDDR6 at 640 GB/s, giving the four cards 128 GB of GPU memory and 2,560 GB/s of aggregate bandwidth to go with a system built on Tiny Corp's G5 platform, with a 32-core AMD Epyc Genoa processor whose exact model the tinybox configurator doesn't name, and a modest 32 GB of DDR5 system memory in tow.

Tiny Corp claims the machine can run Kimi K3 at 40 tokens per second, a figure nobody outside the company has tested yet.

The storage in play is the unique selling point for Tiny Corp's behemoth: its 16 drives form a RAID array rated at 238.4 GB/s, and Tiny Corp says its tinygrad software now includes a driver that lets the AMD GPUs control the NVMe drives directly, rather than routing every read through the CPU.

Sharing the system's topology on X, the company pitched the result as "frontier models at home at usable speeds for a good price."

The rationale comes down to capacity. 56 TB. The four GPUs can hold about 8% of that, so the rest has to live somewhere, and Tiny Corp has picked considerably cheaper flash over DRAM.


Source link
Related Topics:Apple

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.