🎁 Dev Box DPU Upgrade 🎁
-
🎁 Dev Box DPU Upgrade 🎁
More ZFS PoC for vGPU + DOCA blah blah NVMe-oF offloads
Left–to–Right (lotta slots)
- Broadcom CNA 2x10G
- Optane P3608 2x 2TB NVMe AIC
- Nvidia T10 16GB GPU (w/ 90mm blower)
- blank
- Nvidia T10 16GB GPU (w/ 90mm blower)
- Nvidia Bluefield2 DPU 16GB RAM, 2x 25G
- Optane 4x 512GB NVDIMM
- Samsung 4x 32GB ECC Volatile
- Intel Xeon 8370C (Azure) 32C/64T 270WChassis cooled by 2x 180mm, 1x 140mm, 1x 120mm. Idles very comfortably below 40dB, wind-tunnel at full rpm is more like whoooooshing than the usual 28K-RPM 40mm axial fan screamers people expect from enterprise hardware. Choose wisely.
#gpu #dpu #ai #dev #llm #nvidia #intel #optane #zfs #linux #freebsd
-
🎁 Dev Box DPU Upgrade 🎁
More ZFS PoC for vGPU + DOCA blah blah NVMe-oF offloads
Left–to–Right (lotta slots)
- Broadcom CNA 2x10G
- Optane P3608 2x 2TB NVMe AIC
- Nvidia T10 16GB GPU (w/ 90mm blower)
- blank
- Nvidia T10 16GB GPU (w/ 90mm blower)
- Nvidia Bluefield2 DPU 16GB RAM, 2x 25G
- Optane 4x 512GB NVDIMM
- Samsung 4x 32GB ECC Volatile
- Intel Xeon 8370C (Azure) 32C/64T 270WChassis cooled by 2x 180mm, 1x 140mm, 1x 120mm. Idles very comfortably below 40dB, wind-tunnel at full rpm is more like whoooooshing than the usual 28K-RPM 40mm axial fan screamers people expect from enterprise hardware. Choose wisely.
#gpu #dpu #ai #dev #llm #nvidia #intel #optane #zfs #linux #freebsd
@winterschon what is the usecase of this monster? Local LLM or something else?
-
@winterschon what is the usecase of this monster? Local LLM or something else?
@madduci it runs VMs on an RDMA network, messing with ZFS + NVMe-oF and vGPU slices. basically scale-model engineering for 100+ node HPC clusters that are running 480b models.