jdagostino.github.io

AI At Home Part 1: A Box Of Scraps

timmmmmmay · 120 points · 56 comments · 19 giờ trước · Open original

Comments

5 preview comments · loading full thread
numpad014 giờ trước

> The cards had some kind of metal cable guide fin on the back That's to slot into the front PCI brackets for full length cards. There's "full" size for PCI cards and most GPUs are considered "half" length cards. This is separate to Low Profile, so there are four possible slot compatibility configurations, namely HHHL, HHFL, FHFL, and FHHL. Real workstations(including Mac Pro) has slots cut in the case or a bracket to accept the card or that metal piece(which means a standardized solution to GPU sagging had existed even before PCIe was created). Also, on fans, it's not like blower fans are quieter at all, but in case anyone encounters a situation where turning up fans seem to be only creating noises without moving air or cooling yhe cards, it might be worth remembering that radial fans have higher static pressure and are better at forcing air through. edit: ps: people recreating this might want to know what case this is. The vast majority of ATX cases, even unnecessarily big ones, only has 7 PCI slots. Cases that can take four dual-slot cards is rare.

Aurornis17 giờ trước

> I got these 10,000 RPM fans because I wanted to make sure I was moving enough air, and they were the same price as slower fans. They are really loud! I wanted the motherboard to control their speed based on the GPU temperature, and this didn't work at first, so I just wore ear protection during initial setup. I think everyone remembers the first time they went from "I think I can tolerate some server fans. How loud can they be?" to "I had no idea a small 12V fan could be this loud"

comandillos17 giờ trước

I ended up buying 2 DGX Sparks interconnected over QSFP with the intention of getting rid (as much as I could) of any cloud-based AI provider. I'm running DS4 Flash 0731 on it and some OCR models, using Oh My Pi and OpenWebUI as my main ways to interface with the agent... and from someone that has been using Claude for a long time, I can definitely say I don't need it anymore. Not for the stuff I'm doing.

rsolva15 giờ trước

I love this! Hacky recycling of old computer parts, home-cooked fan controllers and a website that is just plain HTML with a stylesheet that is so short I don't even have to scroll to read it all. Just write part 2 already, I want to know what you can squeeze out of those AMD cards <3

fabiensanglard17 giờ trước

Quite courageous to go with AMD. I am very curious to see Chapter 2 and how he solves the software stability that used to plague AMD AI applications.