github.com

Show HN: TurboGPT: train 22KiB transformer in 13s

lostmsu · 53 points · 10 comments · 23시간 전 · Open original

Inspired by minGPT for home experiments. Requires CUDA 13.4; build script is Windows only.

Comments

5 preview comments · loading full thread
_34520시간 전

Trying to be a little less negative than the guy that got flagged, I too don't understand the motivation behind these projects. I've seen a hundred of them at this point- and each of them is probably worse and has less learning value than the one Andrej Karpathy made to teach people the building blocks involved in a GPT So, why do people keep making these? Asking genuinely

vjsrinivas20시간 전

Interesting trend of labeling models after how big they are on disk vs how many learnable parameters they have.

jey22시간 전

At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little

w4yai20시간 전

"hn1g.txt" => not available

pane_poker_1120시간 전

[deleted]