lostmsu · 53 points · 10 comments · il y a 23 heures · Open original
Inspired by minGPT for home experiments.
Requires CUDA 13.4; build script is Windows only.
Comments
5 preview comments · loading full thread
Log in to use comments
Log in to h4cker, then connect Hacker News to publish comments.
_3_345il y a 20 heures
Trying to be a little less negative than the guy that got flagged, I too don't understand the motivation behind these projects. I've seen a hundred of them at this point- and each of them is probably worse and has less learning value than the one Andrej Karpathy made to teach people the building blocks involved in a GPT
So, why do people keep making these? Asking genuinely
VJvjsrinivasil y a 20 heures
Interesting trend of labeling models after how big they are on disk vs how many learnable parameters they have.
JEjeyil y a 22 heures
At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little
Comments
5 preview comments · loading full threadLog in to h4cker, then connect Hacker News to publish comments.
Trying to be a little less negative than the guy that got flagged, I too don't understand the motivation behind these projects. I've seen a hundred of them at this point- and each of them is probably worse and has less learning value than the one Andrej Karpathy made to teach people the building blocks involved in a GPT So, why do people keep making these? Asking genuinely
Interesting trend of labeling models after how big they are on disk vs how many learnable parameters they have.
At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little
"hn1g.txt" => not available
[deleted]